Abstract

With increasing capability and complexity of surgical interventions, intra-operative visualization is becoming an important part of a surgical environment. This paper reviews some of our recent progress in the intelligent use of pre- and intra-operative data for enhanced surgical navigation and motion compensated visualization. High fidelity augmented reality (AR) with enhanced 3D depth perception is proposed to provide effective surgical guidance. To cater for large scale tissue deformation, real-time depth recovery based on stereo disparity and eye gaze tracking is introduced. This allows the development of motion compensated visualization for improved visual perception and for facilitating motion adaptive AR displays. The discussion of the paper is focused on how to ensure perceptual fidelity of AR and the need for real-time tissue deformation recovery and modeling, as well as the importance of incorporating human perceptual factors in surgical displays.

© 2008 IEEE

Factors in Human Visual Resolution*

Gordon L. Walls
J. Opt. Soc. Am. 33(9) 487-505 (1943)

Perception enhancement using importance-driven hybrid rendering for augmented reality based endoscopic surgical navigation

Yakui Chu, Xu Li, Xilin Yang, Danni Ai, Yong Huang, Hong Song, Yurong Jiang, Yongtian Wang, Xiaohong Chen, and Jian Yang
Biomed. Opt. Express 9(11) 5205-5226 (2018)

Saccadic and perceptual performance in visual search tasks. I. Contrast detection and discrimination

Brent R. Beutter, Miguel P. Eckstein, and Leland S. Stone
J. Opt. Soc. Am. A 20(7) 1341-1355 (2003)

A perceptual eyebox for near-eye displays

Steven A. Cholewiak, Zeynep Başgöze, Ozan Cakmakci, David M. Hoffman, and Emily A. Cooper
Opt. Express 28(25) 38008-38028 (2020)

Dual focal plane augmented reality interactive display with gaze-tracker

Uğur Yekta Başak, Seyedmahdi Kazempourradi, Cemalettin Yilmaz, Erdem Ulusoy, and Hakan Urey
OSA Continuum 2(5) 1734-1745 (2019)