An effective visualization technique for depth perception in augmented reality‐based surgical navigation

Depth perception is a major issue in augmented reality (AR)‐based surgical navigation. We propose an AR and virtual reality (VR) switchable visualization system with distance information, and evaluate its performance in a surgical navigation set‐up.

[1]  Gabor Fichtinger,et al.  OpenIGTLink: an open network protocol for image‐guided therapy environment , 2009, The international journal of medical robotics + computer assisted surgery : MRCAS.

[2]  M Hashizume,et al.  Preliminary Study on the Clinical Application of Augmented Reality Neuronavigation , 2013, Journal of Neurological Surgery—Part A.

[3]  D. M. Herron,et al.  The 3-D monitor and head-mounted display , 1999, Surgical Endoscopy.

[4]  Ryutarou Ohbuchi,et al.  Merging virtual objects with the real world: seeing ultrasound imagery within the patient , 1992, SIGGRAPH.

[5]  David J. Hawkes,et al.  Stereo Augmented Reality in the Surgical Microscope , 2000, Presence: Teleoperators & Virtual Environments.

[6]  Jay B. West,et al.  Implementation, calibration and accuracy testing of an image-enhanced endoscopy system , 2002, IEEE Transactions on Medical Imaging.

[7]  Torsten Rohlfing,et al.  Augmented-reality visualization of brain structures with stereo and kinetic depth cues: system description and initial evaluation with head phantom , 2001, SPIE Medical Imaging.

[8]  Jay B. West,et al.  Fiducial Point Placement and the Accuracy of Point-based, Rigid Body Registration , 2001, Neurosurgery.

[9]  Cass W. Everitt,et al.  Interactive Order-Independent Transparency , 2001 .

[10]  Paul Milgram,et al.  Perceptual issues in augmented reality , 1996, Electronic Imaging.

[11]  Giovanni Aloisio,et al.  Augmented Reality in Minimally Invasive Surgery , 2010 .

[12]  D. Louis Collins,et al.  A Realistic Test and Development Environment for Mixed Reality in Neurosurgery , 2011, AE-CAI.

[13]  M. Hashizume,et al.  An effective point-based registration tool for surgical navigation , 2010, Surgical Endoscopy.

[14]  Steven K. Feiner,et al.  Perceptual issues in augmented reality revisited , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[15]  Nikolaus F. Troje,et al.  Enhancing Depth Perception in Translucent Volumes , 2006, IEEE Transactions on Visualization and Computer Graphics.

[16]  Ramesh Raskar,et al.  Augmented Reality Visualization for Laparoscopic Surgery , 1998, MICCAI.

[17]  Ronald Azuma,et al.  Augmented-reality visualizations guided by cognition: perceptual heuristics for combining visible and obscured information , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[18]  Heinz-Otto Peitgen,et al.  Illustrative visualization of 3D planning models for augmented reality in liver surgery , 2010, International Journal of Computer Assisted Radiology and Surgery.

[19]  E. Mingolla,et al.  Perception of solid shape from shading , 1989, Biological Cybernetics.

[20]  Makoto Hashizume,et al.  Dual Surgical Navigation Using Augmented and Virtual Environment Techniques , 2011 .

[21]  Nassir Navab,et al.  Depth Perception - A Major Issue in Medical AR: Evaluation Study by Twenty Surgeons , 2006, MICCAI.

[22]  Jaimie M. Henderson,et al.  Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention , 2006 .

[23]  Guoyan Zheng,et al.  Calibration of a surgical microscope with automated zoom lenses using an active optical tracker , 2008, The international journal of medical robotics + computer assisted surgery : MRCAS.

[24]  Nassir Navab,et al.  Contextual Anatomic Mimesis Hybrid In-Situ Visualization Method for Improving Multi-Sensory Depth Perception in Medical Augmented Reality , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[25]  Tobias Höllerer,et al.  Pictorial depth cues for outdoor augmented reality , 2005, Ninth IEEE International Symposium on Wearable Computers (ISWC'05).

[26]  E. Fishman,et al.  Three-dimensional volume rendering of spiral CT data: theory and method. , 1999, Radiographics : a review publication of the Radiological Society of North America, Inc.

[27]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[28]  Nassir Navab,et al.  Automatic Patient Registration for Port Placement in Minimally Invasixe Endoscopic Surgery , 2005, MICCAI.

[29]  Makoto Hashizume,et al.  Warning navigation system using real-time safe region monitoring for otologic surgery , 2012, International Journal of Computer Assisted Radiology and Surgery.

[30]  Jon Louis Bentley,et al.  Multidimensional binary search trees used for associative searching , 1975, CACM.