Advanced Display and Visualization Concepts for Image Guided Surgery

Thanks to its rapid development in the last decades, image guided surgery (IGS) has been introduced successfully in many modern operating rooms. Current IGS systems provide their navigation information on a standard computer monitor. Alternatively, one could enhance the direct sight of the physician by an overlay of the virtual data onto the real patient view. Such in situ visualization methods have been proposed in the literature for providing a more intuitive visualization, improving the ergonomics as well as the hand-eye coordination. In this paper, we first discuss the fundamental issues and the recent endeavors in advanced display and visualization for IGS. We then present some of our recent work comparing two navigation systems: 1) a classical monitor based navigation and 2) a new navigation system we had developed based on in situ visualization. As both solutions reveal shortcomings as well as complementary advantages, we introduce a new solution that combines both concepts into one hybrid user interface. Finally, experimental results report on the performance of several surgeons using an external monitor as well as a stereo video see-through head-mounted display (HMD). The experiments consist of drilling into a phantom in order to reach planted deep-seated targets only visible in computed tomography (CT) data. We evaluate several visualization techniques, including the new hybrid solution, and study their influence on the performance of the participant surgeons.

[1]  Steven Gold,et al.  A Graduated Assignment Algorithm for Graph Matching , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Gabor Fichtinger,et al.  MRI image overlay: applications to arthrography needle insertion. , 2006, Studies in health technology and informatics.

[3]  Pierre Jannin,et al.  Surgical models for computer-assisted neurosurgery , 2007, NeuroImage.

[4]  F. Langlotz,et al.  Minimally invasive approaches in orthopaedic surgery , 2003, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[5]  K. Cleary,et al.  Image-guided interventions : technology and applications , 2008 .

[6]  Heinrich Niemann,et al.  Single camera tracking of marker clusters: multiparameter cluster optimization and experimental verification , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[7]  Ramesh Raskar,et al.  Augmented Reality Visualization for Laparoscopic Surgery , 1998, MICCAI.

[8]  R.J. Maciunas,et al.  An automatic technique for finding and localizing externally attached markers in CT and MR volume images of the head , 1996, IEEE Transactions on Biomedical Engineering.

[9]  Ken Masamune,et al.  Image overlay guidance for needle insertion in CT scanner , 2005, IEEE Transactions on Biomedical Engineering.

[10]  Ekkehard Euler,et al.  Evaluation of an in-situ visualization system for navigated trauma surgery , 2006 .

[11]  Tyrone L. Vincent,et al.  Analysis of Head Pose Accuracy in Augmented Reality , 2000, IEEE Trans. Vis. Comput. Graph..

[12]  Nassir Navab,et al.  A Boosted Segmentation Method for Surgical Workflow Analysis , 2007, MICCAI.

[13]  Yakup Genc,et al.  Augmented workspace: designing an AR testbed , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[14]  Frank Sauer,et al.  A Head-Mounted Display System for Augmented Reality Image Guidance: Towards Clinical Evaluation for iMRI-guided Neurosurgery , 2001, MICCAI.

[15]  Markus Hadwiger,et al.  Real-time volume graphics , 2006, Eurographics.

[16]  Larry S. Davis,et al.  Dynamic superimposition of synthetic objects on rigid and simple-deformable real objects , 2001, Proceedings IEEE and ACM International Symposium on Augmented Reality.

[17]  Nassir Navab,et al.  Navigated Three Dimensional Beta Probe for Optimal Cancer Resection , 2006, MICCAI.

[18]  Wolfgang Birkfellner,et al.  A fully automated calibration method for an optical see-through head-mounted operating microscope with variable zoom and focus , 2005, IEEE Transactions on Medical Imaging.

[19]  R. P. Gaston,et al.  A System for Microscope-Assisted Guided Interventions , 2000, Stereotactic and Functional Neurosurgery.

[20]  S. Umeyama,et al.  Least-Squares Estimation of Transformation Parameters Between Two Point Patterns , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  G. Stetten,et al.  Overlaying ultrasonographic images on direct vision. , 2001, Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine.

[22]  Nassir Navab,et al.  Online Estimation of the Target Registration Error for n -Ocular Optical Tracking Systems , 2007, MICCAI.

[23]  David J. Hawkes,et al.  Design and evaluation of a system for microscope-assisted guided interventions (MAGI) , 2000 .

[24]  Nassir Navab,et al.  Action- and Workflow-Driven Augmented Reality for Computer-Aided Medical Procedures , 2007, IEEE Computer Graphics and Applications.

[25]  D. Hill,et al.  Medical image registration , 2001, Physics in medicine and biology.

[26]  Nassir Navab,et al.  Merging visible and invisible: two Camera-Augmented Mobile C-arm (CAMC) applications , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[27]  Ekkehard Euler,et al.  Hybrid Navigation Interface for Orthopedic and Trauma Surgery , 2006, MICCAI.

[28]  Wolfgang Birkfellner,et al.  A head-mounted operating binocular for augmented reality visualization in medicine - design and initial evaluation , 2002, IEEE Transactions on Medical Imaging.

[29]  Nassir Navab,et al.  Recovery of Surgical Workflow Without Explicit Models , 2006, MICCAI.

[30]  Jannick P. Rolland,et al.  A Survey of Tracking Technologies for Virtual Environments , 2001 .

[31]  F. Langlotz,et al.  Computer-assisted Minimally Invasive Spine Surgery , 2006 .

[32]  Ekkehard Euler,et al.  Towards a Hybrid Navigation Interface: Comparison of a Slice Based Navigation System with In-Situ Visualization , 2006, MIAR.