A Head-Mounted Display System for Augmented Reality Image Guidance: Towards Clinical Evaluation for iMRI-guided Neurosurgery

We developed an augmented reality system targeting image guidance for surgical procedures. The surgeon wears a video-see-through head mounted display that provides him with a stereo video view of the patient. The live video images are augmented with graphical representations of anatomical structures that are segmented from medical image data. The surgeon can see e.g. a tumor in its actual location inside the patient. This in-situ visualization, where the computer maps the image information onto the patient, promises the most direct, intuitive guidance for surgical procedures. In this paper, we discuss technical details of the system and describe a first pre-clinical evaluation. This first evaluation is very positive and encourages us to get our system ready for installation in UCLA's iMRI operating room to perform clinical trials.

[1]  K. Farahani,et al.  Magnetic resonance imaging-guided neurosurgery in the magnetic fringe fields: the next step in neuronavigation. , 2000, Neurosurgery.

[2]  Yakup Genc,et al.  Augmented workspace: designing an AR testbed , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[3]  Wolfgang Birkfellner,et al.  Development of the Varioscope AR. A see-through HMD for computer-aided surgery , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[4]  R. Kikinis,et al.  Image-guided surgery. , 1999 .

[5]  Torsten Rohlfing,et al.  Augmented-reality visualization of brain structures with stereo and kinetic depth cues: system description and initial evaluation with head phantom , 2001, SPIE Medical Imaging.

[6]  Mary C. Whitton,et al.  Technologies for augmented reality systems: realizing ultrasound-guided needle biopsies , 1996, SIGGRAPH.

[7]  Ramesh Raskar,et al.  Augmented Reality Visualization for Laparoscopic Surgery , 1998, MICCAI.

[8]  A. Takagi,et al.  Development of a stereo video see-through HMD for AR systems , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[9]  Jannick P. Rolland,et al.  Optical versus Video See-Through Head-Mounted Displays , 2001 .

[10]  FuchsHenry,et al.  Merging virtual objects with the real world , 1992 .

[11]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[12]  Henry Fuchs,et al.  Optical Versus Video See-Through Head-Mounted Displays in Medical Visualization , 2000, Presence: Teleoperators & Virtual Environments.

[13]  Ryutarou Ohbuchi,et al.  Merging virtual objects with the real world: seeing ultrasound imagery within the patient , 1992, SIGGRAPH.

[14]  David J. Hawkes,et al.  Stereo Augmented Reality in the Surgical Microscope , 2000, Presence: Teleoperators & Virtual Environments.