DVV: Towards a Taxonomy for Mixed Reality Visualization in Image Guided Surgery

We introduce the DVV taxonomy (Data, Visualization processing, View) which defines each of the major components of a mixed reality image-guided surgery (IGS) system. We propose that these components should be considered and in turn validated for acceptance of a system into the operating room. A taxonomy of IGS visualization systems is a step towards developing a common language that will help developers and end-users discuss and understand the constituents of a visualization system. We demonstrate the usefulness of the taxonomy by classifying fifteen state-of-the-art research papers in the domain of mixed reality visualization IGS systems.

[1]  Simon K. Warfield,et al.  Non-rigid alignment of preoperative MRI, fMRI and DT-MRI with intraoperative MRI to enhance visualization and navigation in image-guided neurosurgery , 2006 .

[2]  Andrew D. Wiles,et al.  Virtual reality-enhanced ultrasound guidance: A novel technique for intracardiac interventions , 2008, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[3]  Lasse Riis Østergaard,et al.  Active Surface Approach for Extraction of the Human Cerebral Cortex from MRI , 2006, MICCAI.

[4]  N. Hata,et al.  An integrated visualization system for surgical planning and guidance using image fusion and an open MR , 2001, Journal of magnetic resonance imaging : JMRI.

[5]  Nassir Navab,et al.  Contextual Anatomic Mimesis Hybrid In-Situ Visualization Method for Improving Multi-Sensory Depth Perception in Medical Augmented Reality , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[6]  Luc Soler,et al.  An augmented reality system to guide radio‐frequency tumour ablation , 2005, Comput. Animat. Virtual Worlds.

[7]  Ron Kikinis,et al.  Augmented reality visualization for CT-guided interventions: system description, feasibility, and initial evaluation in an abdominal phantom. , 2006, Radiology.

[8]  Takeo Kanade,et al.  An Image Overlay System for Medical Data Visualization , 1998, MICCAI.

[9]  Wolfgang Birkfellner,et al.  Computer-enhanced stereoscopic vision in a head-mounted operating binocular. , 2003, Physics in medicine and biology.

[10]  Pierre Jannin,et al.  Augmented virtuality based on stereoscopic reconstruction in multimodal image-guided neurosurgery: methods and performance evaluation , 2005, IEEE Transactions on Medical Imaging.

[11]  David J. Hawkes,et al.  Design and evaluation of a system for microscope-assisted guided interventions (MAGI) , 2000 .

[12]  Nassir Navab,et al.  Depth Perception - A Major Issue in Medical AR: Evaluation Study by Twenty Surgeons , 2006, MICCAI.

[13]  Luc Soler,et al.  An augmented reality system to guide radio-frequency tumour ablation: Research Articles , 2005 .

[14]  Neil D. Glossop,et al.  Laser projection augmented reality system for computer-assisted surgery , 2003, CARS.

[15]  G. Stetten,et al.  Overlaying ultrasonographic images on direct vision. , 2001, Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine.

[16]  Paul Milgram,et al.  A Taxonomy of Real and Virtual World Display Integration , 1999 .

[17]  Heinz-Otto Peitgen,et al.  Illustrative visualization of 3D planning models for augmented reality in liver surgery , 2010, International Journal of Computer Assisted Radiology and Surgery.

[18]  Frank Sauer,et al.  An augmented reality system for MR image-guided needle biopsy: initial results in a swine model. , 2006, Radiology.

[19]  Neil Glossop,et al.  Laser projection augmented reality system for computer-assisted surgery , 2003 .