Clinical Experience and Perception in Stereo Augmented Reality Surgical Navigation

Over the last 10 years only a small number of systems that provide stereo augmented reality for surgical guidance have been proposed and it has been rare for such devices to be evaluated in-theatre. Over the same period we have developed a system for microscope-assisted guided interventions (MAGI). This provides stereo augmented reality navigation for ENT and neurosurgery. The aim is to enable the surgeon to see virtual structures beneath the operative surface as though the tissue were transparent. During development the system MAGI has undergone regular evaluation in the operating room. This experience has provided valuable feedback for system development as well as insight into the clinical effectiveness of AR. As a result of early difficulties encountered, a parallel project was set up in a laboratory setting to establish the accuracy of depth perception in stereo AR. An interesting anomaly was found when the virtual object is placed 0-40mm below the real surface. Despite this such errors are small (~3mm) and the intraoperative evaluation has established that AR surgical guidance can be clinically effective. Of the 17 cases described here confidence was increased in 3 cases and in a further 2 operations patient outcome was judged to have been improved. Additionally, intuitive and easy craniotomy navigation was achieved even in two cases where registration errors were quite high. These results suggest that stereo AR should have a role in the future of surgical navigation.

[1]  A. Jusczyzck,et al.  Locking acrylic resin dental stent for image-guided surgery. , 2000, The Journal of prosthetic dentistry (Print).

[2]  Mukul Mukherjee,et al.  Medicine Meets Virtual Reality 14 , 2005 .

[3]  Alain Tanguy,et al.  Virtual Reality as an Operative Tool During Scoliosis Surgery , 1995, CVRMed.

[4]  Ramesh Raskar,et al.  Augmented Reality Visualization for Laparoscopic Surgery , 1998, MICCAI.

[5]  M. Y. Wang,et al.  Measurement of Intraoperative Brain Surface Deformation Under a Craniotomy , 1998, MICCAI.

[6]  David J. Hawkes,et al.  Design and evaluation of a system for microscope-assisted guided interventions (MAGI) , 2000 .

[7]  M Wendt,et al.  [A head-mounted display system for augmented reality: initial evaluation for interventional MRI]. , 2003, RoFo : Fortschritte auf dem Gebiete der Rontgenstrahlen und der Nuklearmedizin.

[8]  K. Paulsen,et al.  Intraoperative brain shift and deformation: a quantitative analysis of cortical displacement in 28 cases. , 1998 .

[9]  Dean C. Barratt,et al.  The problem of perceiving accurate depth information through a surgical augmented reality system , 2003 .

[10]  Derek L. G. Hill,et al.  Measurement of Intraoperative Brain Surface Deformation Under a Craniotomy , 1998, MICCAI.

[11]  David Hawkes,et al.  Surface transparency makes stereo overlays unpredictable: the implications for augmented reality. , 2003, Studies in health technology and informatics.

[12]  Nicholas Ayache,et al.  Computer Vision, Virtual Reality and Robotics in Medicine , 1995, Lecture Notes in Computer Science.

[13]  Wolfgang Birkfellner,et al.  A head-mounted operating binocular for augmented reality visualization in medicine - design and initial evaluation , 2002, IEEE Transactions on Medical Imaging.

[14]  D. Hill,et al.  Augmentation of reality using an operating microscope for otolaryngology and neurosurgical guidance. , 1995, Journal of image guided surgery.