Innovative 3D augmented reality techniques for spinal surgery applications

This paper aims to be an outlet for speeding up workflow of orthopedics surgery and be helpful for surgeons to simply coordinate transformations between several imaging displays. Based on epipolar geometry and simple feature landmarks, a 3-D superimposed imaging approach is developed via the construction of the camera-projector system. The superimposed approach is to rectify the perspective, X-ray and projected image pair using the perspective projection model. The proposed method not only simplifies the computation between surgical instruments and patient for surgeons, but also reduces the radiation exposure. Experimental results for both the synthetic spinal image on dummy and real patient testing have demonstrated the feasibility of our approach.

[1]  Qionghai Dai,et al.  Fusing Multiview and Photometric Stereo for 3D Reconstruction under Uncalibrated Illumination , 2011, IEEE Transactions on Visualization and Computer Graphics.

[2]  H. Opower.  Multiple view geometry in computer vision , 2002 .

[3]  Ramesh Raskar,et al.  Augmented Reality Visualization for Laparoscopic Surgery , 1998, MICCAI.

[4]  T. Robinson,et al.  Minimally invasive surgery , 1999, European Surgical Research.

[5]  Hongen Liao,et al.  3-D Augmented Reality for MRI-Guided Surgery Using Integral Videography Autostereoscopic Image Overlay , 2010, IEEE Transactions on Biomedical Engineering.

[6]  N. Hurtós,et al.  Plane-based calibration of a projector-camera system , 2008 .

[7]  P. Kelly,et al.  Computer-assisted stereotaxic laser resection of intra-axial brain neoplasms. , 1986, Journal of neurosurgery.

[8]  W. Eric L. Grimson,et al.  Evaluating and Validating an Automated Registration System for Enhanced Reality Visualization in Surgery , 1995, CVRMed.

[9]  G. Nollert,et al.  Planning a cardiovascular hybrid operating room: the technical point of view. , 2009, The heart surgery forum.

[10]  Thomas Hartkens,et al.  The Hybrid Operating Room , 2012 .

[11]  D. Hill,et al.  Augmentation of reality using an operating microscope for otolaryngology and neurosurgical guidance. , 1995, Journal of image guided surgery.

[12]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[13]  Neil D. Glossop,et al.  Laser projection augmented reality system for computer-assisted surgery , 2003, CARS.

[14]  Heinz Wörn,et al.  Visualization of surgical 3D information with projector-based augmented reality. , 2005, Studies in health technology and informatics.

[15]  A.J.N. van Breemen,et al.  Design and implementation of a room thermostat using an agent-based approach , 2001 .

[16]  Kai-Che Liu,et al.  31.2: Invited Paper: Enhanced Minimally Invasive Surgery by 2D to 3D Conversion , 2011 .

[17]  Marc Levoy,et al.  Reconstructing Occluded Surfaces Using Synthetic Apertures: Stereo, Focus and Robust Measures , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).