A novel method and system for stereotactic surgical procedures

A novel three-dimension (3-D) augmented reality system using autostereoscopic images was developed for surgical navigation. The 3D images are created by computer reconstruction and the polarized stereo projection system, which provides geometrically accurate 3-D spatial images and reproduces motion parallax with polarized eyeglasses. The spatially projected 3-D images are superimposed onto the surgical area and viewed via two semitransparent mirrors. A set of accurate spatial image registration methods based on the coordinate transformation relationship of the world coordinate system, the CT image coordinate system, the view plane coordinate system of VtkCamera and the image plane coordinate system of projectors were developed for registration of 3D virtual images and corresponding lesion areas. Preliminary phantom experiments showed that the average errors of 4 selected reference points are 1.6548mm, 1.8956mm, 2.5630mm, 2.3560mm (observer' heigh 1650mm) and 1.8648mm, 3.1614mm, 2.3904mm, 2.6416mm (observer' height: 1750mm) which meet the clinical requirement. Trapezium distortion of the projectors is 0.6 pixel distance. The differences of observers' height, interpupillary distance and motion have little effect on the accuracy of registration. Part of the human eye may have automatic focusing function thus increasing the actual registration accuracy.

[1]  Kate A. Gavaghan,et al.  Augmented Reality Image Overlay Projection for Image Guided Open Liver Ablation of Metastatic Liver Cancer , 2011, AE-CAI.

[2]  Nobuhiko Hata,et al.  Surgical navigation by autostereoscopic image overlay of integral videography , 2004, IEEE Transactions on Information Technology in Biomedicine.

[3]  Ichiro Sakuma,et al.  Augmented Reality Navigation With Automatic Marker-Free Image Registration Using 3-D Image Overlay for Dental Surgery , 2014, IEEE Transactions on Biomedical Engineering.

[4]  G H Barnett,et al.  Use of a frameless, armless stereotactic wand for brain tumor localization with two-dimensional and three-dimensional neuroimaging. , 1993, Neurosurgery.

[5]  H. M. Karara,et al.  Direct Linear Transformation from Comparator Coordinates into Object Space Coordinates in Close-Range Photogrammetry , 2015 .

[6]  Stanislav V. Klimenko,et al.  Crosstalk reduction in passive stereo-projection systems , 2003, Eurographics.

[7]  O. Ratib,et al.  Augmented reality and image overlay navigation with OsiriX in laparoscopic and robotic surgery: not only a matter of fashion , 2011, Journal of hepato-biliary-pancreatic sciences.

[8]  T Yoshimine,et al.  [Computer assisted neurosurgery: development of a frameless and armless navigation system (CNS navigator)]. , 1991, No shinkei geka. Neurological surgery.

[9]  Ken Masamune,et al.  Surgical Navigation System with Intuitive Three-Dimensional Display , 2000, MICCAI.

[10]  Stefan Weber,et al.  A Portable Image Overlay Projection Device for Computer-Aided Open Liver Surgery , 2011, IEEE Transactions on Biomedical Engineering.

[11]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[12]  K. Keller,et al.  Head Mounted Displays for Medical Use , 2008, Journal of Display Technology.

[13]  G. Horstmann,et al.  Sonic stereometry in microsurgical procedures for deep-seated brain tumors and vascular malformations. , 1993, Neurosurgery.

[14]  J. Strohbehn,et al.  A frameless stereotaxic integration of computerized tomographic imaging and the operating microscope. , 1986, Journal of neurosurgery.

[15]  John Kenneth Salisbury,et al.  The Intuitive/sup TM/ telesurgery system: overview and application , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[16]  Jan Egger,et al.  Development of a surgical navigation system based on augmented reality using an optical see-through head-mounted display , 2015, J. Biomed. Informatics.

[17]  Branislav Jaramaz,et al.  Proceedings of the Third International Conference on Medical Image Computing and Computer-Assisted Intervention , 1998 .

[18]  Dan Stoianovici,et al.  Robotically assisted spine needle placement: program plan and cadaver study , 2001, Proceedings 14th IEEE Symposium on Computer-Based Medical Systems. CBMS 2001.

[19]  M P Heilbrun,et al.  Stereotactic localization and guidance using a machine vision technique. , 1992, Stereotactic and functional neurosurgery.

[20]  Naoki Suzuki,et al.  Clinical application of navigation surgery using augmented reality in the abdominal field , 2015, Surgery Today.

[21]  C. Detter,et al.  Clinical Use of a Computer-enhanced Surgical Robotic System for Endoscopic Coronary Artery Bypass Grafting on the Beating Heart1 , 2000, The Thoracic and cardiovascular surgeon.

[22]  H Iseki,et al.  Development of an MRI-compatible needle insertion manipulator for stereotactic neurosurgery. , 1995, Journal of image guided surgery.

[23]  Sheng Liu,et al.  An optical see-through head mounted display with addressable focal planes , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[24]  Yorktown Heights,et al.  An Image-directed Robotic System for Precise Orthopaedic Surgery , 1990 .