Surgeon Assistive Augmented Reality Model with the use of Endoscopic Camera for Line of Vision Calculation

In this paper, the authors describe a surgeon assistive Augmented Reality AR model for endoscopic procedures. They analyze the main parts of the model and the processes that need to be established such as, the registration of the patient, the segmentation of medical data, their 3D reconstruction, and the detection of endoscopic instruments and the camera. The authors present two graphical user interfaces, build to serve the needs of segmentation, navigation, and visualization of the final intra-operative scene. By using preoperative data of the patient MRI-CT and image processing techniques, the authors can provide a unique view of the surgical scene. The potentials and the advantages of endoscopic-robotic surgeries nowadays can be improved. Augmented surgery scenes with information about the patients underline structures, enables wider situation awareness, precision, and confidence.

[1]  Ioannis A. Kakadiaris,et al.  Tracking Methods for Medical Augmented Reality , 2001, MICCAI.

[2]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[3]  Stéphane Lavallée,et al.  Nonrigid 3-D/2-D Registration of Images Using Statistical Models , 1999, MICCAI.

[4]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[5]  M AlcañizRaya,et al.  Mixed reality for neurosurgery: a novel prototype. , 2003 .

[6]  Jennifer Healey,et al.  Augmented Reality through Wearable Computing , 1997, Presence: Teleoperators & Virtual Environments.

[7]  Frank Sauer,et al.  An Augmented Reality system for MRI-guided needle biopsies. , 2003, Studies in health technology and informatics.

[8]  Christopher M. Brown,et al.  Interactive Augmented Reality , 1998 .

[9]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[10]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[11]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[12]  M. Dujovny,et al.  Head registration techniques for image-guided surgery. , 1998, Neurological research.

[13]  Xiao Bai,et al.  Graph-Based Methods in Computer Vision: Developments and Applications , 2012 .

[14]  Yoshitaka Sakurai,et al.  Adaptive Kansei Search Method Using User's Subjective Criterion Deviation , 2011, Int. J. Comput. Vis. Image Process..

[15]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[16]  Christos G. Christodoulou,et al.  Comparison of Kernel Methods Applied to Smart Antenna Array Processing , 2007 .

[17]  Graeme P. Penney,et al.  2D/3D registration and motion tracking for surgical interventions , 1998 .

[18]  Tomas Lozano-Perez,et al.  An automatic registration method for frameless stereotaxy, image guided surgery, and enhanced reality visualization , 1996 .

[19]  José Luis Rojo-Álvarez,et al.  Kernel Methods in Bioengineering, Signal And Image Processing , 2007 .

[20]  Ramesh Raskar,et al.  Modern approaches to augmented reality: introduction to current approaches , 2006, SIGGRAPH Courses.

[21]  Ming Dong,et al.  Building a Multiple Object Tracking System with Occlusion Handling in Surveillance Videos , 2013 .

[22]  P. Jannin,et al.  A data fusion environment for multimodal and multi-informational neuronavigation. , 2000, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[23]  Ratna Dahiya,et al.  Sliding Window Based Fast Corner Matching Palmprint Authentication , 2011, Int. J. Comput. Vis. Image Process..

[24]  Kaspar Riesen,et al.  Graph Embedding Using Dissimilarities with Applications in Classification , 2013 .

[25]  Hassan Ugail,et al.  Facial Image Processing in Computer Vision , 2013 .

[26]  Tarek M. Mahmoud,et al.  A Highly Efficient Content Based Approach to Filter Pornography Websites , 2012, Int. J. Comput. Vis. Image Process..

[27]  Naoki Suzuki,et al.  A robotic surgery system (da Vinci) with image guided function--system architecture and cholecystectomy application. , 2003, Studies in health technology and informatics.

[28]  Ron Kikinis,et al.  Serial registration of intraoperative MR images of the brain , 2002, Medical Image Anal..