Design and Validation of an Augmented Reality System for Laparoscopic Surgery in a Real Environment

Purpose. This work presents the protocol carried out in the development and validation of an augmented reality system which was installed in an operating theatre to help surgeons with trocar placement during laparoscopic surgery. The purpose of this validation is to demonstrate the improvements that this system can provide to the field of medicine, particularly surgery. Method. Two experiments that were noninvasive for both the patient and the surgeon were designed. In one of these experiments the augmented reality system was used, the other one was the control experiment, and the system was not used. The type of operation selected for all cases was a cholecystectomy due to the low degree of complexity and complications before, during, and after the surgery. The technique used in the placement of trocars was the French technique, but the results can be extrapolated to any other technique and operation. Results and Conclusion. Four clinicians and ninety-six measurements obtained of twenty-four patients (randomly assigned in each experiment) were involved in these experiments. The final results show an improvement in accuracy and variability of 33% and 63%, respectively, in comparison to traditional methods, demonstrating that the use of an augmented reality system offers advantages for trocar placement in laparoscopic surgery.

[1]  Vincenzo Ferrari,et al.  A 3-D Mixed-Reality System for Stereoscopic Visualization of Medical Dataset , 2009, IEEE Transactions on Biomedical Engineering.

[2]  John Moore,et al.  Augmented reality laser projection device for surgery. , 2004, Studies in health technology and informatics.

[3]  Abhilash Pandya,et al.  Registered, Sensor-Integrated Virtual Reality for Surgical Applications , 2007, 2007 IEEE Virtual Reality Conference.

[4]  D. Marquardt.  An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[5]  B. Krug,et al.  Application of an augmented reality tool for maxillary positioning in orthognathic surgery - a feasibility study. , 2006, Journal of cranio-maxillo-facial surgery : official publication of the European Association for Cranio-Maxillo-Facial Surgery.

[6]  A. Retik,et al.  A comparative direct cost analysis of pediatric urologic robot-assisted laparoscopic surgery versus open surgery: could robot-assisted surgery be less expensive? , 2012, Journal of endourology.

[7]  Nassir Navab,et al.  The Virtual Mirror: A New Interaction Paradigm for Augmented Reality Environments , 2009, IEEE Transactions on Medical Imaging.

[8]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[9]  Heinz Wörn,et al.  Port Visualization for Laparoscopic Surgery : Setup and First Intraoperative Evaluation , 2008 .

[10]  Marc Pollefeys,et al.  Multiple view geometry , 2005 .

[11]  W. Boyd,et al.  3-D image guidance for minimally invasive robotic coronary artery bypass. , 2000, The heart surgery forum.

[12]  T. Pintaric,et al.  An adaptive thresholding algorithm for the augmented reality toolkit , 2003, 2003 IEEE International Augmented Reality Toolkit Workshop.

[13]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  H. Iseki,et al.  Endoscopic Augmented Reality Navigation System for Endonasal Transsphenoidal Surgery to Treat Pituitary Tumors: Technical Note , 2002, Neurosurgery.

[15]  Bernhard Preim,et al.  Intraoperative augmented reality for minimally invasive liver interventions , 2003, SPIE Medical Imaging.

[16]  H. Burhenne,et al.  Cholecystectomy: the gold standard. , 1991, American journal of surgery.

[17]  D. Louis Collins,et al.  DVV: A Taxonomy for Mixed Reality Visualization in Image Guided Surgery , 2012, IEEE Transactions on Visualization and Computer Graphics.

[18]  Ève Coste-Manière,et al.  Optimal planning for minimally invasive surgical robots , 2003, IEEE Trans. Robotics Autom..

[19]  H. Troidl,et al.  Randomized comparison of pulmonary function after the ‘French’ and ‘American’ techniques of laparoscopic cholecystectomy , 1996, The British journal of surgery.

[20]  Robert D. Howe,et al.  Port placement planning in robot-assisted coronary artery bypass , 2003, IEEE Trans. Robotics Autom..

[21]  J. Marescaux,et al.  Augmented reality in laparoscopic surgical oncology. , 2011, Surgical oncology.

[22]  Mariano Alcañiz Raya,et al.  Aorta segmentation using the watershed algorithm for an augmented reality system in laparoscopic surgery , 2011, 2011 18th IEEE International Conference on Image Processing.

[23]  Nassir Navab,et al.  Intraoperative Laparoscope Augmentation for Port Placement and Resection Planning in Minimally Invasive Liver Resection , 2008, IEEE Transactions on Medical Imaging.

[24]  Mariano Alcañiz Raya,et al.  Design and validation of an augmented book for spatial abilities development in engineering students , 2010, Comput. Graph..

[25]  Frank Sauer,et al.  Reality Augmentation for Medical Procedures: System Architecture, Single Camera Marker Tracking, and System Evaluation , 2006, International Journal of Computer Vision.

[26]  Andrew W. Fitzgibbon,et al.  Markerless tracking using planar structures in the scene , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[27]  Silke Geisen.  Augmented Reality in surgery , 2005 .

[28]  Mariano Alcañiz Raya,et al.  Augmented Reality System for Keyhole Surgery - Performance and Accuracy Validation , 2011, GRAPP.

[29]  M J Rupérez,et al.  Analysis of several biomechanical models for the simulation of lamb liver behaviour using similarity coefficients from medical image , 2013, Computer methods in biomechanics and biomedical engineering.

[30]  Mariano Alcañiz Raya,et al.  Pneumoperitoneum Technique Simulation in Laparoscopic Surgery on Lamb Liver Samples and 3D Reconstruction , 2011, MMVR.

[31]  Eigil Samset,et al.  Augmented reality in surgical procedures , 2008, Electronic Imaging.