Augmented reality visual guidance for spatial perception in the computer assisted surgical trainer

We propose several augmented reality overlays for visual guidance in training for laparoscopic surgery using a 2D display, with the goal of aiding the user's perception of depth and space in that limiting environment. A pilot study of 30 subjects (22 male and 8 female) is presented with results showing the effect of the various overlays on subject performance of a path following task in the Computer Assisted Surgical Trainer. Deviation, economy of movement, and completion time are considered as metrics. The use of a reference indicator for the nearest point on the optimal path is found to result in significant reduction (p < 0.05) in some deviation metrics using non-parametric tests of significance. The data also indicate a reduction in subject deviation with overlays designed to provide depth information. Avenues for further investigation are presented.

[1]  George D. Stetten,et al.  Method for assessing augmented reality needle guidance using a virtual biopsy task , 2004, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[2]  Ramesh Raskar,et al.  Modern approaches to augmented reality , 2005, SIGGRAPH Courses.

[3]  Leo Joskowicz,et al.  An augmented reality guidance probe and method for image-guided surgical navigation , 2006 .

[4]  G. F. Buess,et al.  Comparative study of two-dimensional and three-dimensional vision systems for minimally invasive surgery , 1998, Surgical Endoscopy.

[5]  Jerzy W. Rozenblit,et al.  A haptic guidance system for Computer-Assisted Surgical Training using virtual fixtures , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[6]  Chee-Kong Chui,et al.  Intraoperative visual guidance and control interface for augmented reality robotic surgery , 2010, IEEE ICCA 2010.

[7]  L. V. von Segesser,et al.  3-D Vision Improves Performance in a Pelvic Trainer , 2000, Endoscopy.

[8]  J. Moran,et al.  Sensation and perception , 1980 .

[9]  Pallab Mahmud,et al.  Augmented and Virtual Reality based approaches in Minimally Invasive Surgery training , 2013, 2013 International Conference on Informatics, Electronics and Vision (ICIEV).

[10]  Jerzy W. Rozenblit,et al.  The computer assisted surgical trainer: design, models, and implementation , 2014, SummerSim.

[11]  Giovanni Aloisio,et al.  Augmented Reality in Minimally Invasive Surgery , 2010 .

[12]  Torsten Rohlfing,et al.  Augmented-reality visualization of brain structures with stereo and kinetic depth cues: system description and initial evaluation with head phantom , 2001, SPIE Medical Imaging.

[13]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..