Surgical Simulation Training Systems: Box Trainers, Virtual Reality and Augmented Reality Simulators

In contrast to Virtual Reality (VR) and traditional surgical training, simulation-based training in Minimally Invasive Surgery (MIS), and Augmented Reality (AR) technology, constitute relatively new application fields in surgery. However, between simulation and AR there is a direct link: the utilization of state-of-the art computer graphics tools and techniques. Nevertheless, an integrated research system that introduces AR properties in simulation-based surgical training scenarios has not yet been proposed in the current literature. In this article we provide a survey on the simulation techniques and systems employed for surgical skills training based on traditional as well as more advanced VR technologies. Moreover, we summarize recent experimental results with regard to the design of a novel ARbased simulator developed in our lab for basic skills training in MIS.

[1]  Blake Hannaford,et al.  The Blue DRAGON--a system for monitoring the kinematics and the dynamics of endoscopic tools in minimally invasive surgery for objective laparoscopic skill assessment. , 2002, Studies in health technology and informatics.

[2]  V. Lahanas,et al.  A novel augmented reality simulator for skills assessment in minimal invasive surgery , 2015, Surgical Endoscopy.

[3]  Fumio Kishino,et al.  Augmented reality: a class of displays on the reality-virtuality continuum , 1995, Other Conferences.

[4]  Thoralf Schollmeyer,et al.  Enhancing laparoscopic performance with the LTS3E: a computerized hybrid physical reality simulator. , 2008, Fertility and sterility.

[5]  Gregory Hager,et al.  Vision-based navigation in image-guided interventions. , 2011, Annual review of biomedical engineering.

[6]  D. Rattner,et al.  Computer-enhanced laparoscopic training system (CELTS): bridging the gap , 2004, Surgical Endoscopy And Other Interventional Techniques.

[7]  Derek R. Magee,et al.  An augmented reality simulator for ultrasound guided needle placement training , 2007, Medical & Biological Engineering & Computing.

[8]  Raphael Grasset,et al.  An Augmented Reality Application for Patient Positioning and Monitoring in Radiotherapy , 2009 .

[9]  M S Wilson,et al.  MIST VR: a virtual reality trainer for laparoscopic surgery assesses performance. , 1997, Annals of the Royal College of Surgeons of England.

[10]  A. G. Gallagher,et al.  Construct validation of the ProMIS simulator using a novel laparoscopic suturing task , 2005, Surgical Endoscopy And Other Interventional Techniques.

[11]  Michael Bajura,et al.  Merging Virtual Objects with the Real World , 1992 .

[12]  B. Krug,et al.  Application of an augmented reality tool for maxillary positioning in orthognathic surgery - a feasibility study. , 2006, Journal of cranio-maxillo-facial surgery : official publication of the European Association for Cranio-Maxillo-Facial Surgery.

[13]  Constantinos Loukas,et al.  A simple sensor calibration technique for estimating the 3D pose of endoscopic instruments , 2016, Surgical Endoscopy.

[14]  Richard M Satava,et al.  Virtual reality surgical simulator: the first steps. 1993. , 2006, Clinical orthopaedics and related research.

[15]  Martin Bauer,et al.  Augmented reality for port placement and navigation in robotically assisted minimally invasive cardiovascular surgery , 2004, CARS.

[16]  F.E. Zajac,et al.  An interactive graphics-based model of the lower extremity to study orthopaedic surgical procedures , 1990, IEEE Transactions on Biomedical Engineering.

[17]  Constantinos Loukas,et al.  Psychomotor skills assessment in laparoscopic surgery using augmented reality scenarios , 2011, 2011 17th International Conference on Digital Signal Processing (DSP).

[18]  S. Botden,et al.  Augmented versus Virtual Reality Laparoscopic Simulation: What Is the Difference? , 2007, World journal of surgery.

[19]  A Cuschieri,et al.  Extracorporeal pneumoperitoneum access bubble for endoscopic surgery. , 1995, American journal of surgery.

[20]  R. Satava Virtual reality surgical simulator , 1993, Surgical Endoscopy.

[21]  Luc Soler,et al.  A Complete Augmented Reality Guidance System for Liver Punctures: First Clinical Evaluation , 2005, MICCAI.

[22]  Constantinos Loukas,et al.  An integrated approach to endoscopic instrument tracking for augmented reality applications in surgical simulation training , 2013, The international journal of medical robotics + computer assisted surgery : MRCAS.

[23]  S. Botden,et al.  What is going on in augmented reality simulation in laparoscopic surgery? , 2008, Surgical Endoscopy.

[24]  D. W. F. van Krevelen,et al.  A Survey of Augmented Reality Technologies, Applications and Limitations , 2010, Int. J. Virtual Real..

[25]  J. Marescaux,et al.  Augmented reality in laparoscopic surgical oncology. , 2011, Surgical oncology.

[26]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[27]  Ramesh Raskar,et al.  Augmented Reality Visualization for Laparoscopic Surgery , 1998, MICCAI.

[28]  M. Feuerstein,et al.  Navigation in endoscopic soft tissue surgery: perspectives and limitations. , 2008, Journal of endourology.