Highly immersive virtual reality laparoscopy simulation: development and future aspects

PurposeVirtual reality (VR) applications with head-mounted displays (HMDs) have had an impact on information and multimedia technologies. The current work aimed to describe the process of developing a highly immersive VR simulation for laparoscopic surgery.MethodsWe combined a VR laparoscopy simulator (LapSim) and a VR-HMD to create a user-friendly VR simulation scenario. Continuous clinical feedback was an essential aspect of the development process. We created an artificial VR (AVR) scenario by integrating the simulator video output with VR game components of figures and equipment in an operating room. We also created a highly immersive VR surrounding (IVR) by integrating the simulator video output with a $$360{^{\circ }}$$360∘ video of a standard laparoscopy scenario in the department’s operating room.ResultsClinical feedback led to optimization of the visualization, synchronization, and resolution of the virtual operating rooms (in both the IVR and the AVR). Preliminary testing results revealed that individuals experienced a high degree of exhilaration and presence, with rare events of motion sickness. The technical performance showed no significant difference compared to that achieved with the standard LapSim.ConclusionOur results provided a proof of concept for the technical feasibility of an custom highly immersive VR-HMD setup. Future technical research is needed to improve the visualization, immersion, and capability of interacting within the virtual scenario.

[1]  John L. Salmon,et al.  Capabilities of Current Generation Virtual Reality to Enhance the Design Process , 2017 .

[2]  Andreas Kirschniak,et al.  Umfrage zum Training laparoskopischer Fertigkeiten in Deutschland , 2016, Zentralblatt für Chirurgie.

[3]  John R. Wilson,et al.  Measurement of presence and its consequences in virtual environments , 2000, Int. J. Hum. Comput. Stud..

[4]  Andrea Gaggioli,et al.  The Potential of Virtual Reality for the Investigation of Awe , 2016, Front. Psychol..

[5]  Doug A. Bowman,et al.  Virtual Reality: How Much Immersion Is Enough? , 2007, Computer.

[6]  JoAnn Difede,et al.  Virtual reality exposure therapy for combat‐related posttraumatic stress disorder , 2010, Annals of the New York Academy of Sciences.

[7]  Suvranu De,et al.  Face and construct validation of a next generation virtual reality (Gen2-VR©) surgical simulator , 2016, Surgical Endoscopy.

[8]  A. Doerfler,et al.  Robotic Surgery Simulator: Elements to Build a Training Program. , 2016, Journal of surgical education.

[9]  T. Parsons.  Virtual Reality for Enhanced Ecological Validity and Experimental Control in the Clinical, Affective and Social Neurosciences , 2015, Front. Hum. Neurosci..

[10]  M. Schijven,et al.  Virtual reality training for endoscopic surgery: voluntary or obligatory? , 2007, Surgical Endoscopy.

[11]  Albert A. Rizzo,et al.  Virtual Reality Exposure Therapy for Combat-Related Posttraumatic Stress Disorder , 2014, Computer.

[12]  J. Deutsch,et al.  Virtual Reality for Stroke Rehabilitation , 2012 .

[13]  Michael Mara,et al.  Extended TimeWarp latency compensation for virtual reality , 2016, I3D.

[14]  W Kneist,et al.  ["I will do laparoscopy somewhere else" : Total, highly immersive virtual reality without side effects?] , 2017, Der Chirurg; Zeitschrift fur alle Gebiete der operativen Medizen.

[15]  M. Paschold,et al.  Virtuelle 3-D-Laparoskopie-Simulation in der chirurgischen Aus- und Weiterbildung – Ergebnisse einer Pilotstudie , 2013, Zentralblatt für Chirurgie – Zeitschrift für Allgemeine, Viszeral-, Thorax- und Gefäßchirurgie.

[16]  Daniel B. Jones,et al.  Identifying Opportunities for Virtual Reality Simulation in Surgical Education , 2015, Surgical innovation.

[17]  Susie Thomas,et al.  Virtual reality for stroke rehabilitation. , 2015, The Cochrane database of systematic reviews.

[18]  W Kneist,et al.  [3D Virtual Reality Laparoscopic Simulation in Surgical Education - Results of a Pilot Study]. , 2016, Zentralblatt fur Chirurgie.

[19]  Joseph Yang,et al.  78‐3: Screen Door Effect Reduction with Diffractive Film for Virtual Reality and Augmented Reality Displays , 2017 .

[20]  M. Paschold,et al.  Preconditioning in laparoscopic surgery—results of a virtual reality pilot study , 2014, Langenbeck's Archives of Surgery.

[21]  Cho Joungmin,et al.  78‐4: Screen Door Effect Mitigation and Its Quantitative Evaluation in VR Display , 2017 .

[22]  Werner Kneist,et al.  Virtual reality laparoscopy: which potential trainee starts with a higher proficiency level? , 2011, International Journal of Computer Assisted Radiology and Surgery.

[23]  G Riva,et al.  Applications of Virtual Environments in Medicine , 2003, Methods of Information in Medicine.

[24]  Behrang Keshavarz,et al.  Validating an Efficient Method to Quantify Motion Sickness , 2011, Hum. Factors.

[25]  Lars Konge,et al.  Three-dimensional versus two-dimensional vision in laparoscopy: a systematic review , 2015, Surgical Endoscopy.

[26]  Hunter G Hoffman,et al.  A randomized, controlled trial of immersive virtual reality analgesia, during physical therapy for pediatric burns. , 2011, Burns : journal of the International Society for Burn Injuries.

[27]  David Earle,et al.  Development of a rapid response plan for intraoperative emergencies: the Circulate, Scrub, and Technical Assistance Team. , 2017, American journal of surgery.

[28]  Michael Madary,et al.  Real Virtuality: A Code of Ethical Conduct. Recommendations for Good Scientific Practice and the Consumers of VR-Technology , 2016, Front. Robot. AI.

[29]  Fumio Kishino,et al.  Augmented reality: a class of displays on the reality-virtuality continuum , 1995, Other Conferences.

[30]  R. Aggarwal,et al.  Virtual reality training for surgical trainees in laparoscopic surgery. , 2009, The Cochrane database of systematic reviews.

[31]  Christian Hansen,et al.  New dimensions in surgical training: immersive virtual reality laparoscopic simulation exhilarates surgical staff , 2017, Surgical Endoscopy.

[32]  Rajesh Aggarwal,et al.  An Evidence-Based Virtual Reality Training Program for Novice Laparoscopic Surgeons , 2006, Annals of surgery.

[33]  Steven M. LaValle,et al.  Head tracking for the Oculus Rift , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[34]  Teodor P Grantcharov,et al.  Effect of virtual reality training on laparoscopic surgery: randomised controlled trial , 2009, BMJ : British Medical Journal.