Empirical Evaluation of a 3D Virtual Simulator of Hysteroscopy Using Leap Motion for Gestural Interfacing

Surgical training using 3D virtual reality simulators has become an important routine in medical education. Recent research points to Leap Motion as an exciting interface for the control of virtual surgical instruments due to its simplicity and low-cost characteristics. However, previous studies using Leap Motion only evaluated movements of the whole hand, without considering individual finger movements during the manipulation of surgical instruments. This work investigates the use of Leap Motion as an interface for the capture of basic hand and finger movements during a simulated hysteroscopy using a 3D-printed hysteroscope model. We created a virtual simulated uterine environment containing a hysteroscope controlled by movements of the hand and fingers of a user actuating on a 3D-printed model hysteroscope. The model hysteroscope was positioned in a pivot basis allowing the capture of the following basic movements: leftward/rightward, upward/downward, forward/backward, and extrusion/retraction of the virtual resection loop (which rests on the end of the virtual virtual resectoscope). The findings indicate that the arc-shaped paths of the hysteroscope’s alpha plane (rightward/leftward) and beta plane (upward/downward) movements are satisfactorily simulated by the virtual reality system. Using Intraclass Correlation, was noted that the similarity between the calculated (ideal standard) and measured arcs was highly significant on both planes (r = 0.9599 on the alpha plane, and r = 0.9208 on the beta plane). Also, the forward/backward trajectory is a straight line; the pinch gesture decreases its accuracy when increase its distance from the Interaction Box of Leap Motion. The results were satisfactorily since compared with previous works, which used Leap Motion for the capture of hands-free gesturing.

[1]  H. Fernandez,et al.  Hysteroscopic resection on virtual reality simulator: What do we measure? , 2018, Journal of gynecology obstetrics and human reproduction.

[2]  Cecilie Våpenstad,et al.  Procedural virtual reality simulation in minimally invasive surgery , 2013, Surgical Endoscopy.

[3]  Constantinos Loukas,et al.  Virtual reality-based assessment of basic laparoscopic skills using the Leap Motion controller , 2017, Surgical Endoscopy.

[4]  Jake Araullo,et al.  The Leap Motion controller: a view on sign language , 2013, OZCHI.

[5]  Pablo Ruisoto,et al.  Digital Environment for Movement Control in Surgical Skill Training , 2016, Journal of Medical Systems.

[6]  Frank Weichert,et al.  Analysis of the Accuracy and Robustness of the Leap Motion Controller , 2013, Sensors.

[7]  Anup Basu,et al.  Smart Sensor-Based Motion Detection System for Hand Movement Training in Open Surgery , 2017, Journal of Medical Systems.

[8]  R. Aggarwal,et al.  Objective assessment of gynecologic laparoscopic skills using the LapSimGyn virtual reality simulator , 2006, Surgical Endoscopy And Other Interventional Techniques.

[9]  Jenny Dankelman,et al.  Feasibility of tracking laparoscopic instruments in a box trainer using a Leap Motion Controller , 2016 .

[10]  E. Mohammadi,et al.  Barriers and facilitators related to the implementation of a physiological track and trigger system: A systematic review of the qualitative evidence , 2017, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[11]  J. Mairos,et al.  Excision of intracavitary masses in office hysteroscopy - what are the limits? Excisão de massas intracavitárias por histeroscopia office - quais os limites? , 2014 .

[12]  David A Cook,et al.  State of the Evidence on Simulation-Based Training for Laparoscopic Surgery: A Systematic Review , 2013, Annals of surgery.

[13]  Prema Nedungadi,et al.  Interactive Gesture Based Cataract Surgery Simulation , 2015, 2015 Fifth International Conference on Advances in Computing and Communications (ICACC).

[14]  R. Aggarwal,et al.  Virtual reality training for surgical trainees in laparoscopic surgery. , 2009, The Cochrane database of systematic reviews.

[15]  Jose A. Piedra-Fernández,et al.  Virtual Environment for the Training of the Hands in Minimally Invasive Thoracic Surgery , 2016, 2016 8th International Conference on Games and Virtual Worlds for Serious Applications (VS-GAMES).

[16]  Mark Hughes,et al.  The LEAP™ Gesture Interface Device and Take-Home Laparoscopic Simulators: A Study of Construct and Concurrent Validity. , 2015, Surgical innovation.

[17]  Y. Fong,et al.  Get "real" with hysteroscopy using the pig bladder: a "uterine" model for hysteroscopy training. , 2013, Annals of the Academy of Medicine, Singapore.