Accessible laparoscopic instrument tracking ("InsTrac"): construct validity in a take-home box simulator.

INTRODUCTION Objective performance feedback has potential to maximize the training benefit of laparoscopic simulators. Instrument movement metrics are, however, currently the preserve of complex and expensive systems. We aimed to develop and validate affordable, user-ready software that provides objective feedback by tracking instrument movement in a "take-home" laparoscopic simulator. MATERIALS AND METHODS Computer-vision processing tracks the movement of colored bands placed around the distal instrument shafts. The position of each instrument is logged from the simulator camera feed and movement metrics calculated in real time. Ten novices (junior doctors) and 13 general surgery trainees (StR) (training years 3-7) performed a standardized task (threading string through hoops) on the eoSim (eoSurgical™ Ltd., Edinburgh, Scotland, United Kingdom) take-home laparoscopic simulator. Statistical analysis was performed using unpaired t tests with Welch's correction. RESULTS The software was able to track the instrument tips reliably and effectively. Significant differences between the two groups were observed in time to complete task (StR versus novice, 2 minutes 33 seconds versus 9 minutes 53 seconds; P=.01), total distance traveled by instruments (3.29 m versus 11.38 m, respectively; P=.01), average instrument motion smoothness (0.15 mm/second(3) versus 0.06 mm/second(3), respectively; P<.01), and handedness (mean difference between dominant and nondominant hand) (0.55 m versus 2.43 m, respectively; P=.03). There was no significant difference seen in the distance between instrument tips, acceleration, speed of instruments, or time off-screen. CONCLUSIONS We have developed software that brings objective performance feedback to the portable laparoscopic box simulator. Construct validity has been demonstrated. Removing the need for additional motion-tracking hardware makes it affordable and accessible. It is user-ready and has the potential to enhance the training benefit of portable simulators both in the workplace and at home.

[1]  P. Hewett,et al.  Construct, concurrent, and content validity of the eoSim laparoscopic simulator. , 2013, Journal of laparoendoscopic & advanced surgical techniques. Part A.

[2]  Jorie M. Colbert-Getz,et al.  Warm-up on a simulator improves residents’ performance in laparoscopic surgery: a randomized trial , 2013, International Urogynecology Journal.

[3]  Fedde Scheele,et al.  Validation of a new box trainer-related tracking device: the TrEndo , 2012, Surgical Endoscopy.

[4]  J. Dankelman,et al.  Construct validity and assessment of the learning curve for the SIMENDO endoscopic simulator , 2007, Surgical Endoscopy.

[5]  Pierre Graebling,et al.  Real-time segmentation of surgical instruments inside the abdominal cavity using a joint hue saturation color feature , 2005, Real Time Imaging.

[6]  J. A. Sánchez-Margallo,et al.  EVA: Laparoscopic Instrument Tracking Based on Endoscopic Video Analysis for Psychomotor Skills Assessment , 2013, Surgical Endoscopy.

[7]  K. Moorthy,et al.  Laparoscopic skills training and assessment , 2004, The British journal of surgery.

[8]  J. Dankelman,et al.  Objective classification of residents based on their psychomotor laparoscopic skills , 2009, Surgical Endoscopy.

[9]  Roberto A. Hexsel,et al.  Particle filtering in the Hough space for instrument tracking , 2012, Comput. Biol. Medicine.

[10]  J. Dankelman,et al.  The influence of experience and camera holding on laparoscopic instrument movements measured with the TrEndo tracking system , 2007, Surgical Endoscopy.

[11]  David A Cook,et al.  Cost: the missing outcome in simulation-based medical education research: a systematic review. , 2013, Surgery.

[12]  D. Scott,et al.  Construct and face validity of MIST-VR, Endotower, and CELTS , 2005, Surgical Endoscopy And Other Interventional Techniques.

[13]  J. Fitzgerald,et al.  Introduction, availability and role of simulation in surgical education and training: review of current evidence and recommendations from the Association of Surgeons in Training. , 2012, International journal of surgery.

[14]  D. Rattner,et al.  Computer-enhanced laparoscopic training system (CELTS): bridging the gap , 2004, Surgical Endoscopy And Other Interventional Techniques.

[15]  J. Barsuk,et al.  Does Simulation-Based Medical Education With Deliberate Practice Yield Better Results Than Traditional Clinical Education? A Meta-Analytic Comparative Review of the Evidence , 2011, Academic medicine : journal of the Association of American Medical Colleges.

[16]  A. Duffy,et al.  Construct validity for the LAPSIM laparoscopic surgical simulator , 2005, Surgical Endoscopy And Other Interventional Techniques.

[17]  James R Korndorffer,et al.  Effective home laparoscopic simulation training: a preliminary evaluation of an improved training paradigm. , 2012, American journal of surgery.

[18]  Paul G Gauger,et al.  Laparoscopic simulation training with proficiency targets improves practice and performance of novice surgeons. , 2010, American journal of surgery.

[19]  J. Lee,et al.  Laparoscopic warm-up exercises improve performance of senior-level trainees during laparoscopic renal surgery. , 2012, Journal of endourology.

[20]  M. Pellen,et al.  Construct validity of the ProMIS laparoscopic simulator , 2008, Surgical Endoscopy.

[21]  Christopher W. Snyder,et al.  Proficiency-based laparoscopic and endoscopic training with virtual reality simulators: a comparison of proctored and independent approaches. , 2009, Journal of surgical education.

[22]  S. Botden,et al.  What is going on in augmented reality simulation in laparoscopic surgery? , 2008, Surgical Endoscopy.

[23]  J. Dankelman,et al.  Validation of a new basic virtual reality simulator for training of basic endoscopic skills , 2006, Surgical Endoscopy And Other Interventional Techniques.

[24]  David A Cook,et al.  State of the Evidence on Simulation-Based Training for Laparoscopic Surgery: A Systematic Review , 2013, Annals of surgery.

[25]  Roland Partridge,et al.  Validating the Use of Smartphone-Based Accelerometers for Performance Assessment in a Simulated Neurosurgical Task , 2014, Neurosurgery.