Validation of the mobile serious game application Touch Surgery™ for cognitive training and assessment of laparoscopic cholecystectomy

BackgroundTouch Surgery™ (TS) is a serious gaming application for cognitive task simulation and rehearsal of key steps in surgical procedures. The aim was to establish face, content, and construct validity of TS for laparoscopic cholecystectomy (LC). Furthermore, learning curves with TS and a virtual reality (VR) trainer were compared in a randomized trial.MethodsThe performance of medical students and general surgeons was compared for all three modules of LC in TS to establish construct validity. Questionnaires assessed face and content validity. For analysis of learning curves, students were randomized to train on VR or TS first, and then switched to the other training modality. Performance data were recorded.Results54 Surgeons and 51 medical students completed the validation study. Surgeons outperformed students with TS: patient preparation (students = 45.0 ± 19.1%; surgeons = 57.3 ± 15.2%; p < 0.001), access and laparoscopy (students = 70.2 ± 10.9%; surgeons = 75.9 ± 9.7%; p = 0.008) and LC (students = 69.8 ± 12.4%; surgeons = 77.7 ± 9.6%; p < 0.001). Both groups agreed that TS was a highly useful and realistic application. 46 students were randomized for learning curve analysis. It took them 2–4 attempts to reach a 100% score with TS. Training with TS first did not improve students’ performance on the VR trainer; however, students who trained with VR first scored significantly higher in module 3 of TS.ConclusionTS is an accepted serious gaming application for learning cognitive aspects of LC with established construct, face, and content validity. There appeared to be a synergy between TS and the VR trainer. Therefore, the two training modalities should accompany one another in a multimodal training approach to laparoscopy.

[1]  A. Darzi,et al.  Objective assessment of technical skills in surgery , 2003, BMJ : British Medical Journal.

[2]  Andre Chow,et al.  Development and Evaluation of a Novel Pan-Specialty Virtual Reality Surgical Simulator for Smartphones , 2016, MMVR.

[3]  J. Marescaux,et al.  Surgical education and Internet‐based simulation: The World Virtual University , 2005, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[4]  C. I. Mosier A Critical Examination of the Concepts of Face Validity , 1947, Educational and psychological measurement.

[5]  A. Weiss,et al.  Characteristics of Medicaid and Uninsured Hospitalizations, 2012: Statistical Brief #182 , 2006 .

[6]  C. Gupte,et al.  Validating Touch Surgery™: A cognitive task simulation and rehearsal app for intramedullary femoral nailing. , 2015, Injury.

[7]  A. Akdemir,et al.  Laparoscopic virtual reality simulator and box trainer in gynecology , 2014, International journal of gynaecology and obstetrics: the official organ of the International Federation of Gynaecology and Obstetrics.

[8]  B. Müller-Stich,et al.  One or two trainees per workplace in a structured multimodality training curriculum for laparoscopic surgery? Study protocol for a randomized controlled trial – DRKS00004675 , 2014, Trials.

[9]  Jean-Pierre Jessel,et al.  Classifying Serious Games: The G/P/S Model , 2011 .

[10]  F. Lewis,et al.  Issues in general surgery residency training--2012. , 2012, Annals of surgery.

[11]  R. Aggarwal,et al.  Simulation‐based training and learning curves in laparoscopic Roux‐en‐Y gastric bypass , 2012, The British journal of surgery.

[12]  R. Satava,et al.  Virtual Reality Simulation for the Operating Room: Proficiency-Based Training as a Paradigm Shift in Surgical Skills Training , 2005, Annals of surgery.

[13]  Gregorio Patrizi,et al.  Play to Become a Surgeon: Impact of Nintendo WII Training on Laparoscopic Skills , 2013, PloS one.

[14]  H. Kenngott,et al.  Virtual Reality Does Not Meet Expectations in a Pilot Study on Multimodal Laparoscopic Surgery Training , 2013, World Journal of Surgery.

[15]  Cecilie Våpenstad,et al.  Procedural virtual reality simulation in minimally invasive surgery , 2013, Surgical Endoscopy.

[16]  I. Broeders,et al.  The role of cognitive abilities in laparoscopic simulator training , 2014, Advances in health sciences education : theory and practice.

[17]  D. O'Leary,et al.  From theater to the world wide web--a new online era for surgical education. , 2012, Journal of surgical education.

[18]  G. Fried,et al.  Proving the Value of Simulation in Laparoscopic Surgery , 2004, Annals of surgery.

[19]  C. Chmelik,et al.  [An interactive and multimedia-based manual of surgical procedures: Webop--an approach to improve surgical education]. , 2010, Zentralblatt fur Chirurgie.

[20]  H. Kenngott,et al.  Direct Observation versus Endoscopic Video Recording-Based Rating with the Objective Structured Assessment of Technical Skills for Training of Laparoscopic Cholecystectomy , 2016, European Surgical Research.

[21]  Ross E. Willis,et al.  Comparing three pedagogical approaches to psychomotor skills acquisition. , 2012, American journal of surgery.

[22]  Thomas Bruckner,et al.  Successful learning of surgical liver anatomy in a computer-based teaching module , 2016, International Journal of Computer Assisted Radiology and Surgery.

[23]  H. Troidl,et al.  Randomized comparison of pulmonary function after the ‘French’ and ‘American’ techniques of laparoscopic cholecystectomy , 1996, The British journal of surgery.

[24]  Erich Kosiol,et al.  Organisation der Unternehmung , 1962 .

[25]  J Dankelman,et al.  Serious gaming and voluntary laparoscopic skills training: A multicenter study , 2009, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[26]  S. Messick Validity of Psychological Assessment: Validation of Inferences from Persons' Responses and Performances as Scientific Inquiry into Score Meaning. Research Report RR-94-45. , 1994 .

[27]  Gary Klein,et al.  Working Minds: A Practitioner's Guide to Cognitive Task Analysis , 2006 .

[28]  Beat P. Müller-Stich,et al.  Virtual Reality Training Versus Blended Learning of Laparoscopic Cholecystectomy , 2015, Medicine.

[29]  H. O. Cate Hoedemaker,et al.  Construct and concurrent validity of a Nintendo Wii video game made for training basic laparoscopic skills , 2013, Surgical Endoscopy.

[30]  Didier Mutter,et al.  WeBSurg: An Innovative Educational Web Site in Minimally Invasive Surgery—Principles and Results , 2011, Surgical innovation.

[31]  Marc Immenroth,et al.  Multimedia-based training on Internet platforms improves surgical performance: a randomized controlled trial , 2013, Surgical Endoscopy.