Is the skillset obtained in surgical simulation transferable to the operating theatre?

BACKGROUND Simulated surgical training offers a safe and accessible way of learning surgical procedures outside the operating room. Training programs have been developed using simulated laboratories to train surgical trainees to proficiency outside the operating room. Despite the global enthusiasm among educators to enhance training through simulation-based learning, it remains to be elucidated whether the skill set obtained is transferrable to the operating room. METHODS Using standardized search methods, the authors searched the Cochrane Central Register of Controlled Trials, PubMed, Embase, and Web-Based Knowledge, as well as the reference lists of relevant articles, and retrieved all published randomized controlled trials. RESULTS Sixteen randomized controlled trials involving 309 participants were identified to be suitable for qualitative analysis using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. The mean Consolidated Standards of Reporting Trials score was 16 (range, 12-22). The studies showed considerable clinical and methodologic diversity. Operative time improved consistently in all trials after training and was the only objective parameter measurable in the live setting. Studies that used the Objective Structured Assessment of Technical Skills as their primary outcome showed improved scores in 80% of trials, and studies that used performance indicators to assess participants all showed improved scores after simulation training in all of the trials, with 88% showing statistical significance. CONCLUSIONS The current literature consistently demonstrates the positive impact of simulation on operative time and predefined performance scores. However, these reproducible measures alone are insufficient to demonstrate transferability of skills from the laboratory to the operating room. The authors advocate a multimodal assessment, including metrics, the Objective Structured Assessment of Technical Skills, and critical step completion. This may provide a more complete assessment of operative performance. Only then can it be concluded that simulation skills are transferable to the live operative setting.

[1]  A. Gallagher,et al.  Virtual reality training improves junior residents’ operating room performance: Results of a prospective, randomized, double-blinded study of the complete laparoscopic cholecystectomy , 2004 .

[2]  Dimitrios Stefanidis,et al.  Proficiency-Based Laparoscopic Simulator Training Leads to Improved Operating Room Skill That Is Resistant to Decay , 2008, Surgical innovation.

[3]  J. Dankelman,et al.  Transfer validity of laparoscopic knot-tying training on a VR simulator to a realistic environment: A randomized controlled trial , 2008, Surgical Endoscopy.

[4]  P. Andreatta,et al.  Construct validity of the LapSim laparoscopic surgical simulator. , 2006, American journal of surgery.

[5]  R. Reznick,et al.  Validation of an objective structured assessment of technical skill for surgical residents , 1996, Academic medicine : journal of the Association of American Medical Colleges.

[6]  R. Satava Virtual reality surgical simulator , 1993, Surgical Endoscopy.

[7]  Elisabeth A. Pimentel,et al.  Proficiency-based Fundamentals of Laparoscopic Surgery skills training results in durable performance improvement and a uniform certification pass rate , 2010, Surgical Endoscopy.

[8]  Richard M Satava,et al.  Virtual reality surgical simulator: the first steps. 1993. , 2006, Clinical orthopaedics and related research.

[9]  S. Tesfay,et al.  Implementation, construct validity, and benefit of a proficiency-based knot-tying and suturing curriculum. , 2008, Journal of surgical education.

[10]  N. Seymour VR to OR: A Review of the Evidence that Virtual Reality Simulation Improves Operating Room Performance , 2008, World Journal of Surgery.

[11]  R. Reznick,et al.  Testing technical skill via an innovative "bench station" examination. , 1997, American journal of surgery.

[12]  Jeffrey A. Cadeddu,et al.  Training on a virtual reality laparoscopic simulator improves performance of an unfamiliar live laparoscopic procedure. , 2008, The Journal of urology.

[13]  Edoardo Rovida,et al.  The First Steps , 2013 .

[14]  Daniel B. Jones,et al.  Improving operative performance using a laparoscopic hernia simulator. , 2001, American journal of surgery.

[15]  R. Satava,et al.  Virtual Reality Training Improves Operating Room Performance: Results of a Randomized, Double-Blinded Study , 2002, Annals of surgery.

[16]  G. Fried,et al.  Comparison of laparoscopic performance in vivo with performance measured in a laparoscopic simulator , 1999, Surgical Endoscopy.

[17]  D. Scott,et al.  The impact of intense laparoscopic skills training on the operative performance of urology residents. , 2001, The Journal of urology.

[18]  James R Korndorffer,et al.  Simulator training for laparoscopic suturing using performance goals translates to the operating room. , 2005, Journal of the American College of Surgeons.

[19]  G. Ahlberg,et al.  Does training in a virtual reality simulator improve surgical performance? , 2001, Surgical Endoscopy And Other Interventional Techniques.

[20]  C D Smith,et al.  Assessing laparoscopic manipulative skills. , 2001, American journal of surgery.

[21]  Leif Hedman,et al.  Proficiency-based virtual reality training significantly reduces the error rate for residents during their first 10 laparoscopic cholecystectomies. , 2007, American journal of surgery.

[22]  T. Grantcharov,et al.  Randomized clinical trial of virtual reality simulation for laparoscopic skills training , 2004, The British journal of surgery.

[23]  D. Scott,et al.  Construct and face validity of MIST-VR, Endotower, and CELTS , 2005, Surgical Endoscopy And Other Interventional Techniques.

[24]  Paul G Gauger,et al.  Laparoscopic Skills Are Improved With LapMentor™ Training: Results of a Randomized, Double-Blinded Study , 2006, Annals of surgery.

[25]  H. Lönroth,et al.  The transfer of basic skills learned in a laparoscopic simulator to the operating room , 2002, Surgical Endoscopy And Other Interventional Techniques.

[26]  P. H. Cosman,et al.  Skills Acquired on Virtual Reality Laparoscopic Simulators Transfer into the Operating Room in a Blinded, Randomised, Controlled Trial , 2007, MMVR.

[27]  Daniel B. Jones,et al.  Laparoscopic training on bench models: better and more cost effective than operating room experience? , 2000, Journal of the American College of Surgeons.

[28]  R. Reznick,et al.  Objective structured assessment of technical skill (OSATS) for surgical residents , 1997, The British journal of surgery.

[29]  A. D. Gilliam Construct validity of the ProMIS laparoscopic simulator , 2009, Surgical Endoscopy.

[30]  Michitaka Fujiwara,et al.  Construct validity of the LapVR virtual-reality surgical simulator , 2011, Surgical Endoscopy.