Instructor Feedback Versus No Instructor Feedback on Performance in a Laparoscopic Virtual Reality Simulator: A Randomized Trial

Objective:To investigate the impact of instructor feedback versus no instructor feedback when training a complex operational task on a laparoscopic virtual reality simulator. Background:Simulators are now widely accepted as a training tool, but there is insufficient knowledge about how much feedback is necessary, which is useful for sustainable implementation. Methods:A randomized trial complying with CONSORT Statement. All participants had to reach a predefined proficiency level for a complex operational task on a virtual reality simulator. The intervention group received standardized instructor feedback a maximum of 3 times. The control group did not receive instructor feedback. Participants were senior medical students without prior laparoscopic experience (n = 99). Outcome measures were time, repetitions, and performance score to reach a predefined proficiency level. Furthermore, influence of sex and perception of own surgical skills were examined. Results:Time (in minutes) and repetitions were reduced in the intervention group (162 vs 342 minutes; P < 0.005) and (29 vs 65 repetitions; P < 0.005). The control group achieved a higher performance score than the intervention group (57% vs 49%; P = 0.004). Men used less time (in minutes) than women (P = 0.037), but no sex difference was observed for repetitions (P = 0.20). Participants in the intervention group had higher self-perception regarding surgical skills after the trial (P = 0.011). Conclusions:Instructor feedback increases the efficiency when training a complex operational task on a virtual reality simulator; time and repetitions used to achieve a predefined proficiency level were significantly reduced in the group that received instructor feedback compared with the control group. Trial registration number: NCT01497782.

[1]  Leif Hedman,et al.  Proficiency-based virtual reality training significantly reduces the error rate for residents during their first 10 laparoscopic cholecystectomies. , 2007, American journal of surgery.

[2]  A. Cuschieri,et al.  Extent of innate dexterity and ambidexterity across handedness and gender: Implications for training in laparoscopic surgery , 2007, Surgical Endoscopy.

[3]  R. Aggarwal,et al.  Objective assessment of gynecologic laparoscopic skills using the LapSimGyn virtual reality simulator , 2006, Surgical Endoscopy And Other Interventional Techniques.

[4]  R. A. Forse,et al.  Can we continue to ignore gender differences in performance on simulation trainers? , 2011, Journal of laparoendoscopic & advanced surgical techniques. Part A.

[5]  R. Satava,et al.  Virtual Reality Simulation for the Operating Room: Proficiency-Based Training as a Paradigm Shift in Surgical Skills Training , 2005, Annals of surgery.

[6]  A. Darzi,et al.  Simulation and clinical practice: strengthening the relationship , 2004, Medical education.

[7]  Dan Morris,et al.  Providing metrics and performance feedback in a surgical simulator , 2008, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[8]  J. Wetterslev,et al.  Evidence at a glance: error matrix approach for overviewing available evidence , 2010, BMC medical research methodology.

[9]  Jiguo Cao,et al.  Mastery versus the standard proficiency target for basic laparoscopic skill training: effect on skill transfer and retention , 2011, Surgical Endoscopy.

[10]  Glenn Regehr,et al.  Measuring Self-assessment: Current State of the Art , 2002, Advances in health sciences education : theory and practice.

[11]  J. Dungan,et al.  Effect of virtual reality training on laparoscopic surgery: randomised controlled trial , 2010 .

[12]  Anthony G Gallagher,et al.  Optimising surgical training: use of feedback to reduce errors during a simulated surgical procedure , 2011, Postgraduate Medical Journal.

[13]  Dimitrios Stefanidis,et al.  The formula for a successful laparoscopic skills curriculum. , 2009, Archives of surgery.

[14]  A. G. Gallagher,et al.  The effect of escalating feedback on the acquisition of psychomotor skills for laparoscopy , 2007, Surgical Endoscopy.

[15]  Nader N Massarweh,et al.  Laparoscopic virtual reality training: are 30 repetitions enough? , 2004, The Journal of surgical research.

[16]  R. Satava,et al.  Virtual Reality Training Improves Operating Room Performance: Results of a Randomized, Double-Blinded Study , 2002, Annals of surgery.

[17]  T. Grantcharov,et al.  Randomized clinical trial of virtual reality simulation for laparoscopic skills training , 2004, The British journal of surgery.

[18]  Christopher W. Snyder,et al.  Proficiency-based laparoscopic and endoscopic training with virtual reality simulators: a comparison of proctored and independent approaches. , 2009, Journal of surgical education.

[19]  A. Scherpbier,et al.  Validation and implementation of surgical simulators: a critical review of present, past, and future , 2009, Surgical Endoscopy.

[20]  Sonja N. Buzink,et al.  Criterion-based laparoscopic training reduces total training time , 2011, Surgical Endoscopy.

[21]  C. Shea,et al.  Motor skill learning and performance: a review of influential factors , 2010, Medical education.

[22]  Gabriele Wulf,et al.  Self-Controlled Observational Practice Enhances Learning , 2005, Research quarterly for exercise and sport.

[23]  A. Paisley,et al.  Predictors of Technical Skill Acquisition Among Resident Trainees in a Laparoscopic Skills Education Program , 2008, World Journal of Surgery.

[24]  Gabriele Wulf,et al.  Self-Controlled Feedback Is Effective if It Is Based on the Learner's Performance , 2005, Research quarterly for exercise and sport.

[25]  C. Cao,et al.  How much feedback is necessary for learning to suture? , 2008, Surgical Endoscopy.

[26]  Jason J Zigmont,et al.  Theoretical foundations of learning through simulation. , 2011, Seminars in perinatology.

[27]  Heather Carnahan,et al.  How effective is self‐guided learning of clinical technical skills? It’s all about process , 2009, Medical education.

[28]  T. Draycott,et al.  The use of simulation to teach clinical skills in obstetrics. , 2011, Seminars in perinatology.

[29]  E. Holmboe,et al.  Self-assessment in lifelong learning and improving performance in practice: physician know thyself. , 2006, JAMA.

[30]  S. Holm.  A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[31]  T. Grantcharov,et al.  Impact of hand dominance, gender, and experience with computer games on performance in virtual reality laparoscopy , 2003, Surgical Endoscopy And Other Interventional Techniques.

[32]  A. Nathens,et al.  Threat and challenge: cognitive appraisal and stress responses in simulated trauma resuscitations , 2010, Medical education.

[33]  Peter Weinstock,et al.  Effects of Simulation Versus Traditional Tutorial-Based Training on Physiologic Stress Levels Among Clinicians: A Pilot Study , 2010, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[34]  Charlotte Ringsted,et al.  Instructor feedback versus no instructor feedback on performance in a laparoscopic virtual reality simulator: a randomized educational trial , 2012, BMC medical education.

[35]  Rajesh Aggarwal,et al.  Proving the Effectiveness of Virtual Reality Simulation for Training in Laparoscopic Surgery , 2007, Annals of surgery.

[36]  S. Patchett,et al.  Evaluation of formal feedback on endoscopic competence among trainees: the EFFECT trial , 2008, Irish journal of medical science.

[37]  E. Fosse,et al.  Unsupervised Virtual Reality Training May Not Increase Laparoscopic Suturing Skills , 2011, Surgical laparoscopy, endoscopy & percutaneous techniques.

[38]  C. R. Larsen,et al.  Integration of laparoscopic virtual‐reality simulation into gynaecology training , 2011, BJOG : an international journal of obstetrics and gynaecology.

[39]  J. Ende.  Feedback in clinical medical education. , 1983, JAMA.

[40]  Rajesh Aggarwal,et al.  A competency-based virtual reality training curriculum for the acquisition of laparoscopic psychomotor skill. , 2006, American journal of surgery.