Optimal acquisition and assessment of proficiency on simulators in surgery.

Increasingly, trainees are being exposed to simulators for the purpose of acquiring surgical skills. This article addresses the theoretical framework behind surgical skill acquisition and explores the factors that optimize learning on simulators. Furthermore, this article evaluates the role of currently used performance metrics for documentation of skills proficiency and provides suggestions for the incorporation of additional, more sensitive performance metrics that may lead to improved transfer of simulator-acquired skill.

[1]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[2]  K. A. Ericsson,et al.  Expert and exceptional performance: evidence of maximal adaptation to task constraints. , 1996, Annual review of psychology.

[3]  K. A. Ericsson,et al.  Deliberate practice and acquisition of expert performance: a general overview. , 2008, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[4]  A Darzi,et al.  Practice distribution in procedural skills training: a randomized controlled trial. , 2002, Surgical endoscopy.

[5]  B. Böhm,et al.  A prospective randomized trial on heart rate variability of the surgical team during laparoscopic and conventional sigmoid resection. , 2001, Archives of surgery.

[6]  Rajesh Aggarwal,et al.  Framework for systematic training and assessment of technical skills. , 2007, Journal of the American College of Surgeons.

[7]  Lucian Panait,et al.  The role of haptic feedback in laparoscopic simulation training. , 2009, The Journal of surgical research.

[8]  M. Schijven,et al.  The value of haptic feedback in conventional and robot-assisted minimal invasive surgery and virtual reality training: a current review , 2009, Surgical Endoscopy.

[9]  Leslie G. Ungerleider,et al.  The acquisition of skilled motor performance: fast and slow experience-driven changes in primary motor cortex. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[10]  E. DeMaria,et al.  Training the novice in laparoscopy , 2002, Surgical Endoscopy And Other Interventional Techniques.

[11]  Daniel B. Jones,et al.  Construct and face validity and task workload for laparoscopic camera navigation: virtual reality versus videotrainer systems at the SAGES Learning Center , 2007, Surgical Endoscopy.

[12]  J. Ende.  Feedback in clinical medical education. , 1983, JAMA.

[13]  Jeffrey T. Fairbrother,et al.  Differential Transfer Benefits of Increased Practice for Constant, Blocked, and Serial Practice Schedules , 2002, Journal of motor behavior.

[14]  A. Madan,et al.  Goal-directed laparoscopic training leads to better laparoscopic skill acquisition. , 2008, Surgery.

[15]  R. Satava,et al.  Virtual Reality Training Improves Operating Room Performance: Results of a Randomized, Double-Blinded Study , 2002, Annals of surgery.

[16]  P K Davis,et al.  The use of video self-modelling and feedback to teach cooking skills to individuals with traumatic brain injury: A pilot study , 2006, Brain injury.

[17]  W. Heinrichs,et al.  Three different types of surgeon-specific stress reactions identified by laparoscopic simulation in a virtual scenario , 2008, Surgical Endoscopy.

[18]  F. Greene,et al.  Performance goals on simulators boost resident motivation and skills lab attendance , 2008 .

[19]  M. Yano,et al.  Cyber visual training as a new method for the mastery of endoscopic surgery , 2005, Surgical Endoscopy And Other Interventional Techniques.

[20]  J. Rosser,et al.  Effectiveness of a CD-ROM multimedia tutorial in transferring cognitive knowledge essential for laparoscopic skill training. , 2000, American journal of surgery.

[21]  Timothy D. Lee,et al.  Distribution of Practice in Motor Skill Acquisition: Learning and Performance Effects Reconsidered , 1988 .

[22]  R. Reznick,et al.  Comparing the psychometric properties of checklists and global rating scales for assessing performance on an OSCE‐format examination , 1998, Academic medicine : journal of the Association of American Medical Colleges.

[23]  Adam Dubrowski,et al.  Surgical skill acquisition with self-directed practice using computer-based video training. , 2007, American journal of surgery.

[24]  J. Veltman,et al.  Physiological workload reactions to increasing levels of task difficulty. , 1998, Ergonomics.

[25]  Dimitrios Stefanidis,et al.  The formula for a successful laparoscopic skills curriculum. , 2009, Archives of surgery.

[26]  R. M. Satava,et al.  Disruptive visions: surgical education , 2004, Surgical Endoscopy And Other Interventional Techniques.

[27]  T. D. Lee,et al.  Contextual interference in movements of the same class: differential effects on program and parameter learning. , 1993, Journal of motor behavior.

[28]  R. M. Satava,et al.  Evaluation of structured and quantitative training methods for teaching intracorporeal knot tying , 2001, Surgical Endoscopy And Other Interventional Techniques.

[29]  L. Kaufman,et al.  Cognitive processes and performance , 1986 .

[30]  J. Gianutsos,et al.  Effects of Contextual Interference and Conditions of Movement Task on Acquisition, Retention, and Transfer of Motor Skills by Women , 1997, Perceptual and motor skills.

[31]  J. P. Fuentes,et al.  Analysis of Effects of Distribution of Practice in Learning and Retention of a Continuous and a Discrete Skill Presented on a Computer , 2008, Perceptual and motor skills.

[32]  A. Ziv,et al.  Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review , 2005, Medical teacher.

[33]  James R Korndorffer,et al.  Simulator training for laparoscopic suturing using performance goals translates to the operating room. , 2005, Journal of the American College of Surgeons.

[34]  N. Hodges,et al.  Modelling coaching practice: the role of instruction and demonstration , 2002, Journal of sports sciences.

[35]  P G Jorna,et al.  Heart rate and workload variations in actual and simulated flight. , 1993, Ergonomics.

[36]  R. Shiffrin,et al.  Controlled and automatic human information processing: I , 1977 .

[37]  R. Reznick,et al.  Objective structured assessment of technical skill (OSATS) for surgical residents , 1997, The British journal of surgery.

[38]  R. Reznick,et al.  Teaching surgical skills--changes in the wind. , 2006, The New England journal of medicine.

[39]  Dimitrios Stefanidis,et al.  Challenges during the implementation of a laparoscopic skills curriculum in a busy general surgery residency program. , 2008, Journal of surgical education.

[40]  G C Rinehart,et al.  Acquisition of surgical skills: a randomized trial of didactic, videotape, and computer-based training. , 1999, Surgery.

[41]  E. DeMaria,et al.  Training the novice in laparoscopy. More challenge is better. , 2002, Surgical endoscopy.

[42]  Teodor P Grantcharov,et al.  The impact of constructive feedback on training in gastrointestinal endoscopy using high-fidelity virtual-reality simulation: a randomised controlled trial , 2009, Gut.

[43]  Heather Carnahan,et al.  How effective is self‐guided learning of clinical technical skills? It’s all about process , 2009, Medical education.

[44]  Gabriele Wulf,et al.  Continuous Concurrent Feedback Degrades Skill Learning: Implications for Training and Simulation , 1997, Hum. Factors.

[45]  Frank Brady,et al.  Contextual Interference: A Meta-Analytic Study , 2004, Perceptual and motor skills.

[46]  James R Korndorffer,et al.  Closing the gap in operative performance between novices and experts: does harder mean better for laparoscopic simulator training? , 2006, Journal of the American College of Surgeons.

[47]  Melina C Vassiliou,et al.  A global assessment tool for evaluation of intraoperative laparoscopic skills. , 2005, American journal of surgery.

[48]  D A Rogers,et al.  The impact of external feedback on computer-assisted learning for surgical technical skill training. , 2000, American journal of surgery.

[49]  W. Shebilske,et al.  Motor Learning and Control , 1993 .

[50]  Dimitrios Stefanidis,et al.  Do novices display automaticity during simulator training? , 2008, American journal of surgery.

[51]  Warren D. Smith,et al.  Performing laparoscopic surgery is significantly more stressful for the surgeon than open surgery , 2001, Surgical Endoscopy.

[52]  A. H. Roscoe.  Assessing pilot workload. Why measure heart rate, HRV and respiration? , 1992, Biological Psychology.

[53]  Caroline G. L. Cao,et al.  Can Surgeons Think and Operate with Haptics at the Same Time? , 2007, Journal of Gastrointestinal Surgery.

[54]  J. J. Donovan,et al.  A meta-analytic review of the distribution of practice effect: Now you see it, now you don't. , 1999 .

[55]  Ju-Ying Chang,et al.  Effectiveness of Two Forms of Feedback on Training of a Joint Mobilization Skill by Using a Joint Translation Simulator , 2007, Physical Therapy.

[56]  Leif Hedman,et al.  Proficiency-based virtual reality training significantly reduces the error rate for residents during their first 10 laparoscopic cholecystectomies. , 2007, American journal of surgery.

[57]  A. Darzi,et al.  The learning curve for a colonoscopy simulator in the absence of any feedback: No feedback, no learning , 2004, Surgical Endoscopy And Other Interventional Techniques.

[58]  Matthew B. Weinger,et al.  An Objective Methodology for Task Analysis and Workload Assessment in Anesthesia Providers , 1994, Anesthesiology.

[59]  R. Reznick,et al.  Teaching suturing and knot-tying skills to medical students: a randomized controlled study comparing computer-based video instruction and (concurrent and summary) expert feedback. , 2007, Surgery.

[60]  P. Hancock,et al.  Human Mental Workload , 1988 .

[61]  G. Regehr,et al.  OSCE checklists do not capture increasing levels of expertise. , 1999, Academic medicine : journal of the Association of American Medical Colleges.

[62]  M. Osborne.  William Stewart Halsted: his life and contributions to surgery. , 2007, The Lancet. Oncology.

[63]  C. mongin,et al.  Stress des chirurgiensen formation : Étude prospective de la cardio-fréquence lors de cholécystectomies laparoscopiques , 2008 .

[64]  C Alain,et al.  The effects of the amount and variability of practice on the learning of a multi-segmented motor task. , 1994, Acta psychologica.

[65]  Adam Dubrowski,et al.  Teaching Surgical Skills: What Kind of Practice Makes Perfect?: A Randomized, Controlled Trial , 2006, Annals of surgery.

[66]  Dimitrios Stefanidis,et al.  Increased stress levels may explain the incomplete transfer of simulator-acquired skill to the operating room. , 2010, Surgery.

[67]  K. A. Ericsson,et al.  Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. , 2004, Academic medicine : journal of the Association of American Medical Colleges.

[68]  G. Logan.  Automaticity, Resources, and Memory: Theoretical Controversies and Practical Implications , 1988, Human factors.

[69]  A. H. Roscoe,et al.  Assessing Pilot Workload , 1978 .

[70]  R. Satava,et al.  Virtual Reality Simulation for the Operating Room: Proficiency-Based Training as a Paradigm Shift in Surgical Skills Training , 2005, Annals of surgery.

[71]  Gerald M Fried,et al.  Lessons from the surgical experience with simulators: incorporation into training and utilization in determining competency. , 2006, Gastrointestinal endoscopy clinics of North America.

[72]  F. Thomas Eggemeier,et al.  Workload assessment methodology. , 1986 .

[73]  Rajesh Aggarwal,et al.  A competency-based virtual reality training curriculum for the acquisition of laparoscopic psychomotor skill. , 2006, American journal of surgery.

[74]  L. Chang,et al.  Integrating simulation into a surgical residency program , 2007, Surgical Endoscopy.

[75]  P. Ström,et al.  Early exposure to haptic feedback enhances performance in surgical simulator training: a prospective randomized crossover study in surgical residents , 2006, Surgical Endoscopy And Other Interventional Techniques.

[76]  P. Matthews,et al.  Changing brain networks for visuomotor control with increased movement automaticity. , 2004, Journal of neurophysiology.

[77]  L. Chang,et al.  Integrating simulation into a surgical residency program: is voluntary participation effective? , 2007, Surgical endoscopy.

[78]  R. Schmidt,et al.  Reduced frequency of knowledge of results enhances motor skill learning. , 1990 .

[79]  R. Christina,et al.  Distribution of Practice and Metacognition in Learning and Long-Term Retention of a Discrete Motor Task , 2004, Research quarterly for exercise and sport.

[80]  G. Young,et al.  Assessment of workload using NASA Task Load Index in perianesthesia nursing. , 2008, Journal of perianesthesia nursing : official journal of the American Society of PeriAnesthesia Nurses.

[81]  Timothy D. Lee,et al.  Motor Control and Learning: A Behavioral Emphasis , 1982 .

[82]  K. J. Williams,et al.  Quantitative description of the workload associated with airway management procedures. , 2000, Journal of clinical anesthesia.

[83]  R. Reznick,et al.  Verbal feedback from an expert is more effective than self-accessed feedback about motion efficiency in learning new surgical skills. , 2007, American journal of surgery.

[84]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[85]  J. Meredith,et al.  Videotape review leads to rapid and sustained learning. , 2003, American journal of surgery.

[86]  C. Daniel Smith,et al.  Design and Development of a Surgical Skills Simulation Curriculum , 2008, World Journal of Surgery.

[87]  Dimitrios Stefanidis,et al.  Proficiency-Based Laparoscopic Simulator Training Leads to Improved Operating Room Skill That Is Resistant to Decay , 2008, Surgical innovation.

[88]  Heather Carnahan,et al.  Effects of Expertise, Practice and Contextual Interference on Adaptations to Visuo-Motor Misalignment , 2008, MMVR.

[89]  J. Korndorffer,et al.  Robotic assistance improves intracorporeal suturing performance and safety in the operating room while decreasing operator workload , 2010, Surgical Endoscopy.

[90]  Walter Schneider,et al.  Controlled and automatic human information processing: II. Perceptual learning, automatic attending and a general theory. , 1977 .

[91]  J. Korndorffer,et al.  Limited feedback and video tutorials optimize learning and resource utilization during laparoscopic simulator training. , 2007, Surgery.

[92]  R. Magill.  Motor learning and control : concepts and applications , 2004 .

[93]  C. Robazza,et al.  Effects of Contextual Interference on Learning Technical Sports Skills , 1992, Perceptual and motor skills.

[94]  T D Lee,et al.  Distribution of practice in motor skill acquisition: different effects for discrete and continuous tasks. , 1989, Research quarterly for exercise and sport.

[95]  Wendy.  Now you see it....now you don , 2012 .

[96]  R. Magill,et al.  Variability of Practice and Contextual Interference in Motor Skill Learning. , 1995, Journal of motor behavior.

[97]  James R Korndorffer,et al.  Redefining simulator proficiency using automaticity theory. , 2007, American journal of surgery.