“Best Practice” Skills Lab Training vs. a “see one, do one” Approach in Undergraduate Medical Education: An RCT on Students’ Long-Term Ability to Perform Procedural Clinical Skills

Background Benefits of skills lab training are widely accepted, but there is sparse research on its long-term effectiveness. We therefore conducted a prospective, randomised controlled-trial to investigate whether in a simulated setting students trained according to a "best practice" model (BPSL) perform two skills of different complexity (nasogastral tube insertion, NGT; intravenous cannulation, IVC) better than students trained with a traditional "see one, do one" teaching approach (TRAD), at follow-up of 3 or 6 months. Methodology and Principal Findings 94 first-year medical students were randomly assigned to one of four groups: BPSL training or TRAD teaching with follow-up at 3 (3M) or 6 (6M) months. BPSL included structured feedback, practice on manikins, and Peyton’s "Four-Step-Approach", while TRAD was only based on the "see one - do one" principle. At follow-up, manikins were used to assess students’ performance by two independent blinded video-assessors using binary checklists and a single-item global assessment scale. BPSL students scored significantly higher immediately after training (NGT: BPSL3M 94.8%±0.2 and BPSL6M 95.4%±0.3 percentage of maximal score ± SEM; TRAD3M 86.1%±0.5 and TRAD6M 84.7%±0.4. IVC: BPSL3M 86.4%±0.5 and BPSL6M 88.0%±0.5; TRAD3M 73.2%±0.7 and TRAD6M 72.5%±0.7) and lost significantly less of their performance ability at each follow-up (NGT: BPSL3M 86.3%±0.3 and TRAD3M 70.3%±0.6; BPSL6M 89.0%±0.3 and TRAD6M 65.4%±0.6; IVC: BPSL3M 79.5%±0.5 and TRAD3M 56.5%±0.5; BPSL6M 73.2%±0.4 and TRAD6M 51.5%±0.8). In addition, BPSL students were more often rated clinically competent at all assessment times. The superiority at assessment after training was higher for the more complex skill (IVC), whereas NGT with its lower complexity profited more with regard to long-term retention. Conclusions This study shows that within a simulated setting BPSL is significantly more effective than TRAD for skills of different complexity assessed immediately after training and at follow-up. The advantages of BPSL training are seen especially in long-term retention.

[1]  Robert Burton,et al.  A systematic review of medical skills laboratory training: where to from here? , 2007, Medical education.

[2]  Michael Gaetz,et al.  First aid skill retention of first responders within the workplace , 2011, Scandinavian journal of trauma, resuscitation and emergency medicine.

[3]  P Bradley,et al.  Setting up a clinical skills learning facility , 2003, Medical education.

[4]  J. Barsuk,et al.  Clinical Performance and Skill Retention after Simulation‐based Education for Nephrology Fellows , 2012, Seminars in dialysis.

[5]  Jana Jünger,et al.  Effects of Peyton's Four-Step Approach on Objective Performance Measures in Technical Skills Training: A Controlled Trial , 2011, Teaching and learning in medicine.

[6]  A. Calle-Pascual,et al.  A Telemedicine system based on Internet and short message service as a new approach in the follow-up of patients with gestational diabetes. , 2010, Diabetes research and clinical practice.

[7]  C. Nikendei,et al.  Effectiveness of IV Cannulation Skills Laboratory Training and Its Transfer into Clinical Practice: A Randomized, Controlled Trial , 2012, PloS one.

[8]  R. Schmidt,et al.  New Conceptualizations of Practice: Common Principles in Three Paradigms Suggest New Concepts for Training , 1992 .

[9]  M. Frass,et al.  Performance and skill retention of intubation by paramedics using seven different airway devices--a manikin study. , 2011, Resuscitation.

[10]  M. Fitch,et al.  Stages of competency for medical procedures , 2012, The clinical teacher.

[11]  A. Ziv,et al.  Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review , 2005, Medical teacher.

[12]  R G Oliver,et al.  A Practical Guide for Medical Teachers. , 2002, Journal of orthodontics.

[13]  H. Schmidt,et al.  Description, justification and clarification: a framework for classifying the purposes of research in medical education , 2008, Medical education.

[14]  Jeanie Goddard,et al.  Teaching as Theatre , 2008 .

[15]  S. Zipfel,et al.  An innovative model for teaching complex clinical procedures: Integration of standardised patients into ward round training for final year students , 2007, Medical teacher.

[16]  J. Soar,et al.  A systematic review of retention of adult advanced life support knowledge and skills in healthcare providers. , 2012, Resuscitation.

[17]  W. Herzog,et al.  Role-playing for more realistic technical skills training , 2005, Medical teacher.

[18]  Kamran Z Khan,et al.  Simulation in Medical Education , 2018, Understanding Medical Education.

[19]  S. Thompson Social Learning Theory , 2008 .

[20]  A. Darzi,et al.  The learning curve for a colonoscopy simulator in the absence of any feedback: No feedback, no learning , 2004, Surgical Endoscopy And Other Interventional Techniques.

[21]  Amitai Ziv,et al.  Simulation Based Medical Education: an opportunity to learn from errors , 2005, Medical teacher.

[22]  V M DeCoux,et al.  Kolb's Learning Style Inventory: a review of its applications in nursing research. , 1990, The Journal of nursing education.

[23]  J. Rethans,et al.  The relationship between competence and performance: implications for assessing practice performance , 2002, Medical education.

[24]  Christopher W. Snyder,et al.  Retention of Colonoscopy Skills after Virtual Reality Simulator Training by Independent and Proctored Methods , 2010, The American surgeon.

[25]  R. Duran,et al.  Proficiency and knowledge gained and retained by pediatric residents after neonatal resuscitation course , 2008, Pediatrics international : official journal of the Japan Pediatric Society.

[26]  J. McNally Self-Directed Learning, A Guide for Learners and Teachers , 1976 .

[27]  Lynne T. Harris,et al.  Effective intervention or child's play? A review of video games for diabetes education. , 2010, Diabetes technology & therapeutics.

[28]  J. Barsuk,et al.  Use of simulation-based mastery learning to improve the quality of central venous catheter placement in a medical intensive care unit. , 2009, Journal of hospital medicine.

[29]  R. Rossaint,et al.  Evaluation of a newly developed media-supported 4-step approach for basic life support training , 2012, Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine.

[30]  J. Barsuk,et al.  Does Simulation-Based Medical Education With Deliberate Practice Yield Better Results Than Traditional Clinical Education? A Meta-Analytic Comparative Review of the Evidence , 2011, Academic medicine : journal of the Association of American Medical Colleges.

[31]  C. Nikendei,et al.  Peer‐assisted versus faculty staff‐led skills laboratory training: a randomised controlled trial , 2009, Medical education.

[32]  Irene W. Y. Ma,et al.  Directed self‐regulated learning versus instructor‐regulated learning in simulation training , 2012, Medical education.

[33]  K. A. Ericsson,et al.  Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. , 2004, Academic medicine : journal of the Association of American Medical Colleges.

[34]  R. Schwarzer,et al.  The General Self-Efficacy Scale: Multicultural Validation Studies , 2005, The Journal of psychology.

[35]  H. Barrows An overview of the uses of standardized patients for teaching and evaluating clinical skills. AAMC , 1993, Academic medicine : journal of the Association of American Medical Colleges.

[36]  S. Downing,et al.  Structured training on box trainers for first year surgical residents: does it improve retention of laparoscopic skills? A randomized controlled study. , 2012, Journal of surgical education.

[37]  Martin F. Lynch,et al.  Computer-assisted intervention improves patient-centered diabetes care by increasing autonomy support. , 2007, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[38]  M. Johnston,et al.  Measures in Health Psychology: A User's Portfolio , 1995 .

[39]  R. Reznick,et al.  Comparing the psychometric properties of checklists and global rating scales for assessing performance on an OSCE‐format examination , 1998, Academic medicine : journal of the Association of American Medical Colleges.

[40]  Dimitrios Stefanidis,et al.  Evaluating the Impact of Simulation on Translational Patient Outcomes , 2011, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[41]  L. A. Hausman How we Think , 1921 .

[42]  Norbert Senninger,et al.  Laparoscopic simulation training: Testing for skill acquisition and retention. , 2012, Surgery.

[43]  Karen Pierce,et al.  Evaluation of staff's retention of ACLS and BLS skills. , 2008, Resuscitation.

[44]  V. Naik,et al.  Complex procedural skills are retained for a minimum of 1 yr after a single high-fidelity simulation training session. , 2011, British journal of anaesthesia.

[45]  Grace C. Huang,et al.  Simulation Training and Its Effect on Long-Term Resident Performance in Central Venous Catheterization , 2010, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[46]  G. Marchesini,et al.  Guidelines for enteral feeding in adult hospital patients , 2003, Gut.

[47]  S. Zipfel,et al.  Integration of role-playing into technical skills training: a randomized controlled trial , 2007, Medical teacher.

[48]  D. Dunn,et al.  Experiential Learning , 2019, High Impact Teaching for Sport and Exercise Psychology Educators.

[49]  Dariush Rokhafroz,et al.  clinical skills education , 2010 .

[50]  Gabriele Wulf,et al.  Continuous Concurrent Feedback Degrades Skill Learning: Implications for Training and Simulation , 1997, Hum. Factors.

[51]  Winston Bennett,et al.  Factors That Influence Skill Decay and Retention: A Quantitative Review and Analysis , 1998 .

[52]  P. Ingram,et al.  Peripheral intravenous cannulation: safe insertion and removal technique. , 2007, Nursing standard (Royal College of Nursing (Great Britain) : 1987).

[53]  J. Sandars,et al.  Self-regulation theory: Applications to medical education: AMEE Guide No. 58 , 2011, Medical teacher.

[54]  Ori Eyal,et al.  A prototype of a new noninvasive device to detect nocturnal hypoglycemia in adolescents with type 1 diabetes--a pilot study. , 2012, Diabetes technology & therapeutics.

[55]  H. Owen,et al.  Learning on a simulator does transfer to clinical practice. , 2009, Resuscitation.

[56]  Adam Dubrowski,et al.  Teaching Surgical Skills: What Kind of Practice Makes Perfect?: A Randomized, Controlled Trial , 2006, Annals of surgery.

[57]  Kezhong Chen,et al.  Learning curves and long-term outcome of simulation-based thoracentesis training for medical students , 2011, BMC medical education.