Simulation-Based Mastery Learning Improves Medical Student Performance and Retention of Core Clinical Skills

Introduction Simulation-based mastery learning (SBML) improves procedural skills among medical trainees. We employed an SBML method that includes an asynchronous knowledge acquisition portion and a hands-on skill acquisition portion with simulation to assess senior medical student performance and retention of the following 6 core clinical skills: (a) ultrasound-guided peripheral intravenous placement, (b) basic skin laceration repair, (c) chest compressions, (d) bag-valve mask ventilation, (e) defibrillator management, and (f) code leadership. Methods Seven emergency medicine (EM) faculty members developed curricula, created checklists, and set minimum passing standards (MPSs) to test mastery of the 6 skills. One hundred thirty-five students on an EM clerkship were pretested on all 6 skills, viewed online videos asynchronously followed by a multiple choice computer-based skill-related quiz, received one-on-one hands-on skill training using deliberate practice with feedback, and were posttested until MPS was met. We compared pretest and posttest performance. We also retested, unannounced, a convenience sample (36%) of students from 1 to 9 months postintervention to assess skill retention. Results All students passed each quiz. The percentage of students who reached each MPS increased significantly (P < 0.001) from pretest to posttest for all 6 clinical skills. Ninety-eight percent of the students scored at or above the MPS when retested 1 to 9 months later. There was no significant decrease in mean score for any of the 6 skills between posttest and retention testing. Conclusions Simulation-based mastery learning using a substantial asynchronous component is an effective way for senior medical students to learn and retain EM clinical skills. This method can be adapted to other skill training necessary for residency readiness.

[1]  Jonathan M. Amiel,et al.  Core Entrustable Professional Activities for Entering Residency Pilot Group Update: Considerations for Medical Science Educators , 2016, Medical Science Educator.

[2]  Chaoyan Dong,et al.  Beyond the Simulation Laboratory: A Realist Synthesis Review of Clinical Outcomes of Simulation-Based Mastery Learning , 2015, Academic medicine : journal of the Association of American Medical Colleges.

[3]  Joel R. Levin,et al.  Single-Case Intervention Research: Methodological and Statistical Advances , 2014 .

[4]  William C McGaghie,et al.  A critical review of simulation‐based mastery learning with translational outcomes , 2014, Medical education.

[5]  S. Hamstra,et al.  Mastery Learning for Health Professionals Using Technology-Enhanced Simulation: A Systematic Review and Meta-Analysis , 2013, Academic medicine : journal of the Association of American Medical Colleges.

[6]  J. Barsuk,et al.  Simulation-based education with mastery learning improves residents' lumbar puncture skills , 2012, Neurology.

[7]  J. Barsuk,et al.  Clinical Performance and Skill Retention after Simulation‐based Education for Nephrology Fellows , 2012, Seminars in dialysis.

[8]  David Plummer,et al.  Ultrasound-Guided Peripheral IV Placement , 2012 .

[9]  Lanty M. O'Connor,et al.  Simulation-based education with mastery learning improves paracentesis skills. , 2012, Journal of graduate medical education.

[10]  D. Plummer,et al.  Videos in clinical medicine. Ultrasound-guided peripheral i.v. placement. , 2012, The New England journal of medicine.

[11]  V. Naik,et al.  Complex procedural skills are retained for a minimum of 1 yr after a single high-fidelity simulation training session. , 2011, British journal of anaesthesia.

[12]  Gail M Sullivan,et al.  Getting off the "gold standard": randomized controlled trials and education research. , 2011, Journal of graduate medical education.

[13]  Dimitrios Stefanidis,et al.  Evaluating the Impact of Simulation on Translational Patient Outcomes , 2011, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[14]  Gail M. Sullivan Deconstructing quality in education research. , 2011, Journal of graduate medical education.

[15]  J. Barsuk,et al.  Long-Term Retention of Central Venous Catheter Insertion Skills After Simulation-Based Mastery Learning , 2010, Academic medicine : journal of the Association of American Medical Colleges.

[16]  D. Ander,et al.  Emergency medicine clerkship curriculum: an update and revision. , 2010, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[17]  Elaine R. Cohen,et al.  Simulation-based Mastery Learning Improves Cardiac Auscultation Skills in Medical Students , 2010, Journal of General Internal Medicine.

[18]  S. Glickman,et al.  Gaps in procedural experience and competency in medical school graduates. , 2009, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[19]  William C. McGaghie,et al.  Setting Defensible Standards for Cardiac Auscultation Skills in Medical Students , 2009, Academic medicine : journal of the Association of American Medical Colleges.

[20]  William C. McGaghie,et al.  Simulation‐based mastery learning reduces complications during central venous catheter insertion in a medical intensive care unit * , 2009, Critical care medicine.

[21]  Paul E. Mazmanian,et al.  Lessons for continuing medical education from simulation research in undergraduate and graduate medical education: effectiveness of continuing medical education: American College of Chest Physicians Evidence-Based Educational Guidelines. , 2009, Chest.

[22]  M. Leuwer,et al.  Retention and transferability of team resource management skills in anaesthetic emergencies: the long-term impact of a high-fidelity simulation-based course , 2009, European journal of anaesthesiology.

[23]  K. D. Moore,et al.  Management of shoulder dystocia skill retention 6 and 12 months after training. , 2008, Obstetrics and gynecology.

[24]  P M Kuduvalli,et al.  Unanticipated difficult airway management in anaesthetised patients: a prospective study of the effect of mannequin training on management strategies and skill retention , 2008, Anaesthesia.

[25]  J. Barsuk,et al.  Mastery learning of thoracentesis skills by internal medicine residents using simulation technology and deliberate practice. , 2008, Journal of hospital medicine.

[26]  R. Ortega,et al.  Videos in clinical medicine. Positive-pressure ventilation with a face mask and a bag-valve device. , 2007, The New England journal of medicine.

[27]  William C McGaghie,et al.  A Longitudinal Study of Internal Medicine Residents’ Retention of Advanced Cardiac Life Support Skills , 2006, Academic medicine : journal of the Association of American Medical Colleges.

[28]  J. Feinglass,et al.  Mastery learning of advanced cardiac life support skills by internal medicine residents using simulation technology and deliberate practice , 2006, Journal of General Internal Medicine.

[29]  Ara Tekian,et al.  RESEARCH METHODOLOGY: Procedures for Establishing Defensible Absolute Passing Scores on Performance Examinations in Health Professions Education , 2006, Teaching and learning in medicine.

[30]  T. Thomsen,et al.  Videos in clinical medicine. Basic laceration repair. , 2006, The New England journal of medicine.

[31]  A. Cattell The Adult Learner – The Definitive Classic in Adult Education and Human Resource Development , 2005 .

[32]  William C McGaghie,et al.  Comparison of Two Standard-setting Methods for Advanced Cardiac Life Support Training , 2005, Academic medicine : journal of the Association of American Medical Colleges.

[33]  G. Bandiera,et al.  Creating effective learning in today's emergency departments: how accomplished teachers get it done. , 2005, Annals of emergency medicine.

[34]  M. Graber,et al.  Patient opinions and attitudes toward medical student procedures in the emergency department. , 2003, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[35]  J. Norcini,et al.  Setting standards on educational tests , 2003, Medical education.

[36]  L. Brown,et al.  The emergency medicine rotation: a unique experience for medical students. , 2002, The Journal of emergency medicine.

[37]  M. Cusimano Standard setting in medical education , 1996, Academic medicine : journal of the Association of American Medical Colleges.

[38]  L. Sjodahl Evaluation of Training. , 1975 .

[39]  J. Fleiss,et al.  Statistical methods for rates and proportions , 1973 .

[40]  Lester R. Bittel,et al.  TRAINING AND DEVELOPMENT HANDBOOK. , 1967 .