Retention of Pediatric Resuscitation Performance After a Simulation-Based Mastery Learning Session: A Multicenter Randomized Trial

Objectives: Using simulation-based mastery learning, residents can be trained to achieve a predefined performance standard in resuscitation. After mastery is achieved, performance degradation occurs over time. Prior investigations have shown performance retention of 12–14 months following intensive simulation-based mastery learning sessions. We sought to investigate the duration of mastery-level resuscitation performance retention after a single 1- to 2-hour simulation-based mastery learning session. Design: Randomized, prospective trial. Setting: Medical simulation laboratory. Subjects: Convenience sample of 42 pediatric residents. Interventions: Baseline resuscitation performance was determined on four standardized simulation scenarios. After determination of baseline performance, each resident repeated each scenario, as needed, until mastery-level performance was achieved. Residents were then randomized and retested 2, 4, or 6 months later. Statistical analysis on scores at baseline and retesting were used to determine performances changes from baseline and performance retention over time. Measurements and Main Results: Forty-two residents participated in the study (12 in 2 mo group, 14 in 4 mo group, and 16 in 6 mo group). At baseline, postgraduate year-3 residents performed better than postgraduate year-1 residents (p = 0.003). Overall performance on each of the four scenarios improved at retesting. The percent of residents maintaining mastery-level performance showed a significant linear decline (p = 0.039), with a drop at each retesting interval; 92% retained mastery at 2 months, 71% at 4 months, and 56% at 6 months. There was no difference in retention between postgraduate year-1, postgraduate year-2, and postgraduate year-3 residents (p = 0.14). Conclusions: Residents displayed significant improvements in resuscitation performance after a single simulation-based mastery learning session, but performance declined over time, with less than 60% retaining mastery-level performance at 6 months. Our results suggest that relatively frequent refresher training is needed after a single simulation-based mastery learning session. Additional research is needed to determine the duration of performance retention following any specific simulation-based mastery learning intervention.

[1]  M. Posencheg,et al.  Proficiency and Retention of Neonatal Resuscitation Skills by Pediatric Residents , 2012, Pediatrics.

[2]  J. Barsuk,et al.  Use of simulation-based mastery learning to improve the quality of central venous catheter placement in a medical intensive care unit. , 2009, Journal of hospital medicine.

[3]  D. Durbin,et al.  Teaching resuscitation to pediatric residents: the effects of an intervention. , 2000, Archives of pediatrics & adolescent medicine.

[4]  William C McGaghie,et al.  Research opportunities in simulation-based medical education using deliberate practice. , 2008, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[5]  S. Downing Validity: on the meaningful interpretation of assessment data , 2003, Medical education.

[6]  K. Menon,et al.  Using Pediatric Advanced Life Support in pediatric residency training: Does the curriculum need resuscitation?* , 2007, Pediatric critical care medicine : a journal of the Society of Critical Care Medicine and the World Federation of Pediatric Intensive and Critical Care Societies.

[7]  R. Grad,et al.  Retention of neonatal resuscitation skills and knowledge: a randomized controlled trial. , 1998, Family medicine.

[8]  Dimitrios Stefanidis,et al.  Evaluating the Impact of Simulation on Translational Patient Outcomes , 2011, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[9]  William C. McGaghie,et al.  Simulation‐based mastery learning reduces complications during central venous catheter insertion in a medical intensive care unit * , 2009, Critical care medicine.

[10]  William C McGaghie,et al.  Mastery learning of temporary hemodialysis catheter insertion by nephrology fellows using simulation technology and deliberate practice. , 2009, American journal of kidney diseases : the official journal of the National Kidney Foundation.

[11]  D. Durbin,et al.  Assessing pediatric senior residents’ training in resuscitation: Fund of knowledge, technical skills, and perception of confidence , 2000, Pediatric emergency care.

[12]  V. Nadkarni,et al.  Effect of High-Fidelity Simulation on Pediatric Advanced Life Support Training in Pediatric House Staff: A Randomized Trial , 2009, Pediatric emergency care.

[13]  William C McGaghie,et al.  Retention of critical care skills after simulation-based mastery learning. , 2013, Journal of graduate medical education.

[14]  William C McGaghie,et al.  A Longitudinal Study of Internal Medicine Residents’ Retention of Advanced Cardiac Life Support Skills , 2006, Academic medicine : journal of the Association of American Medical Colleges.

[15]  T. Sawyer,et al.  Deliberate Practice Using Simulation Improves Neonatal Resuscitation Performance , 2011, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[16]  David A. Cook,et al.  Simulation-Based Mastery Learning Improves Patient Outcomes in Laparoscopic Inguinal Hernia Repair: A Randomized Controlled Trial , 2011, Annals of surgery.

[17]  A. Nishisaki,et al.  Reliability and validity of a scoring instrument for clinical performance during Pediatric Advanced Life Support simulation scenarios. , 2010, Resuscitation.

[18]  Janice Palaganas,et al.  An educational course including medical simulation for early goal-directed therapy and the severe sepsis resuscitation bundle: an evaluation for medical student training. , 2009, Resuscitation.

[19]  J. Feinglass,et al.  Mastery learning of advanced cardiac life support skills by internal medicine residents using simulation technology and deliberate practice , 2006, Journal of General Internal Medicine.