Examining pediatric resuscitation education using simulation and scripted debriefing: a multicenter randomized trial.

IMPORTANCE Resuscitation training programs use simulation and debriefing as an educational modality with limited standardization of debriefing format and content. Our study attempted to address this issue by using a debriefing script to standardize debriefings. OBJECTIVE To determine whether use of a scripted debriefing by novice instructors and/or simulator physical realism affects knowledge and performance in simulated cardiopulmonary arrests. DESIGN Prospective, randomized, factorial study design. SETTING The study was conducted from 2008 to 2011 at 14 Examining Pediatric Resuscitation Education Using Simulation and Scripted Debriefing (EXPRESS) network simulation programs. Interprofessional health care teams participated in 2 simulated cardiopulmonary arrests, before and after debriefing. PARTICIPANTS We randomized 97 participants (23 teams) to nonscripted low-realism; 93 participants (22 teams) to scripted low-realism; 103 participants (23 teams) to nonscripted high-realism; and 94 participants (22 teams) to scripted high-realism groups. INTERVENTION Participants were randomized to 1 of 4 arms: permutations of scripted vs nonscripted debriefing and high-realism vs low-realism simulators. MAIN OUTCOMES AND MEASURES Percentage difference (0%-100%) in multiple choice question (MCQ) test (individual scores), Behavioral Assessment Tool (BAT) (team leader performance), and the Clinical Performance Tool (CPT) (team performance) scores postintervention vs preintervention comparison (PPC). RESULTS There was no significant difference at baseline in nonscripted vs scripted groups for MCQ (P = .87), BAT (P = .99), and CPT (P = .95) scores. Scripted debriefing showed greater improvement in knowledge (mean [95% CI] MCQ-PPC, 5.3% [4.1%-6.5%] vs 3.6% [2.3%-4.7%]; P = .04) and team leader behavioral performance (median [interquartile range (IQR)] BAT-PPC, 16% [7.4%-28.5%] vs 8% [0.2%-31.6%]; P = .03). Their improvement in clinical performance during simulated cardiopulmonary arrests was not significantly different (median [IQR] CPT-PPC, 7.9% [4.8%-15.1%] vs 6.7% [2.8%-12.7%], P = .18). Level of physical realism of the simulator had no independent effect on these outcomes. CONCLUSIONS AND RELEVANCE The use of a standardized script by novice instructors to facilitate team debriefings improves acquisition of knowledge and team leader behavioral performance during subsequent simulated cardiopulmonary arrests. Implementation of debriefing scripts in resuscitation courses may help to improve learning outcomes and standardize delivery of debriefing, particularly for novice instructors.

[1]  Jonathan R Studnek,et al.  The association between emergency medical services field performance assessed by high-fidelity simulation and the cognitive knowledge of practicing paramedics. , 2011, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[2]  Vinay Nadkarni,et al.  A Multifunctional Online Research Portal for Facilitation of Simulation-Based Research: A Report From the EXPRESS Pediatric Simulation Research Collaborative , 2011, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[3]  V. Nadkarni,et al.  Research Regarding Debriefing as Part of the Learning Process , 2011, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[4]  Akira Nishisaki,et al.  Design, Implementation, and Psychometric Analysis of a Scoring Instrument for Simulated Pediatric Resuscitation: A Report from the EXPRESS Pediatric Investigators , 2011, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[5]  Sonya L Ranson,et al.  Teamwork training improves the clinical care of trauma patients. , 2010, Journal of surgical education.

[6]  N. Finer,et al.  Neonatal resuscitation for the preterm infant: evidence versus practice , 2010, Journal of Perinatology.

[7]  V. Nadkarni,et al.  Effect of Just-in-time Simulation Training on Tracheal Intubation Procedure Safety in the Pediatric Intensive Care Unit , 2010, Anesthesiology.

[8]  A. Nishisaki,et al.  Reliability and validity of a scoring instrument for clinical performance during Pediatric Advanced Life Support simulation scenarios. , 2010, Resuscitation.

[9]  V. Nadkarni,et al.  Perception of Realism During Mock Resuscitations by Pediatric Housestaff: The Impact of Simulated Physical Features , 2010, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[10]  P. Pronovost,et al.  Clinical review: Checklists - translating evidence into practice , 2009, Critical care.

[11]  W. McGaghie,et al.  Development and Evaluation of a Simulation-Based Pediatric Emergency Medicine Curriculum , 2009, Academic medicine : journal of the Association of American Medical Colleges.

[12]  K. T. Fong,et al.  Surgical team behaviors and patient outcomes. , 2009, American journal of surgery.

[13]  V. Nadkarni,et al.  Effect of High-Fidelity Simulation on Pediatric Advanced Life Support Training in Pediatric House Staff: A Randomized Trial , 2009, Pediatric emergency care.

[14]  Mindi Anderson,et al.  Alternative Educational Models for Interdisciplinary Student Teams , 2009, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[15]  Peter Dieckmann,et al.  The art and science of debriefing in simulation: Ideal and practice , 2009, Medical teacher.

[16]  A. Burden,et al.  Simulation-Based Education Improves Quality of Care During Cardiac Arrest Team Responses at an Academic Teaching Hospital: A Case-Control Study , 2009 .

[17]  E. Hunt,et al.  Resuscitation education: narrowing the gap between evidence-based resuscitation guidelines and performance using best educational practices. , 2008, Pediatric clinics of North America.

[18]  Elizabeth A Hunt,et al.  Team training: implications for emergency and critical care pediatrics , 2008, Current opinion in pediatrics.

[19]  Benjamin S Abella,et al.  Improving in-hospital cardiac arrest process and outcomes with performance debriefing. , 2008, Archives of internal medicine.

[20]  E. Hunt,et al.  The Use of Cognitive Aids During Simulated Pediatric Cardiopulmonary Arrests , 2008, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[21]  Elizabeth A. Hunt,et al.  Simulation of In-Hospital Pediatric Medical Emergencies and Cardiopulmonary Arrests: Highlighting the Importance of the First 5 Minutes , 2008, Pediatrics.

[22]  J. Barsuk,et al.  Simulation-based education improves quality of care during cardiac arrest team responses at an academic teaching hospital: a case-control study. , 2008, Chest.

[23]  E. Hunt,et al.  Simulated Pediatric Trauma Team Management: Assessment of an Educational Intervention , 2007, Pediatric emergency care.

[24]  Robert Simon,et al.  Which Reality Matters? Questions on the Path to High Engagement in Healthcare Simulation , 2007, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[25]  J. Leflore,et al.  Comparison of Self-Directed Learning Versus Instructor-Modeled Learning During a Simulated Clinical Experience , 2007, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[26]  Adam Cheng,et al.  Simulation in paediatrics: An educational revolution. , 2007, Paediatrics & child health.

[27]  David M. Gaba,et al.  The Role of Debriefing in Simulation-Based Learning , 2007, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[28]  Peter E. Rivard,et al.  Debriefing with good judgment: combining rigorous feedback with genuine inquiry. , 2007, Anesthesiology clinics.

[29]  Lisbet Meurling,et al.  Target‐focused medical emergency team training using a human patient simulator: effects on behaviour and attitude , 2007, Medical education.

[30]  Peter Dieckmann,et al.  Deepening the Theoretical Foundations of Patient Simulation as Social Practice , 2007, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[31]  Harry Owen,et al.  Comparison of three simulation-based training methods for management of medical emergencies. , 2006, Resuscitation.

[32]  Jo Kramer-Johansen,et al.  Effects of compression depth and pre-shock pauses predict defibrillation failure during cardiac arrest. , 2006, Resuscitation.

[33]  T. K. Harrison,et al.  Use of Cognitive Aids in a Simulated Anesthetic Crisis , 2006, Anesthesia and analgesia.

[34]  P. Pronovost,et al.  The checklist--a tool for error management and performance improvement. , 2006, Journal of critical care.

[35]  Roger Chow,et al.  Value of Debriefing during Simulated Crisis Management: Oral versus Video-assisted Oral Feedback , 2006, Anesthesiology.

[36]  William C McGaghie,et al.  Emergency and critical care pediatrics: use of medical simulation for training in acute pediatric emergencies , 2006, Current opinion in pediatrics.

[37]  E. Hunt,et al.  Simulation of Pediatric Trauma Stabilization in 35 North Carolina Emergency Departments: Identification of Targets for Performance Improvement , 2006, Pediatrics.

[38]  J. Feinglass,et al.  Mastery learning of advanced cardiac life support skills by internal medicine residents using simulation technology and deliberate practice , 2006, Journal of General Internal Medicine.

[39]  Daniel B. Raemer,et al.  There's No Such Thing as “Nonjudgmental” Debriefing: A Theory and Method for Debriefing with Good Judgment , 2006, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[40]  William C. McGaghie,et al.  Simulation-Based Training of Internal Medicine Residents in Advanced Cardiac Life Support Protocols: A Randomized Trial , 2005, Teaching and learning in medicine.

[41]  A. Ziv,et al.  Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review , 2005, Medical teacher.

[42]  John C. Morey,et al.  Simulation based teamwork training for emergency department staff: does it improve clinical team performance when added to an existing didactic teamwork curriculum? , 2004, Quality and Safety in Health Care.

[43]  R M Harden,et al.  Adoption and integration of simulation‐based learning technologies into the curriculum of a UK Undergraduate Education Programme , 2003, Medical education.

[44]  D. Gaba,et al.  Trauma assessment training with a patient simulator: a prospective, randomized study. , 2003, The Journal of trauma.

[45]  John C. Morey,et al.  Error reduction and performance improvement in the emergency department through formal teamwork training: evaluation results of the MedTeams project. , 2002, Health services research.

[46]  Kenji Hira,et al.  Evaluation of trauma team performance using an advanced human patient simulator for resuscitation training. , 2002, The Journal of trauma.

[47]  T. Krummel,et al.  Use of a human patient simulator in the development of resident trauma management skills. , 2001, The Journal of trauma.

[48]  Charles F. Petranek Written Debriefing: The Next Vital Step in Learning with Simulations , 2000 .

[49]  W. McGaghie,et al.  Simulation technology for health care professional skills training and assessment. , 1999, JAMA.

[50]  G. Setnik,et al.  Demonstration of high-fidelity simulation team training for emergency medicine. , 1999, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[51]  Charles F. Petranek A Maturation in Experiential Learning: Principles of Simulation and Gaming , 1994 .