Impact of Just-in-Time and Just-in-Place Simulation on Intern Success With Infant Lumbar Puncture

BACKGROUND AND OBJECTIVE: Simulation-based skill trainings are common; however, optimal instructional designs that improve outcomes are not well specified. We explored the impact of just-in-time and just-in-place training (JIPT) on interns’ infant lumbar puncture (LP) success. METHODS: This prospective study enrolled pediatric and emergency medicine interns from 2009 to 2012 at 34 centers. Two distinct instructional design strategies were compared. Cohort A (2009–2010) completed simulation-based training at commencement of internship, receiving individually coached practice on the LP simulator until achieving a predefined mastery performance standard. Cohort B (2010–2012) had the same training plus JIPT sessions immediately before their first clinical LP. Main outcome was LP success, defined as obtaining fluid with first needle insertion and <1000 red blood cells per high-power field. Process measures included use of analgesia, early stylet removal, and overall attempts. RESULTS: A total of 436 first infant LPs were analyzed. The LP success rate in cohort A was 35% (13/37), compared with 38% (152/399) in cohort B (95% confidence interval for difference [CI diff], −15% to +18%). Cohort B exhibited greater analgesia use (68% vs 19%; 95% CI diff, 33% to 59%), early stylet removal (69% vs 54%; 95% CI diff, 0% to 32%), and lower mean number of attempts (1.4 ± 0.6 vs 2.1 ± 1.6, P < .01) compared with cohort A. CONCLUSIONS: Across multiple institutions, intern success rates with infant LP are poor. Despite improving process measures, adding JIPT to training bundles did not improve success rate. More research is needed on optimal instructional design strategies for infant LP.

[1]  K. Roberts,et al.  "Rolling Refreshers": a novel approach to maintain CPR psychomotor skill competence. , 2009, Resuscitation.

[2]  M. Blum,et al.  Bronchoscopy simulator effectively prepares junior residents to competently perform basic clinical bronchoscopy. , 2004, The Annals of thoracic surgery.

[3]  A. Klotsas,et al.  Procedural confidence in hospital based practitioners: implications for the training and practice of doctors at all grades. , 2009 .

[4]  J. Barsuk,et al.  Simulation-based education with mastery learning improves residents' lumbar puncture skills , 2012, Neurology.

[5]  William C. McGaghie,et al.  Simulation‐based mastery learning reduces complications during central venous catheter insertion in a medical intensive care unit * , 2009, Critical care medicine.

[6]  James M. Gerard,et al.  Are Pediatric Interns Prepared to Perform Infant Lumbar Punctures?: A Multi-Institutional Descriptive Study , 2013, Pediatric emergency care.

[7]  V. Nadkarni,et al.  Central Venous Catheter Dress Rehearsals: Translating Simulation Training to Patient Care and Outcomes , 2013, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[8]  Dionne A. Graham,et al.  Reforming Procedural Skills Training for Pediatric Residents: A Randomized, Interventional Trial , 2009, Pediatrics.

[9]  A. Burden,et al.  Simulation-Based Education Improves Quality of Care During Cardiac Arrest Team Responses at an Academic Teaching Hospital: A Case-Control Study , 2009 .

[10]  Jason H. Szostek,et al.  Comparative effectiveness of instructional design features in simulation-based education: Systematic review and meta-analysis , 2013, Medical teacher.

[11]  M. Neuman,et al.  Risk factors for traumatic or unsuccessful lumbar punctures in children. , 2007, Annals of emergency medicine.

[12]  H. Pashler,et al.  Distributed practice in verbal recall tasks: A review and quantitative synthesis. , 2006, Psychological bulletin.

[13]  J. Barsuk,et al.  Does Simulation-Based Medical Education With Deliberate Practice Yield Better Results Than Traditional Clinical Education? A Meta-Analytic Comparative Review of the Evidence , 2011, Academic medicine : journal of the Association of American Medical Colleges.

[14]  W. McGaghie,et al.  Use of simulation-based medical education to improve patient care quality. , 2010, Resuscitation.

[15]  Paul G Gauger,et al.  Laparoscopic Skills Are Improved With LapMentor™ Training: Results of a Randomized, Double-Blinded Study , 2006, Annals of surgery.

[16]  Roslyn F Schneider,et al.  Achieving house staff competence in emergency airway management: Results of a teaching program using a computerized patient simulator* , 2004, Critical care medicine.

[17]  G. Alliger,et al.  KIRKPATRICK'S LEVELS OF TRAINING CRITERIA: THIRTY YEARS LATER , 1989 .

[18]  E. Ewert.  Incidence of Traumatic Lumbar Puncture: Experience of a Large, Tertiary Care Pediatric Hospital , 2012 .

[19]  D. Isaacman,et al.  Pain, Position, and Stylet Styles: Infant Lumbar Puncture Practices of Pediatric Emergency Attending Physicians , 2004, Pediatric emergency care.

[20]  James M. Gerard,et al.  Can Residents Assess Other Providers' Infant Lumbar Puncture Skills?: Validity Evidence for a Global Rating Scale and Subcomponent Skills Checklist , 2016, Pediatric emergency care.

[21]  Effect of Just-in-time Simulation Training on Tracheal Intubation Procedure Safety in the Pediatric Intensive Care Unit , 2011 .

[22]  Pavan Zaveri,et al.  A Comprehensive Infant Lumber Puncture Novice Procedural Skills Training Package: An INSPIRE Simulation-Based Procedural Skills Training Package , 2014 .

[23]  M. Auerbach,et al.  Qualitative Evaluation of Just-in-Time Simulation-Based Learning: The Learners’ Perspective , 2013, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[24]  Ross J. Scalese,et al.  Simulation Technology for Skills Training and Competency Assessment in Medical Education , 2007, Journal of General Internal Medicine.

[25]  H. Pashler,et al.  Increasing Retention Without Increasing Study Time , 2007 .

[26]  William C McGaghie,et al.  Medical Education Research As Translational Science , 2010, Science Translational Medicine.

[27]  V. Nadkarni,et al.  Effect of Just-in-time Simulation Training on Tracheal Intubation Procedure Safety in the Pediatric Intensive Care Unit , 2010, Anesthesiology.

[28]  M. Auerbach,et al.  Infant Lumbar Puncture: POISE Pediatric Procedure Video , 2011 .

[29]  R. Lammers,et al.  Competence of new emergency medicine residents in the performance of lumbar punctures. , 2005, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[30]  Kenneth H. Blanchard,et al.  Great ideas revisited , 1996 .

[31]  A. Ziv,et al.  Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review , 2005, Medical teacher.

[32]  Daniel J Langsam,et al.  An Educational Video Improves Technique in Performance of Pediatric Lumbar Punctures , 2012, Pediatric emergency care.

[33]  James M. Gerard,et al.  Validation of Global Rating Scale and Checklist Instruments for the Infant Lumbar Puncture Procedure , 2013, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[34]  M. Ellenby,et al.  Videos in clinical medicine. Lumbar puncture. , 2006, The New England journal of medicine.

[35]  N. Tofil,et al.  Transfer of Simulated Lumbar Puncture Training to the Clinical Setting , 2012, Pediatric emergency care.

[36]  Daniel M. Fein,et al.  Interns' Success With Clinical Procedures in Infants After Simulation Training , 2013, Pediatrics.

[37]  Donovan A. McFarlane,et al.  Evaluating Training Programs: The Four Levels , 2006 .

[38]  D. Isaacman,et al.  Local Anesthetic and Stylet Styles: Factors Associated With Resident Lumbar Puncture Success , 2006, Pediatrics.

[39]  Scott Snook,et al.  Children's Hospital Boston (A) , 2010 .

[40]  T. Hansen.  [Children's hospital of Pittsburgh]. , 1995, Tidsskrift for den Norske laegeforening : tidsskrift for praktisk medicin, ny raekke.

[41]  Pamela Andreatta,et al.  Simulation-based mock codes significantly correlate with improved pediatric patient cardiopulmonary arrest survival rates* , 2011, Pediatric critical care medicine : a journal of the Society of Critical Care Medicine and the World Federation of Pediatric Intensive and Critical Care Societies.

[42]  Vinay Nadkarni,et al.  Low-Dose, High-Frequency CPR Training Improves Skill Retention of In-Hospital Pediatric Providers , 2011, Pediatrics.

[43]  Dorene Balmer,et al.  The greater good: how supervising physicians make entrustment decisions in the pediatric emergency department. , 2014, Academic pediatrics.

[44]  M. Thomson,et al.  Acquisition of Competence in Paediatric Ileocolonoscopy With Virtual Endoscopy Training , 2006, Journal of pediatric gastroenterology and nutrition.

[45]  David O. Kessler,et al.  A Randomized Trial of Simulation-Based Deliberate Practice for Infant Lumbar Puncture Skills , 2011, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[46]  V. Nadkarni,et al.  Effect of Just-intime Simulation Training on Tracheal Intubation Procedure Safety in the Pediatric Intensive Care Unit , 2010 .

[47]  M. Adler,et al.  Pediatric Residents' Ability to Perform a Lumbar Puncture: Evaluation of an Educational Intervention , 2010, Pediatric emergency care.

[48]  J. Barsuk,et al.  Simulation-based education improves quality of care during cardiac arrest team responses at an academic teaching hospital: a case-control study. , 2008, Chest.

[49]  Donald L. Kirkpatrick,et al.  Great Ideas Revisited. Techniques for Evaluating Training Programs. Revisiting Kirkpatrick's Four-Level Model. , 1996 .