Team training in obstetrics: A multi-level evaluation.

INTRODUCTION Obstetric complications and adverse patient events are often preventable. Teamwork and situational awareness (SA) can improve detection and coordination of critical obstetric (OB) emergencies, subsequently improving decision making and patient outcomes. The purpose of this study was to assess the effectiveness of a team training intervention in improving learning and transfer of teamwork, SA, decision making, and cognitive bias as well as patient outcomes in OB. METHOD An adapted TeamSTEPPS training program was delivered to OB clinicians. Training targeted communication, mutual support, situation monitoring, leadership, SA, and cognitive bias. We conducted a repeated measures multilevel evaluation of the training using Kirkpatrick's (1994) framework of training evaluation to determine impact on trainee reactions, learning, transfer, and results. Data were collected using surveys, situational judgment tests (SJTs), observations, and patient chart reviews. RESULTS Participants perceived the training as useful. Additionally, participants acquired knowledge of communication strategies, though knowledge of other team competencies did not significantly improve nor did self-reported teamwork on the unit. Although SJT decision accuracy did not significantly improve for all scenarios, results of behavioral observation suggest that decision accuracy significantly improved on the job, and there was a marginally significant reduction in babies' hospital length of stay. DISCUSSION These findings indicate that the training intervention was partially effective, but more work needs to be done to determine the conditions under which training is most effective, and the ways in which to sustain improvements. Future research is needed to confirm its generalizability to additional OB units and departments.

[1]  Michael T. Brannick,et al.  Training teamwork in medicine: An active approach using role play and feedback , 2013 .

[2]  Lily Thomas,et al.  Building a culture of safety through team training and engagement , 2012, BMJ quality & safety.

[3]  Medical device alarm safety in hospitals. , 2013, Sentinel event alert.

[4]  Jason J Zigmont,et al.  An approach to unit-based team training with simulation in a neonatal intensive care unit , 2012 .

[5]  M. Sitterding,et al.  Understanding situation awareness in nursing work: a hybrid concept analysis. , 2012, ANS. Advances in nursing science.

[6]  Maureen G Phipps,et al.  Outcomes from a labor and delivery team training program with simulation component. , 2012, American journal of obstetrics and gynecology.

[7]  A. M. Ruscio,et al.  A meta-analysis of the effect of cognitive bias modification on anxiety and depression. , 2011, Psychological bulletin.

[8]  B. Mol,et al.  Multidisciplinary Team Training in a Simulation Setting for Acute Obstetric Emergencies: A Systematic Review , 2010, Obstetrics and gynecology.

[9]  Pascale Carayon,et al.  Patient safety - the role of human factors and systems engineering. , 2010, Studies in health technology and informatics.

[10]  R. Fox,et al.  Retrospective cohort study of diagnosis–delivery interval with umbilical cord prolapse: the effect of team training , 2009, BJOG : an international journal of obstetrics and gynaecology.

[11]  Donald L. Kirkpatrick,et al.  Evaluating Training Programs : The Four Levels , 2009 .

[12]  D. Freeth,et al.  Multidisciplinary obstetric simulated emergency scenarios (MOSES): Promoting patient safety in obstetrics with teamwork‐focused interprofessional simulations , 2009, The Journal of continuing education in the health professions.

[13]  Eduardo Salas,et al.  Does Team Training Improve Team Performance? A Meta-Analysis , 2008, Hum. Factors.

[14]  D. P. Baker,et al.  Understanding Quality and Safety Problems in the Ambulatory Environment: Seeking Improvement With Promising Teamwork Tools and Strategies , 2008 .

[15]  M. Pearlman Patient Safety in Obstetrics and Gynecology , 2006 .

[16]  B. Melnyk,et al.  Building a CULTURE , 2005 .

[17]  Theodore Speroff,et al.  The impact of aviation-based teamwork training on the attitudes of health-care professionals. , 2004, Journal of the American College of Surgeons.

[18]  J. Bailit,et al.  The Effect of House Staff Working Hours on the Quality of Obstetric and Gynecologic Care , 2004, Obstetrics and gynecology.

[19]  John Sweller,et al.  Cognitive Load Theory: Instructional Implications of the Interaction between Information Structures and Cognitive Architecture , 2004 .

[20]  E. Patterson,et al.  Understanding the Complexity of Registered Nurse Work in Acute Care Settings , 2003, The Journal of nursing administration.

[21]  P. Croskerry The Importance of Cognitive Errors in Diagnosis and Strategies to Minimize Them , 2003, Academic medicine : journal of the Association of American Medical Colleges.

[22]  Mica R. Endsley,et al.  Understanding Situation Awareness In System Design , 2003 .

[23]  Winston Bennett,et al.  Effectiveness of training in organizations: a meta-analysis of design and evaluation features. , 2003, The Journal of applied psychology.

[24]  J Bryan Sexton,et al.  Discrepant attitudes about teamwork among critical care nurses and physicians* , 2003, Critical care medicine.

[25]  John C. Morey,et al.  Error reduction and performance improvement in the emergency department through formal teamwork training: evaluation results of the MedTeams project. , 2002, Health services research.

[26]  S. Donaldson,et al.  Understanding Self-Report Bias in Organizational Behavior Research , 2002 .

[27]  P. Croskerry Achieving quality in clinical decision making: cognitive strategies and detection of bias. , 2002, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[28]  G Bordage,et al.  Why did I miss the diagnosis? Some cognitive explanations and educational implications. , 1999, Academic medicine : journal of the Association of American Medical Colleges.

[29]  A S Elstein,et al.  Heuristics and biases: selected errors in clinical reasoning. , 1999, Academic medicine : journal of the Association of American Medical Colleges.

[30]  Winston Bennett,et al.  Factors That Influence Skill Decay and Retention: A Quantitative Review and Analysis , 1998 .

[31]  David M. Gaba,et al.  Situation Awareness in Anesthesiology , 1995, Hum. Factors.

[32]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[33]  D. Redelmeier,et al.  Medical decision making in situations that offer multiple alternatives. , 1995, JAMA.

[34]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[35]  Daniel G Bobrow,et al.  On data-limited and resource-limited processes , 1975, Cognitive Psychology.

[36]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.