Defining team performance for simulation-based training: methodology, metrics, and opportunities for emergency medicine.

Across health care, teamwork is a critical element for effective patient care. Yet, numerous well-intentioned training programs may fail to achieve the desired outcomes in team performance. Hope for the improvement of teamwork in health care is provided by the success of the aviation and military communities in utilizing simulation-based training (SBT) for training and evaluating teams. This consensus paper 1) proposes a scientifically based methodology for SBT design and evaluation, 2) reviews existing team performance metrics in health care along with recommendations, and 3) focuses on leadership as a target for SBT because it has a high likelihood to improve many team processes and ultimately performance. It is hoped that this discussion will assist those in emergency medicine (EM) and the larger health care field in the design and delivery of SBT for training and evaluating teamwork.

[1]  Donald L. Kirkpatrick,et al.  Evaluating Training Programs : The Four Levels , 2009 .

[2]  E. Salas,et al.  Toward a definition of teamwork in emergency medicine. , 2008, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[3]  Eduardo Salas,et al.  Promoting teamwork: an event-based approach to simulation-based teamwork training for emergency medicine residents. , 2008, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[4]  Eduardo Salas,et al.  Debriefing medical teams: 12 evidence-based best practices and tips. , 2008, Joint Commission journal on quality and patient safety.

[5]  Eduardo Salas,et al.  Simulation-Based Training for Patient Safety: 10 Principles That Matter , 2008 .

[6]  Leo Kobayashi,et al.  Multiple encounter simulation for high-acuity multipatient environment training. , 2007, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[7]  Roxane Gardner,et al.  Using the Communication and Teamwork Skills (CATS) Assessment to measure health care team performance. , 2007, Joint Commission journal on quality and patient safety.

[8]  R Flin,et al.  Teaching surgeons about non-technical skills. , 2007, The surgeon : journal of the Royal Colleges of Surgeons of Edinburgh and Ireland.

[9]  R Flin,et al.  Development of a rating system for surgeons' non‐technical skills , 2006, Medical education.

[10]  R Flin,et al.  Attitudes to teamwork and safety in the operating theatre. , 2006, The surgeon : journal of the Royal Colleges of Surgeons of Edinburgh and Ireland.

[11]  Kevin C. Stagl,et al.  What type of leadership behaviors are functional in teams? A meta-analysis , 2006 .

[12]  R. Flin,et al.  Non-technical skills for surgeons in the operating room: a review of the literature. , 2006, Surgery.

[13]  S. Fagan,et al.  Bridging the communication gap in the operating room with medical team training. , 2005, American journal of surgery.

[14]  Dana E. Sims,et al.  Is there a “Big Five” in Teamwork? , 2005 .

[15]  E. Salas,et al.  MEASURING TEAM PERFORMANCE: REVIEW OF CURRENT METHODS AND CONSIDERATION OF FUTURE NEEDS , 2004 .

[16]  J. Morey,et al.  Simulation based teamwork training for emergency department staff: does it improve clinical team performance when added to an existing didactic teamwork curriculum? , 2004, Quality and Safety in Health Care.

[17]  J. Sexton,et al.  Translating teamwork behaviours from aviation to healthcare: development of behavioural markers for neonatal resuscitation , 2004, Quality and Safety in Health Care.

[18]  S Undre,et al.  Developing observational measures of performance in surgical teams , 2004, Quality and Safety in Health Care.

[19]  R. Flin,et al.  Identifying and training non-technical skills for teams in acute medicine , 2004, Quality and Safety in Health Care.

[20]  C Shawn Burke,et al.  Team Task Analysis , 2004 .

[21]  Gavin C. Barr,et al.  Using Simulation to Instruct Emergency Medicine Residents in Cognitive Forcing Strategies , 2004, Academic medicine : journal of the Association of American Medical Colleges.

[22]  R. Flin,et al.  Anaesthetists' Non-Technical Skills (ANTS): evaluation of a behavioural marker system. , 2003, British journal of anaesthesia.

[23]  D. Gaba,et al.  Emergency medicine crisis resource management (EMCRM): pilot study of a simulation-based crisis management course for emergency medicine. , 2003, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[24]  John C. Morey,et al.  Error reduction and performance improvement in the emergency department through formal teamwork training: evaluation results of the MedTeams project. , 2002, Health services research.

[25]  David P. Sklar,et al.  Human simulation in emergency medicine training: A model curriculum , 2002 .

[26]  Lynne Martin,et al.  Behavioral Markers for Crew Resource Management: A Review of Current Practice , 2001 .

[27]  J. Mathieu,et al.  Performance implications of leader briefings and team-interaction training for team adaptation to novel environments. , 2000, The Journal of applied psychology.

[28]  A. Wall,et al.  Book ReviewTo Err is Human: building a safer health system Kohn L T Corrigan J M Donaldson M S Washington DC USA: Institute of Medicine/National Academy Press ISBN 0 309 06837 1 $34.95 , 2000 .

[29]  S D Berns,et al.  The potential for improved teamwork to reduce medical errors in the emergency department. The MedTeams Research Consortium. , 1999, Annals of emergency medicine.

[30]  T. Clemmer,et al.  Cooperation: The Foundation of Improvement , 1998, Annals of Internal Medicine.

[31]  Eduardo Salas,et al.  Team Performance Assessment and Measurement: Theory, Methods, and Applications. Series in Applied Psychology. , 1997 .

[32]  D. Gaba,et al.  Crisis Management in Anesthesiology , 1993 .

[33]  Barbara G. Kanki,et al.  Cockpit Resource Management , 1993 .

[34]  G E Briggs,et al.  Team versus individual training, training task fidelity, and task organization effects on transfer performance by three-man teams. , 1965, The Journal of applied psychology.

[35]  Eduardo Salas,et al.  A Measurement Tool for Simulation-Based Training in Emergency Medicine: The Simulation Module for Assessment of Resident Targeted Event Responses (SMARTER) Approach , 2008, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[36]  E. Salas,et al.  Measuring team performance in simulation-based training: adopting best practices for healthcare. , 2008, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[37]  Roger L. Kneebone,et al.  Crossing the Line: Simulation and Boundary Areas , 2006, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[38]  David P. Baker,et al.  HOW MILITARY RESEARCH CAN IMPROVE TEAM TRAINING EFFECTIVENESS IN OTHER HIGH-RISK INDUSTRIES , 2003 .

[39]  E. Salas,et al.  The science of training: a decade of progress. , 2001, Annual review of psychology.

[40]  William R. Hendee,et al.  To Err is Human: Building a Safer Health System , 2001 .

[41]  R L Helmreich,et al.  The evolution of Crew Resource Management training in commercial aviation. , 1999, The International journal of aviation psychology.

[42]  G. Young,et al.  Best practices for managing surgical services: the role of coordination. , 1997, Health care management review.

[43]  R L Helmreich,et al.  Outcomes of crew resource management training. , 1991, The International journal of aviation psychology.