Rating medical emergency teamwork performance: development of the Team Emergency Assessment Measure (TEAM).

AIM To develop a valid, reliable and feasible teamwork assessment measure for emergency resuscitation team performance. BACKGROUND Generic and profession specific team performance assessment measures are available (e.g. anaesthetics) but there are no specific measures for the assessment of emergency resuscitation team performance. METHODS (1) An extensive review of the literature for teamwork instruments, and (2) development of a draft instrument with an expert clinical team. (3) Review by an international team of seven independent experts for face and content validity. (4) Instrument testing on 56 video-recorded hospital and simulated resuscitation events for construct, consistency, concurrent validity and reliability and (5) a final set of ratings for feasibility on fifteen simulated 'real time' events. RESULTS Following expert review, selected items were found to have a high total content validity index of 0.96. A single 'teamwork' construct was identified with an internal consistency of 0.89. Correlation between the total item score and global rating (rho 0.95; p<0.01) indicated concurrent validity. Inter-rater (k 0.55) and retest reliability (k 0.53) were 'fair', with positive feasibility ratings following 'real time' testing. The final 12 item (11 specific and 1 global rating) are rated using a five-point scale and cover three categories leadership, teamwork and task management. CONCLUSION In this primary study TEAM was found to be a valid and reliable instrument and should be a useful addition to clinicians' tool set for the measurement of teamwork during medical emergencies. Further evaluation of the instrument is warranted to fully determine its psychometric properties.

[1]  Ara Darzi,et al.  A Human Factors Analysis of Technical and Team Skills Among Surgical Trainees During Procedural Simulations in a Simulated Operating Theatre , 2005, Annals of surgery.

[2]  R. Flin,et al.  Identifying and training non-technical skills for teams in acute medicine , 2004, Quality and Safety in Health Care.

[3]  S. Siegel,et al.  Nonparametric Statistics for the Behavioral Sciences , 2022, The SAGE Encyclopedia of Research Design.

[4]  Douglas A Wiegmann,et al.  The Mayo High Performance Teamwork Scale: Reliability and Validity for Evaluating Key Crew Resource Management Skills , 2007, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[5]  Simon Cooper,et al.  Collaborative practices in unscheduled emergency care: role and impact of the emergency care practitioner—quantitative findings , 2007, Emergency Medicine Journal.

[6]  Peter Dieckmann,et al.  The art and science of debriefing in simulation: Ideal and practice , 2009, Medical teacher.

[7]  Jo Kramer-Johansen,et al.  Quality of cardiopulmonary resuscitation during out-of-hospital cardiac arrest , 2005 .

[8]  R. Flin,et al.  Non-technical skills for surgeons in the operating room: a review of the literature. , 2006, Surgery.

[9]  R L Helmreich,et al.  Teaching teamwork during the Neonatal Resuscitation Program: a randomized trial , 2007, Journal of Perinatology.

[10]  S. Rodger,et al.  Effective Health Care Teams: A model of six characteristics developed from shared perceptions , 2005, Journal of interprofessional care.

[11]  S. Cooper,et al.  Modelling emergency decisions: recognition-primed decision making. The literature in relation to an ophthalmic critical incident. , 2006, Journal of clinical nursing.

[12]  T. Manser.  Teamwork and patient safety in dynamic domains of healthcare: a review of the literature , 2009, Acta anaesthesiologica Scandinavica.

[13]  Lynne Martin,et al.  Development of the NOTECHS (non-technical skills) system for assessing pilots’ CRM skills , 2018, Human Factors and Aerospace Safety.

[14]  M. New,et al.  Book reviewStatistics for the behavioural sciences: S. Weinberg and K. Goldberg: Cambridge University Press, Cambridge U.K. (1990). xiii + 621 pp. £25.00 , 1994 .

[15]  F. Tschan,et al.  Human factors affect the quality of cardiopulmonary resuscitation in simulated cardiac arrests. , 2004, Resuscitation.

[16]  Mica R. Endsley,et al.  Situation awareness global assessment technique (SAGAT) , 1988, Proceedings of the IEEE 1988 National Aerospace and Electronics Conference.

[17]  R. Flin,et al.  Non-technical skills of the operating theatre scrub nurse: literature review. , 2008, Journal of advanced nursing.

[18]  Paul Clark,et al.  Teamwork: Building Healthier Workplaces and Providing Safer Patient Care , 2009, Critical care nursing quarterly.

[19]  S. Cooper,et al.  Collaborative practices in unscheduled emergency care: role and impact of the emergency care practitioner—qualitative and summative findings , 2007, Emergency Medicine Journal.

[20]  William C. McGaghie,et al.  Simulation-Based Training of Internal Medicine Residents in Advanced Cardiac Life Support Protocols: A Randomized Trial , 2005, Teaching and learning in medicine.

[21]  G. Lighthall,et al.  Evaluating the management of septic shock using patient simulation , 2007, Critical care medicine.

[22]  K Lauche,et al.  Non-technical skills in the intensive care unit. , 2006, British journal of anaesthesia.

[23]  Diane K. Brown,et al.  The Effect of Simulation Learning on Critical Thinking and Self-confidence When Incorporated Into an Electrocardiogram Nursing Course , 2009 .

[24]  M. Devita,et al.  Improving medical emergency team (MET) performance using a novel curriculum and a computerized human patient simulator , 2005, Quality and Safety in Health Care.

[25]  W. Ummenhofer,et al.  Team performance in the emergency room: assessment of inter-disciplinary attitudes. , 2001, Resuscitation.

[26]  R Flin,et al.  Leadership for safety: industrial experience , 2004, Quality and Safety in Health Care.

[27]  P. Steen,et al.  Quality of cardiopulmonary resuscitation during out-of-hospital cardiac arrest. , 2005, JAMA.

[28]  Gavin D Perkins,et al.  Quality of CPR during advanced resuscitation training. , 2008, Resuscitation.

[29]  Andrew Worster,et al.  Advanced statistics: understanding medical record review (MRR) studies. , 2004, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[30]  Gary Klein,et al.  The Power of Intuition: How to Use Your Gut Feelings to Make Better Decisions at Work , 2004 .

[31]  S. Small.  Simulation applications for human factors and systems evaluation. , 2007, Anesthesiology clinics.

[32]  Michelle Chiu,et al.  A pilot study using high-fidelity simulation to formally evaluate performance in the resuscitation of critically ill patients: The University of Ottawa Critical Care Medicine, High-Fidelity Simulation, and Crisis Resource Management I Study , 2006, Critical care medicine.

[33]  M. Janghorbani,et al.  A decade of in-hospital resuscitation: outcomes and prediction of survival? , 2006, Resuscitation.

[34]  K. Cox.  No Oscar for OSCA , 1990, Medical education.

[35]  Rhona Flin,et al.  Surgeons’ Non-technical Skills in the Operating Room: Reliability Testing of the NOTSS Behavior Rating System , 2008, World Journal of Surgery.

[36]  Kenji Hira,et al.  Evaluation of trauma team performance using an advanced human patient simulator for resuscitation training. , 2002, The Journal of trauma.

[37]  R. Flin,et al.  Anaesthetists' Non-Technical Skills (ANTS): evaluation of a behavioural marker system. , 2003, British journal of anaesthesia.

[38]  R. Reznick,et al.  Comparing the psychometric properties of checklists and global rating scales for assessing performance on an OSCE‐format examination , 1998, Academic medicine : journal of the Association of American Medical Colleges.

[39]  S. Cooper,et al.  Leadership of resuscitation teams: "Lighthouse Leadership'. , 1999, Resuscitation.

[40]  Charles C. Manz,et al.  Using Videotape Technology: Innovations in Behavioral Research , 1981 .

[41]  Cheryl Tatano Beck,et al.  The content validity index: are you sure you know what's being reported? Critique and recommendations. , 2006, Research in nursing & health.

[42]  J. Fleiss.  Statistical methods for rates and proportions , 1974 .

[43]  Barbara Senior,et al.  Inside Management Teams: Developing a Teamwork Survey Instrument , 2007 .

[44]  Glenn Regehr,et al.  Evaluating Teamwork in a Simulated Obstetric Environment , 2007 .

[45]  S. Reise,et al.  Factor analysis and scale revision. , 2000, Psychological assessment.