Error reduction and performance improvement in the emergency department through formal teamwork training: evaluation results of the MedTeams project.

OBJECTIVE To evaluate the effectiveness of training and institutionalizing teamwork behaviors, drawn from aviation crew resource management (CRM) programs, on emergency department (ED) staff organized into caregiver teams. STUDY SETTING Nine teaching and community hospital EDs. STUDY DESIGN A prospective multicenter evaluation using a quasi-experimental, untreated control group design with one pretest and two posttests of the Emergency Team Coordination Course (ETCC). The experimental group, comprised of 684 physicians, nurses, and technicians, received the ETCC and implemented formal teamwork structures and processes. Assessments occurred prior to training, and at intervals of four and eight months after training. Three outcome constructs were evaluated: team behavior, ED performance, and attitudes and opinions. Trained observers rated ED staff team behaviors and made observations of clinical errors, a measure of ED performance. Staff and patients in the EDs completed surveys measuring attitudes and opinions. DATA COLLECTION Hospital EDs were the units of analysis for the seven outcome measures. Prior to aggregating data at the hospital level, scale properties of surveys and event-related observations were evaluated at the respondent or case level. PRINCIPAL FINDINGS A statistically significant improvement in quality of team behaviors was shown between the experimental and control groups following training (p = .012). Subjective workload was not affected by the intervention (p = .668). The clinical error rate significantly decreased from 30.9 percent to 4.4 percent in the experimental group (p = .039). In the experimental group, the ED staffs' attitudes toward teamwork increased (p = .047) and staff assessments of institutional support showed a significant increase (p = .040). CONCLUSION Our findings point to the effectiveness of formal teamwork training for improving team behaviors, reducing errors, and improving staff attitudes among the ETCC-trained hospitals.

[1]  Benjamin S. Bloom,et al.  Handbook On Formative and Summative Evaluation of Student Learning , 1971 .

[2]  T. Cook,et al.  Quasi-experimentation: Design & analysis issues for field settings , 1979 .

[3]  I. Ajzen,et al.  Understanding Attitudes and Predicting Social Behavior , 1980 .

[4]  L. Delbeke.  Quasi-experimentation - design and analysis issues for field settings - cook,td, campbell,dt , 1980 .

[5]  M. Herranen,et al.  Understanding teamwork: another look at the concepts. , 1982, Social work in health care.

[6]  K Y Liang,et al.  Longitudinal data analysis for discrete and continuous outcomes. , 1986, Biometrics.

[7]  T Heeren,et al.  Robustness of the two independent samples t-test when applied to ordinal scaled data. , 1987, Statistics in medicine.

[8]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[9]  Robert F. DeVellis,et al.  Scale Development: Theory and Applications. , 1992 .

[10]  Captain H. C. Alger.  Cockpit resource management. , 1989, Aviation, space, and environmental medicine.

[11]  D. Gaba,et al.  Anesthesia crisis resource management training: teaching anesthesiologists to handle critical incidents. , 1992, Aviation, space, and environmental medicine.

[12]  E. Salas,et al.  Toward an understanding of team performance and training. , 1992 .

[13]  Robert L. Helmreich,et al.  Why crew resource management? Empirical and theoretical bases of human factors training in aviation. , 1993 .

[14]  Daryle Gardner-Bonneau,et al.  What is Iatrogenics, and Why Don't Ergonomists Know? , 1993 .

[15]  Robert L. Helmreich,et al.  Team performance in the operating room. , 1994 .

[16]  Dennis K. Leedom,et al.  Improving Team Coordination: A Case for Behavior-Based Training , 1995 .

[17]  R B D'Agostino,et al.  Robustness and power of analysis of covariance applied to data distorted from normality by floor effects: homogeneous regression slopes. , 1996, Statistics in medicine.

[18]  R. Helmreich.  Managing human error in aviation. , 1997, Scientific American.

[19]  Elliot E. Entin,et al.  Team coordination training. , 1998 .

[20]  S D Berns,et al.  The potential for improved teamwork to reduce medical errors in the emergency department. The MedTeams Research Consortium. , 1999, Annals of emergency medicine.

[21]  Eduardo Salas,et al.  Does CRM Training Improve Teamwork Skills in the Cockpit?: Two Evaluation Studies , 1999, Hum. Factors.

[22]  Stephen G. Clyman,et al.  Components of Rater Error in a Complex Performance Assessment , 1999 .

[23]  J. Sexton,et al.  Error, stress, and teamwork in medicine and aviation: cross sectional surveys , 2000, BMJ : British Medical Journal.

[24]  E. Salas,et al.  The science of training: a decade of progress. , 2001, Annual review of psychology.

[25]  Robert L. Mason,et al.  Statistical Principles in Experimental Design , 2003 .

[26]  J. Ware.  SF-36 health survey: Manual and interpretation guide , 2003 .