Performance Measures for Health Care Teams: A Review

Interest in effective health care teamwork has advanced in recent years. To ensure these teams are performing effectively, valid and reliable measurement is necessary. This review identifies and organizes information about measures of health care team performance by addressing the following objectives: (a) identify existing measures of health care team performance (k = 70), (b) summarize validity evidence (i.e., construct and content validity), (c) summarize reliability information (i.e., interrater/interobserver reliability and internal consistency), (d) summarize information pertaining to the use and implementation of the measures (i.e., generalizability, instrument type, and clarity of language), and (e) identify the teamwork content included in the measures. These findings can aid researchers and practitioners in selecting a measure that is appropriate for a specific context. This review also illuminates areas where future research is needed by identifying types of reliability, validity, and teamwork content that have been largely unaddressed.

[1]  Jennifer E. Moore,et al.  Agency for Healthcare Research and Quality , 2020, Definitions.

[2]  John E. Schaufelberger,et al.  Team development , 2019, Construction Superintendents.

[3]  Gary J. Skolits,et al.  Team Development Measure , 2019 .

[4]  P. Sackett,et al.  Principles for the Validation and Use of Personnel Selection Procedures , 2018, Industrial and Organizational Psychology.

[5]  Shannon L. Marlow,et al.  Saving lives: A meta-analysis of team training in healthcare. , 2016, The Journal of applied psychology.

[6]  S. Wheelan,et al.  Group Development Questionnaire , 2016 .

[7]  M. Pett,et al.  The Development and Validation of the Interprofessional Attitudes Scale: Assessing the Interprofessional Attitudes of Students in the Health Professions , 2015, Academic medicine : journal of the Association of American Medical Colleges.

[8]  M. Fischer,et al.  The Teamwork Assessment Scale: A Novel Instrument to Assess Quality of Undergraduate Medical Students' Teamwork Using the Example of Simulation-based Ward-Rounds , 2015, GMS Zeitschrift fur medizinische Ausbildung.

[9]  Ingrid M. Nembhard,et al.  Measuring Teamwork in Health Care Settings: A Review of Survey Instruments , 2014, Medical care.

[10]  C. MacDonald,et al.  Validation of the interprofessional collaborative competency attainment survey (ICCAS) , 2014, Journal of interprofessional care.

[11]  P. Dieckmann,et al.  Assessing Nurse Anaesthetists' Non‐Technical Skills in the operating room , 2014, Acta anaesthesiologica Scandinavica.

[12]  S. New,et al.  Oxford NOTECHS II: A Modified Theatre Team Non-Technical Skills Scoring System , 2014, PloS one.

[13]  Prafulla N. Dawadi,et al.  Monitoring Everyday Abilities and Cognitive Health Using Pervasive Technologies: Current State and Prospect , 2014 .

[14]  Sally E. Green,et al.  Measuring team factors thought to influence the success of quality improvement in primary care: a systematic review of instruments , 2013, Implementation Science.

[15]  G. King,et al.  Assessment of Interprofessional Team Collaboration Scale (AITCS): Development and Testing of the Instrument , 2012, The Journal of continuing education in the health professions.

[16]  L. Lynn,et al.  A new tool to give hospitalists feedback to improve interprofessional teamwork and advance patient care. , 2012, Health affairs.

[17]  M. Wynia,et al.  Challenges at the intersection of team-based and patient-centered health care: insights from an IOM working group. , 2012, JAMA.

[18]  Sally Okun,et al.  Core Principles & Values of Effective Team-Based Health Care , 2012 .

[19]  N. Sevdalis,et al.  Developing and Testing TEAM (Team Evaluation and Assessment Measure), a Self-assessment Tool to Improve Cancer Multidisciplinary Teamwork , 2012, Annals of Surgical Oncology.

[20]  L. Quan,et al.  The Simulation Team Assessment Tool (STAT): development, reliability and validation. , 2012, Resuscitation.

[21]  David J. Woehr,et al.  Rater training revisited: An updated meta-analytic review of frame-of-reference training , 2012 .

[22]  A. Richardson,et al.  Measuring the quality of MDT working: an observational approach , 2012, BMC Cancer.

[23]  V. Curran,et al.  Development and validation of the interprofessional collaborator assessment rubric ((ICAR)) , 2011, Journal of interprofessional care.

[24]  N. Sevdalis,et al.  Observational Skill-based Clinical Assessment tool for Resuscitation (OSCAR): Development and validation☆ , 2011, Resuscitation.

[25]  C. Vincent,et al.  Teamwork and team performance in multidisciplinary cancer teams: development and evaluation of an observational assessment tool , 2011, Quality and Safety in Health Care.

[26]  M. Paterson,et al.  Development and pilot testing of the collaborative practice assessment tool , 2011, Journal of interprofessional care.

[27]  Alex Pentland,et al.  Sociometric Badges: A New Tool for I.S. Research , 2011 .

[28]  N. Anderson,et al.  Measuring trust in teams: Development and validation of a multifaceted measure of formative and reflective indicators of team trust , 2011 .

[29]  J. Lange,et al.  Discrepant perceptions of communication, teamwork and situation awareness among surgical team members , 2011, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[30]  Boaz Shulruf,et al.  Evaluation of an instrument to measure teamwork in multidisciplinary critical care teams , 2011, Quality and Safety in Health Care.

[31]  Robert M. Guion.  Assessment, measurement, and prediction for personnel decisions, 2nd ed. , 2011 .

[32]  E. Quinlan,et al.  Mutual understanding in multi-disciplinary primary health care teams , 2010, Journal of interprofessional care.

[33]  D. P. Baker,et al.  Assessing teamwork attitudes in healthcare: development of the TeamSTEPPS teamwork attitudes questionnaire , 2010, Quality and Safety in Health Care.

[34]  Timothy T. Baldwin,et al.  Transfer of Training: A Meta-Analytic Review , 2010 .

[35]  P. Bowie,et al.  The development and psychometric evaluation of a safety climate measure for primary care , 2010, Quality and Safety in Health Care.

[36]  Debra Nestel,et al.  Rating medical emergency teamwork performance: development of the Team Emergency Assessment Measure (TEAM). , 2010, Resuscitation.

[37]  S. Reeves,et al.  Validity and reliability of a multiple-group measurement scale for interprofessional collaboration , 2010, BMC health services research.

[38]  Jody Hoffer Gittell,et al.  A Relational Model of How High-Performance Work Systems Work , 2010, Organ. Sci..

[39]  E. Salas,et al.  The Development and Testing of the Nursing Teamwork Survey , 2010, Nursing research.

[40]  Mindy E. Flanagan,et al.  Healthcare Team Vitality Instrument (HTVI): developing a tool assessing healthcare team functioning. , 2010, Journal of Advanced Nursing.

[41]  Gillian King,et al.  The interprofessional socialization and valuing scale: a tool for evaluating the shift toward collaborative care approaches in health care settings. , 2010, Work.

[42]  Frances A. Kennedy,et al.  Evaluating the Quality of Learning-Team Processes in Medical Education: Development and Validation of a New Measure , 2009, Academic medicine : journal of the Association of American Medical Colleges.

[43]  Rei Ushiro.  Nurse–Physician Collaboration Scale: development and psychometric testing , 2009, Journal of advanced nursing.

[44]  P. McCulloch,et al.  The Oxford NOTECHS System: reliability and validity of a tool for measuring teamwork behaviour in the operating theatre , 2009, Quality & Safety in Health Care.

[45]  Alex Pentland,et al.  Wearable sensors for pervasive healthcare management , 2009, 2009 3rd International Conference on Pervasive Computing Technologies for Healthcare.

[46]  T. Manser.  Teamwork and patient safety in dynamic domains of healthcare: a review of the literature , 2009, Acta anaesthesiologica Scandinavica.

[47]  Eduardo Salas,et al.  The wisdom of collectives in organizations: An update of the teamwork competencies. , 2008 .

[48]  Arpana R. Vidyarthi,et al.  Factors Associated with Intern Fatigue , 2008, Journal of General Internal Medicine.

[49]  P. Groenewegen,et al.  Developing and testing an instrument to measure the presence of conditions for successful implementation of quality improvement collaboratives , 2008, BMC health services research.

[50]  S. Jeffcott,et al.  Measuring team performance in healthcare: review of research and implications for patient safety. , 2008, Journal of critical care.

[51]  Tracy A Shepherd,et al.  Measuring the quality of transdisciplinary teams , 2008, Journal of interprofessional care.

[52]  K. Pottie,et al.  Developing a tool to measure contributions to medication-related processes in family practice , 2008, Journal of interprofessional care.

[53]  Ed Zintel,et al.  Resources , 1998, IT Prof..

[54]  Eduardo Salas,et al.  Measuring team performance in simulation-based training: adopting best practices for healthcare. , 2008, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[55]  Roxane Gardner,et al.  Using the Communication and Teamwork Skills (CATS) Assessment to measure health care team performance. , 2007, Joint Commission journal on quality and patient safety.

[56]  G. Lighthall,et al.  Evaluating the management of septic shock using patient simulation , 2007, Critical care medicine.

[57]  Lisbet Meurling,et al.  Target‐focused medical emergency team training using a human patient simulator: effects on behaviour and attitude , 2007, Medical education.

[58]  S P Akerboom,et al.  Assessing system failures in operating rooms and intensive care units , 2007, Quality and Safety in Health Care.

[59]  Kevin C. Stagl,et al.  Fostering team effectiveness in organizations: toward an integrative theoretical framework. , 2007, Nebraska Symposium on Motivation. Nebraska Symposium on Motivation.

[60]  Douglas A Wiegmann,et al.  The Mayo High Performance Teamwork Scale: Reliability and Validity for Evaluating Key Crew Resource Management Skills , 2007, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[61]  Atle Ødegård.  Exploring perceptions of interprofessional collaboration in child mental health care , 2006, International journal of integrated care.

[62]  R Flin,et al.  Development of a rating system for surgeons' non‐technical skills , 2006, Medical education.

[63]  R. Reid,et al.  Validating the Readiness for Interprofessional Learning Scale (RIPLS) in the postgraduate context: are health care professionals ready for IPL? , 2006, Medical education.

[64]  J. Mathieu,et al.  Empowerment and team effectiveness: an empirical test of an integrated model. , 2006, The Journal of applied psychology.

[65]  J. Alexander,et al.  Cross-functional team processes and patient functional improvement. , 2005, Health services research.

[66]  Dana E. Sims,et al.  Is there a “Big Five” in Teamwork? , 2005 .

[67]  D. Hellström,et al.  Team types, perceived efficiency and team climate in Swedish cross-professional teamwork , 2005, Journal of Interprofessional Care.

[68]  S Undre,et al.  Developing observational measures of performance in surgical teams , 2004, Quality and Safety in Health Care.

[69]  Mollie Gilchrist,et al.  Collaborative learning for collaborative working? Initial findings from a longitudinal study of health and social care students. , 2004, Health & social care in the community.

[70]  D. Mukamel,et al.  Measuring Interdisciplinary Team Performance in a Long-Term Care Setting , 2004, Medical care.

[71]  D. Harrison,et al.  Doctors' and nurses' perceptions of interdisciplinary collaboration in the NICU, and the impact of a neonatal nurse practitioner model of practice. , 2004, Journal of clinical nursing.

[72]  Steven E. Stemler.  Practical Assessment, Research, and Evaluation Practical Assessment, Research, and Evaluation A Comparison of Consensus, Consistency, and Measurement A Comparison of Consensus, Consistency, and Measurement Approaches to Estimating Interrater Reliability Approaches to Estimating Interrater Reliabilit , 2022 .

[73]  Director,et al.  Hospital Survey on Patient Safety Culture , 2004 .

[74]  R. Flin,et al.  Anaesthetists' Non-Technical Skills (ANTS): evaluation of a behavioural marker system. , 2003, British journal of anaesthesia.

[75]  J. Herrin,et al.  The influence of hospital culture on rehabilitation team functioning in VA hospitals. , 2002, Journal of rehabilitation research and development.

[76]  L. Millward,et al.  The team survey: a tool for health care team development. , 2001, Journal of advanced nursing.

[77]  William M. K. Trochim,et al.  Research methods knowledge base , 2001 .

[78]  A. Edmondson.  Psychological Safety and Learning Behavior in Work Teams , 1999 .

[79]  Sara A. Brallier,et al.  Development of an Attitudes toward Health Care Teams Scale , 1999, Evaluation & the health professions.

[80]  G. Parsell,et al.  The development of a questionnaire to assess the readiness of health care students for interprofessional learning (RIPLS) , 1999, Medical education.

[81]  Educational Evaluation.  Standards for Educational and Psychological Testing , 1999 .

[82]  N. Anderson,et al.  Measuring climate for work group innovation: development and validation of the team climate inventory , 1998 .

[83]  Jeffrey A. Alexander,et al.  Embedded Intergroup Relations in Interdisciplinary Teams , 1997 .

[84]  Robert M. Guion,et al.  Assessment, Measurement, and Prediction for Personnel Decisions , 1997 .

[85]  R. Mcintyre,et al.  A Conceptual Framework for Teamwork Measurement , 1997 .

[86]  James Dean Brown,et al.  Testing in language programs , 1996 .

[87]  Gregory T. Smith,et al.  Methodological considerations in the refinement of clinical assessment instruments. , 1995 .

[88]  D. Vinokur-Kaplan,et al.  Treatment Teams that Work (and those that don't): An Application of Hackman's Group Effectiveness Model to Interdisciplinary Teams in Psychiatric Hospitals , 1995 .

[89]  S. Haynes,et al.  Content validity in psychological assessment: A functional approach to concepts and methods. , 1995 .

[90]  David J. Woehr,et al.  Rater training for performance appraisal: A quantitative review , 1994 .

[91]  J. Baggs.  Development of an instrument to measure collaboration and satisfaction about care decisions. , 1994, Journal of advanced nursing.

[92]  D. Cicchetti.  Guidelines, Criteria, and Rules of Thumb for Evaluating Normed and Standardized Assessment Instruments in Psychology. , 1994 .

[93]  D. Berwick.  About the Institute for Healthcare Improvement , 1993 .

[94]  J. Pinto,et al.  Antecedents and consequences of project team cross-functional cooperation , 1993 .

[95]  S M Shortell,et al.  Organizational Assessment in Intensive Care Units (ICUs): Construct Development, Reliability, and Validity of the ICU Nurse-Physician Questionnaire , 1991, Medical care.

[96]  M. Appelbaum,et al.  Psychometric methods. , 1989, Annual review of psychology.

[97]  L. James,et al.  Estimating within-group interrater reliability with and without response bias. , 1984 .

[98]  R. Guion,et al.  On Trinitarian doctrines of validity. , 1980 .

[99]  B. Armer,et al.  Attitudes Toward Interdisciplinary Collaboration in Pupil Personnel Services Teams. , 1978 .

[100]  K. Renner.  Must all tests be valid , 1962 .

[101]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[102]  L. Cronbach,et al.  Construct validity in psychological tests. , 1955, Psychological bulletin.