Objective measures of workload in healthcare: a narrative review.

PURPOSE Workload is a critical concept in the evaluation of performance and quality in healthcare systems, but its definition relies on the perspective (e.g. individual clinician-level vs unit-level workload) and type of available metrics (e.g. objective vs subjective measures). The purpose of this paper is to provide an overview of objective measures of workload associated with direct care delivery in tertiary healthcare settings, with a focus on measures that can be obtained from electronic records to inform operationalization of workload measurement. DESIGN/METHODOLOGY/APPROACH Relevant papers published between January 2008 and July 2018 were identified through a search in Pubmed and Compendex databases using the Sample, Phenomenon of Interest, Design, Evaluation, Research Type framework. Identified measures were classified into four levels of workload: task, patient, clinician and unit. FINDINGS Of 30 papers reviewed, 9 used task-level metrics, 14 used patient-level metrics, 7 used clinician-level metrics and 20 used unit-level metrics. Key objective measures of workload include: patient turnover (n=9), volume of patients (n=6), acuity (n=6), nurse-to-patient ratios (n=5) and direct care time (n=5). Several methods for operationalization of these metrics into measurement tools were identified. ORIGINALITY/VALUE This review highlights the key objective workload measures available in electronic records that can be utilized to develop an operational approach for quantifying workload. Insights gained from this review can inform the design of processes to track workload and mitigate the effects of increased workload on patient outcomes and clinician performance.

[1]  Michael O'Sullivan,et al.  Physician rostering for workload balance , 2019, Operations Research for Health Care.

[2]  David B. Kaber,et al.  The Underpinnings of Workload in Unmanned Vehicle Systems , 2018, IEEE Transactions on Human-Machine Systems.

[3]  Clemens Scott Kruse,et al.  The use of Electronic Health Records to Support Population Health: A Systematic Review of the Literature , 2018, Journal of Medical Systems.

[4]  Raj M. Ratwani,et al.  Task2Heart: Exploring Heart Rate Differences with Time-Motion Workflow Observations of Emergency Medicine Physicians , 2018, Journal of Medical Systems.

[5]  Xiaolan Xie,et al.  Physician Staffing for Emergency Departments with Time-Varying Demand , 2018, INFORMS J. Comput..

[6]  Bellal Joseph,et al.  Traumatic Brain Injury , 2018 .

[7]  G. Schneider,et al.  The validity of linear and non-linear heart rate metrics as workload indicators of emergency physicians , 2017, PloS one.

[8]  Elizabeth Manias,et al.  The impact of interruptions on medication errors in hospitals: an observational study of nurses , 2017, Journal of nursing management.

[9]  Clarita Terra Rodrigues Serafim,et al.  Severity and workload related to adverse events in the ICU. , 2017, Revista brasileira de enfermagem.

[10]  Walter Sermeus,et al.  Post-operative mortality, missed care and nurse staffing in nine countries: A cross-sectional study , 2017, International journal of nursing studies.

[11]  Bevin Cohen,et al.  Assessing Intensity of Nursing Care Needs Using Electronically Available Data , 2017, Computers, informatics, nursing : CIN.

[12]  Maria E. Mayorga,et al.  Simulating triage of patients into an internal medicine department to validate the use of an optimization-based workload score , 2016, 2017 Winter Simulation Conference (WSC).

[13]  Eduardo Perez,et al.  The impact of system factors on patient perceptions of quality of care , 2016, 2016 Winter Simulation Conference (WSC).

[14]  Fei Yu,et al.  Toward a better understanding of task demands, workload, and performance during physician-computer interactions , 2016, J. Am. Medical Informatics Assoc..

[15]  H. V. van Stel,et al.  Balancing nurses' workload in hospital wards: study protocol of developing a method to manage workload , 2016, BMJ Open.

[16]  F. Carrara,et al.  Outcomes and nursing workload related to obese patients in the intensive care unit. , 2016, Intensive & critical care nursing.

[17]  Stephane Heritier,et al.  Effect of affordable technology on physical activity levels and mobility outcomes in rehabilitation: a protocol for the Activity and MObility UsiNg Technology (AMOUNT) rehabilitation trial , 2016, BMJ Open.

[18]  S. Pastores,et al.  Survey of Annual Staffing Workloads for Adult Critical Care Physicians Working in the United States. , 2016, Annals of the American Thoracic Society.

[19]  D. Vance,et al.  Nursing workload in the acute-care setting: A concept analysis of nursing workload. , 2016, Nursing outlook.

[20]  M. Alghamdi,et al.  Nursing workload: a concept analysis. , 2016, Journal of nursing management.

[21]  Kanjana Thongsanit,et al.  Nurse’s Shift Balancing in Nurse Scheduling Problem , 2016 .

[22]  E. Maniple,et al.  Making the transition to workload-based staffing: using the Workload Indicators of Staffing Need method in Uganda , 2015, Human Resources for Health.

[23]  T. Rimmele,et al.  Patient Mortality Is Associated With Staff Resources and Workload in the ICU: A Multicenter Observational Study* , 2015, Critical care medicine.

[24]  Avishai Mandelbaum,et al.  ON PATIENT FLOW IN HOSPITALS: A DATA-BASED QUEUEING-SCIENCE PERSPECTIVE , 2015 .

[25]  Elsie Kiguli-Malwadde,et al.  Transforming health professions’ education through in-country collaboration: examining the consortia among African medical schools catalyzed by the Medical Education Partnership Initiative , 2015, Human Resources for Health.

[26]  C. Chew‐Graham,et al.  PICO, PICOS and SPIDER: a comparison study of specificity and sensitivity in three search tools for qualitative systematic reviews , 2014, BMC Health Services Research.

[27]  T. Matsuo,et al.  Nursing Activities Score and workload in the intensive care unit of a university hospital , 2014, Revista Brasileira de terapia intensiva.

[28]  E. Fieldston,et al.  Front-line ordering clinicians: matching workforce to workload. , 2014, Journal of hospital medicine.

[29]  Maura Galletta,et al.  Burnout and Workload Among Health Care Workers: The Moderating Role of Job Control , 2014, Safety and health at work.

[30]  Hester Vermeulen,et al.  Developing and Testing a Computerized Decision Support System for Nurse-to-Patient Assignment: A Multimethod Study , 2014, Computers, informatics, nursing : CIN.

[31]  Gilbert Abotisem Abiiro,et al.  Developing attributes and attribute-levels for a discrete choice experiment on micro health insurance in rural Malawi , 2014, BMC Health Services Research.

[32]  Paul Kolm,et al.  Effect of hospitalist workload on the quality and efficiency of care. , 2014, JAMA internal medicine.

[33]  Margarete Sandelowski,et al.  Turning over patient turnover: an ethnographic study of admissions, discharges, and transfers. , 2013, Research in nursing & health.

[34]  B. Frey,et al.  Measurement of resident workload in paediatric intensive care. , 2013, Swiss medical weekly.

[35]  K. Klauer Innovative staffing in emergency departments: the role of midlevel providers. , 2013, CJEM.

[36]  G. Verleden,et al.  Perspectives using probe-based confocal laser endomicroscopy of the respiratory tract. , 2013, Swiss medical weekly.

[37]  Shu-Ching Chi,et al.  Exploring the Association Between Nurse Workload and Nurse-Sensitive Patient Safety Outcome Indicators , 2012, The journal of nursing research : JNR.

[38]  Andrew Booth,et al.  Beyond PICO , 2012, Qualitative health research.

[39]  F. Colardyn,et al.  Measuring the nursing workload per shift in the ICU , 2012, Intensive Care Medicine.

[40]  J. Helton,et al.  Impact of Electronic Health Records on Nurses’ Productivity , 2012, Computers, informatics, nursing : CIN.

[41]  R. Riessen,et al.  Does doctors’ workload impact supervision and ward activities of final-year students? A prospective study , 2012, BMC medical education.

[42]  Ann Van Hecke,et al.  Determining a set of measurable and relevant factors affecting nursing workload in the acute care hospital setting: a cross-sectional study. , 2012, International journal of nursing studies.

[43]  I. Haq,et al.  Mobile Medical Education (MoMEd) - how mobile information resources contribute to learning for undergraduate clinical students - a mixed methods study , 2012, BMC Medical Education.

[44]  Alcione Miranda dos Santos,et al.  Carga de trabalho de profissionais da saúde e eventos adversos durante ventilação mecânica em unidades de terapia intensiva neonatal , 2011 .

[45]  K. Hurst Are temporary ward staff cost effective? , 2011, Nursing times.

[46]  S. Kuys,et al.  Trial of an allied health workload allocation model. , 2011, Australian health review : a publication of the Australian Hospital Association.

[47]  James M. Walker,et al.  Measuring workload of ICU nurses with a questionnaire survey: the NASA Task Load Index (TLX) , 2011, IIE transactions on healthcare systems engineering.

[48]  T. Proctor,et al.  Measuring quality: how to empower staff to take control. , 2011, Nursing times.

[49]  B. Karsh,et al.  A human factors framework and study of the effect of nursing workload on patient safety and employee quality of working life , 2011, Quality and Safety in Health Care.

[50]  Deborah F. Buckley-Behan,et al.  Simulation and patient assignment: unearthing patterns. , 2010, Nursing management.

[51]  Dimitrios Stefanidis,et al.  Higher Mental Workload is Associated With Poorer Laparoscopic Performance as Measured by the NASA-TLX Tool , 2010, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[52]  D. Aronsky,et al.  Factors affecting stress in emergency medicine residents while working in the ED. , 2010, The American journal of emergency medicine.

[53]  James Lind,et al.  Emergency care workload units: A novel tool to compare emergency department activity , 2010, Emergency medicine Australasia : EMA.

[54]  Marianne Baernholdt,et al.  Using Clinical Data to Capture Nurse Workload: Implications for Staffing and Safety , 2010, Computers, informatics, nursing : CIN.

[55]  Jack Needleman,et al.  Transforming Care at the Bedside , 2010 .

[56]  Nick Sevdalis,et al.  The Imperial Stress Assessment Tool (ISAT): A Feasible, Reliable and Valid Approach to Measuring Stress in the Operating Room , 2010, World Journal of Surgery.

[57]  Edna Boone EMR usability: bridging the gap between nurse and computer. , 2010, Nursing management.

[58]  Michael Bukchin,et al.  Does daily nurse staffing match ward workload variability? Three hospitals' experiences. , 2009, International journal of health care quality assurance.

[59]  Caitlin W Brennan,et al.  Patient acuity: a concept analysis. , 2009, Journal of advanced nursing.

[60]  Christian Terwiesch,et al.  The Impact of Work Load on Service Time and Patient Safety: An Econometric Analysis of Hospital Operations , 2009, Manag. Sci..

[61]  Keith Hurst,et al.  UK ward design: patient dependency, nursing workload, staffing and quality-an observational study. , 2008, International journal of nursing studies.

[62]  Peter Haug,et al.  Hospital Workload and Adverse Events , 2007, Medical care.

[63]  Abbey Hyde,et al.  Reconsidering the conceptualization of nursing workload: literature review. , 2007, Journal of advanced nursing.

[64]  V. Upenieks,et al.  Assessing Nursing Staffing Ratios , 2007, Policy, Politics & Nursing Practice.

[65]  B. Karsh,et al.  A human factors engineering paradigm for patient safety: designing to support the performance of the healthcare professional , 2006, Quality and Safety in Health Care.

[66]  Dominik Aronsky,et al.  Tracking Workload in the Emergency Department , 2006, Hum. Factors.

[67]  M. Fottler,et al.  Patient turnover and nursing staff adequacy. , 2006, Health services research.

[68]  Pascale Carayon,et al.  A human factors engineering conceptual framework of nursing workload and patient safety in intensive care units. , 2005, Intensive & critical care nursing.

[69]  C. Maslach,et al.  A Mediation Model of Job Burnout , 2005 .

[70]  Matthew B Weinger,et al.  Multiple Measures of Anesthesia Workload During Teaching and Nonteaching Cases , 2004, Anesthesia and analgesia.

[71]  W. Schaufeli,et al.  Nursing activities score , 2003, Critical care medicine.

[72]  L. Aiken,et al.  Hospital nurse staffing and patient mortality, nurse burnout, and job dissatisfaction. , 2002, JAMA.

[73]  W. Tarnow-Mordi,et al.  Hospital mortality in relation to staff workload: a 4-year study in an adult intensive-care unit , 2000, The Lancet.

[74]  D. Michael Warner,et al.  Scheduling Nursing Personnel According to Nursing Preference: A Mathematical Programming Approach , 1976, Oper. Res..

[75]  J. Civetta,et al.  Therapeutic intervention scoring system: a method for quantitative comparison of patient care. , 1974, Critical care medicine.

[76]  G. M. Moura,et al.  Association between workload of the nursing staff and patient safety outcomes. , 2017, Revista da Escola de Enfermagem da U S P.

[77]  V. F. Simões,et al.  Staff workload and adverse events during mechanical ventilation in neonatal intensive care units. , 2011, Jornal de pediatria.

[78]  Shu Yin Hoi,et al.  Determining nurse staffing needs: the workload intensity measurement system. , 2010, Journal of nursing management.

[79]  Christine Duffield,et al.  A review of workload measures: a context for a new staffing methodology in Western Australia. , 2009, International journal of nursing studies.

[80]  Christine Duffield,et al.  The causes and consequences of nursing shortages: a helicopter view of the research. , 2003, Australian health review : a publication of the Australian Hospital Association.

[81]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .