Evaluation of emergency department performance – a systematic review on recommended performance and quality-in-care measures

BackgroundEvaluation of emergency department (ED) performance remains a difficult task due to the lack of consensus on performance measures that reflects high quality, efficiency, and sustainability.AimTo describe, map, and critically evaluate which performance measures that the published literature regard as being most relevant in assessing overall ED performance.MethodsFollowing the PRISMA guidelines, a systematic literature review of review articles reporting accentuated ED performance measures was conducted in the databases of PubMed, Cochrane Library, and Web of Science. Study eligibility criteria includes: 1) the main purpose was to discuss, analyse, or promote performance measures best reflecting ED performance, 2) the article was a review article, and 3) the article reported macro-level performance measures, thus reflecting an overall departmental performance level.ResultsA number of articles addresses this study’s objective (n = 14 of 46 unique hits). Time intervals and patient-related measures were dominant in the identified performance measures in review articles from US, UK, Sweden and Canada. Length of stay (LOS), time between patient arrival to initial clinical assessment, and time between patient arrivals to admission were highlighted by the majority of articles. Concurrently, “patients left without being seen” (LWBS), unplanned re-attendance within a maximum of 72 hours, mortality/morbidity, and number of unintended incidents were the most highlighted performance measures that related directly to the patient. Performance measures related to employees were only stated in two of the 14 included articles.ConclusionsA total of 55 ED performance measures were identified. ED time intervals were the most recommended performance measures followed by patient centeredness and safety performance measures. ED employee related performance measures were rarely mentioned in the investigated literature. The study’s results allow for advancement towards improved performance measurement and standardised assessment across EDs.

[1]  John N. Friedman,et al.  Performance Improvement and Performance Dysfunction: An Empirical Examination of Impacts of the Emergency Room Wait-Time Target in the English National Health Service , 2007 .

[2]  K. Göransson,et al.  Patient experience of the triage encounter in a Swedish emergency department. , 2010, International emergency nursing.

[3]  Brian H Rowe,et al.  Prioritizing performance measurement for emergency department care: consensus on evidence-based quality of care indicators. , 2011, CJEM.

[4]  Daruosh Zargari Samani,et al.  Framework for implementing balanced scorecard in hospitals , 2011 .

[5]  David Sibbritt,et al.  Emergency Department Performance Indicators That Encompass the Patient Journey , 2006, Quality management in health care.

[6]  A. Ehrenberg,et al.  Triage in emergency departments: national survey. , 2005, Journal of clinical nursing.

[7]  Andreas Traberg.  Management-By-Objectives in Healthcare , 2011 .

[8]  B. Gordon,et al.  Accuracy of staff-initiated emergency department tracking system timestamps in identifying actual event times. , 2008, Annals of emergency medicine.

[9]  R. Kaplan,et al.  The balanced scorecard--measures that drive performance. , 2015, Harvard business review.

[10]  Kate Silvester,et al.  Health-care process improvement decisions: a systems perspective. , 2006, International journal of health care quality assurance incorporating Leadership in health services.

[11]  Matthew Cooke,et al.  Making care count: introducing the Emergency Department quality indicators. , 2011, International emergency nursing.

[12]  Ulf Ekelund,et al.  Hoping for a domino effect: a new specialty in Sweden is a breath of fresh air for the development of Scandinavian emergency medicine , 2013, Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine.

[13]  A. Neely.  The evolution of performance measurement research: Developments in the last decade and a research agenda for the next , 2005 .

[14]  PERFORMANCE IMPROVEMENT AND PERFORMANCE DYSFUNCTION: AN EMPIRICAL EXAMINATION OF DISTORTIONARY IMPACTS OF THE EMERGENCY ROOM WAIT-TIME TARGET IN THE ENGLISH NATIONAL HEALTH SERVICE , 2008 .

[15]  Shari J. Welch,et al.  Emergency department operational metrics, measures and definitions: results of the Second Performance Measures and Benchmarking Summit. , 2011, Annals of emergency medicine.

[16]  Paulus Torkki,et al.  Patient throughput times and inflow patterns in Swedish emergency departments. A basis for ANSWER, A National SWedish Emergency Registry , 2011, Scandinavian journal of trauma, resuscitation and emergency medicine.

[17]  Andy Neely,et al.  Performance measurement system design , 1995 .

[18]  Edwin D Boudreaux,et al.  Patient satisfaction in the Emergency Department: a review of the literature and implications for practice. , 2004, The Journal of emergency medicine.

[19]  J. Benneyan,et al.  Statistical process control as a tool for research and healthcare improvement , 2003, Quality & safety in health care.

[20]  A. Darzi,et al.  Systematic review of the application of quality improvement methodologies from the manufacturing industry to surgical healthcare , 2012, The British journal of surgery.

[21]  Asma Razzaq,et al.  Development of Measures of the Quality of Emergency Department Care for Children Using a Structured Panel Process , 2006, Pediatrics.

[22]  Jesse M Pines,et al.  A field test of time-based emergency department quality measures. , 2012, Annals of emergency medicine.

[23]  T. Wan,et al.  Relationships of hospital-based emergency department culture to work satisfaction and intent to leave of emergency physicians and nurses , 2012, Health services management research.

[24]  D. Magid,et al.  Emergency department crowding: consensus development of potential measures. , 2003, Annals of emergency medicine.

[25]  Jon Nicholl,et al.  Consensus Methods to Identify a Set of Potential Performance Indicators for Systems of Emergency and Urgent Care , 2010, Journal of health services research & policy.

[26]  Naren Gunja,et al.  Senior Streaming Assessment Further Evaluation after Triage zone: A novel model of care encompassing various emergency department throughput measures , 2012, Emergency medicine Australasia : EMA.

[27]  M. Schull,et al.  A framework for measuring quality in the emergency department , 2011, Emergency Medicine Journal.

[28]  Sharon E Straus,et al.  A systematic review of quality indicators for evaluating pediatric trauma care , 2010, Critical care medicine.

[29]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. , 2010, International journal of surgery.

[30]  Jeremiah D Schuur,et al.  The role of the Society for Academic Emergency Medicine in the development of guidelines and performance measures. , 2010, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[31]  Sharon E Straus,et al.  Evidence for quality indicators to evaluate adult trauma care: A systematic review* , 2011, Critical care medicine.

[32]  Dominic Chalut,et al.  A Consensus-Established Set of Important Indicators of Pediatric Emergency Department Performance , 2007, Pediatric emergency care.

[33]  P John Clarkson,et al.  Emergency department crowding: prioritising quantified crowding measures using a Delphi study , 2011, Emergency Medicine Journal.

[34]  J. Heyworth,et al.  Emergency medicine-quality indicators: the United Kingdom perspective. , 2011, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[35]  Lena Gunningberg,et al.  Patients' perceptions of quality of care at an emergency department and identification of areas for quality improvement. , 2006, Journal of clinical nursing.

[36]  Peter G Jones,et al.  The four hour target to reduce emergency department ‘waiting time’: A systematic review of clinical outcomes , 2010, Emergency medicine Australasia : EMA.

[37]  D. Spaite,et al.  Measuring and improving quality in emergency medicine. , 2002, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[38]  Ping-Ling Chen,et al.  Using a balanced scorecard to improve the performance of an emergency department. , 2004, Nursing economic$.

[39]  Evaline A. Alessandrini,et al.  Measuring Quality in Pediatric Emergency Care , 2011 .

[40]  Amir Qaseem,et al.  Evidence-Based Performance Measures: Preventing Unintended Consequences of Quality Measurement , 2011, Annals of Internal Medicine.

[41]  Stephen D. Persell,et al.  Changes in Performance After Implementation of a Multifaceted Electronic-Health-Record-Based Quality Improvement System , 2011, Medical care.

[42]  Michael Schull,et al.  The development of indicators to measure the quality of clinical care in emergency departments following a modified-delphi approach. , 2002, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[43]  A. Neely,et al.  WHY MEASUREMENT INITIATIVES FAIL , 2000 .