Comparison of the National Emergency Department Overcrowding Scale and the Emergency Department Work Index for quantifying emergency department crowding.

BACKGROUND Emergency department (ED) crowding is just beginning to be quantified. The only two scales presently available are the National Emergency Department Overcrowding Scale (NEDOCS) and the Emergency Department Work Index (EDWIN). OBJECTIVES To assess the value of the NEDOCS and the EDWIN in predicting overcrowding. The hypothesis of this study was that the NEDOCS and the EDWIN would be equally sensitive and specific for overcrowding. METHODS The NEDOCS, the EDWIN, and an overcrowding measure (OV) were determined every two hours for a ten-day period in December 2004. The NEDOCS is a statistically derived calculation, and the EDWIN is a formula-based calculation. The overcrowding measure is a composite of physician and charge nurse expert opinion on the degree of overcrowding as measured on a 100-mm visual analogue scale (VAS). The primary outcome, overcrowding, was based on the dichotomized OV VAS score at the midpoint of 50 mm (> or =50, overcrowded; <50, not overcrowded). The area under the receiver operator characteristic curve (AUC) and an index of adequacy (relative prognostic content) of each measure, on the basis of the likelihood ratio chi-square statistic, were computed to evaluate the performance of NEDOCS and EDWIN. RESULTS There were 130 completed sampling times over ten days. The OV indicated that the ED was overcrowded 62% of the time. The AUC for the NEDOCS was 0.83 (95% CI = 0.75 to 0.90), and the AUC for the EDWIN was 0.80 (95% CI = 0.73 to 0.88). The NEDOCS score accounts for 97% of the prognostic information provided by combining all variables used in each model into one combined model. The EDWIN score accounts for only 86% (chi2 test for difference, p = 0.02). CONCLUSIONS Both scales had high AUCs, correlated well with each other, and showed good discrimination for predicting ED overcrowding. This establishes construct validity for these scales as measures of overcrowding. Which scale is used in an ED is dependent on which set of data is most readily available, with the favored scale being the NEDOCS.

[1]  Chetan U. Kharod,et al.  Medical mistakes, errors in judgment, and personal awareness. , 2003, Annals of emergency medicine.

[2]  P. Friedmann,et al.  Factors associated with older patients' satisfaction with care in an inner-city emergency department. , 2001, Annals of emergency medicine.

[3]  S Wacholder,et al.  Validation studies using an alloyed gold standard. , 1993, American journal of epidemiology.

[4]  P. Richman The paradox of gold standards. , 2002, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[5]  Cherri Hobgood,et al.  Error identification, disclosure, and reporting: practice patterns of three emergency medicine provider types. , 2004, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[6]  John Concato,et al.  Care in the emergency department: how crowded is overcrowded? , 2004, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[7]  J. McMullan,et al.  Emergency Department Volume and Acuity as Factors in Patients Leaving Without Treatment , 2004, Southern medical journal.

[8]  Todd G Nick,et al.  Estimating the degree of emergency department overcrowding in academic medical centers: results of the National ED Overcrowding Study (NEDOCS). , 2004, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[9]  P R Yarnold,et al.  Effects of actual waiting time, perceived waiting time, information delivery, and expressive quality on patient satisfaction in the emergency department. , 1996, Annals of emergency medicine.

[10]  Measurement of C-reactive protein for the targeting of statin therapy in the primary prevention of acute coronary events. , 2001, The New England journal of medicine.

[11]  B. Nelson,et al.  Faculty triage shortens emergency department length of stay. , 2001, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[12]  E. Boudreaux,et al.  Patient satisfaction data as a quality indicator: a tale of two emergency departments , 2003 .

[13]  G. de Pouvourville,et al.  Another look at emergency room overcrowding: accessibility of the health services and quality of care. , 1997, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[14]  A. Levine,et al.  Factors affecting ED length-of-stay in surgical critical care patients. , 1995, The American journal of emergency medicine.

[15]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[16]  Ò. Miró,et al.  Decreased health care quality associated with emergency department overcrowding. , 1999, European journal of emergency medicine : official journal of the European Society for Emergency Medicine.

[17]  D W Baker,et al.  Patients who leave emergency departments without being seen by a physician: magnitude of the problem in Los Angeles County. , 1994, Annals of emergency medicine.

[18]  R. Derlet Triage and ED Overcrowding: Two Cases of Unexpected Outcome. , 2002, The California journal of emergency medicine.

[19]  Edwin D Boudreaux,et al.  Predictors of emergency department patient satisfaction: stability over 17 months. , 2004, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[20]  Michael Schull,et al.  The development of indicators to measure the quality of clinical care in emergency departments following a modified-delphi approach. , 2002, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[21]  D Tandberg,et al.  Hospital factors associated with emergency center patients leaving without being seen. , 2000, The American journal of emergency medicine.

[22]  R H Brook,et al.  Patients who leave a public hospital emergency department without being seen by a physician. Causes and consequences. , 1991, JAMA.

[23]  R. A. Johnson,et al.  Prognostic value of a coronary artery jeopardy score. , 1985, Journal of the American College of Cardiology.

[24]  Steven L Bernstein,et al.  Development and validation of a new index to measure emergency department crowding. , 2003, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[25]  S. Polevoi,et al.  Factors associated with patients who leave without being seen. , 2005, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[26]  Karin V Rhodes,et al.  A conceptual model of emergency department crowding. , 2003, Annals of emergency medicine.

[27]  Todd G Nick,et al.  Relationship between the National ED Overcrowding Scale and the number of patients who leave without being seen in an academic ED. , 2005, The American journal of emergency medicine.

[28]  T. Nick,et al.  Development of a site sampling form for evaluation of ED overcrowding. , 2002, Medical science monitor : international medical journal of experimental and clinical research.

[29]  Frank E. Harrell,et al.  Regression Modeling Strategies: With Applications to Linear Models, Logistic Regression, and Survival Analysis , 2001 .

[30]  S. Faraone,et al.  Measuring diagnostic accuracy in the absence of a "gold standard". , 1994, The American journal of psychiatry.

[31]  M. Weissberg,et al.  Patients who leave without being seen. , 1986, Annals of emergency medicine.

[32]  Howard A Smithline,et al.  Errors in a busy emergency department. , 2003, Annals of emergency medicine.

[33]  J. Christenson,et al.  Does reduced length of stay decrease the number of emergency department patients who leave without seeing a physician? , 1997, The Journal of emergency medicine.

[34]  Joann L. Baril,et al.  Disclosure of medical errors , 2006, Journal of General Internal Medicine.

[35]  D. Debehnke,et al.  The effects of a physician-nurse patient care team on patient satisfaction in an academic ED. , 2002, The American journal of emergency medicine.

[36]  D. Eitel,et al.  The emergency severity index triage algorithm version 2 is reliable and valid. , 2003, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[37]  E. Boudreaux,et al.  Emergency department personnel accuracy at estimating patient satisfaction. , 2000, The Journal of emergency medicine.

[38]  J. Feldman Medical Errors and Emergency Medicine: Will the Difficult Questions Be Asked, and Answered? , 2003 .

[39]  Paul M. Ridker,et al.  Measurement of C-reactive protein for the targeting of statin therapy in the primary prevention of acute coronary events. , 2001, The New England journal of medicine.

[40]  B. Bucheli,et al.  Reduced length of stay in medical emergency department patients: a prospective controlled study on emergency physician staffing , 2004, European journal of emergency medicine : official journal of the European Society for Emergency Medicine.