Real-time prediction of waiting time in the emergency department, using quantile regression.

STUDY OBJECTIVE Emergency department (ED) waiting times can affect patient satisfaction and quality of care. We develop and validate a model that predicts an individual patient's median and 95th percentile waiting time by using only data available at triage. METHODS From the existing ED information system, we extracted date and time of triage completion, start time of emergency physician consultation, and patient acuity category (1=most urgent, 3=least urgent). Quantile regression was applied for model development and parameter estimation by using visits from January 2011. We assessed absolute prediction error, defined as the median difference between the 50th percentile (median) predicted waiting time and actual waiting time, and the proportion of underestimated prediction, defined as the percentage of patients whose actual waiting time exceeded the 95th percentile prediction. The model was validated retrospectively with June 2010 data and prospectively with data from April to June 2011 after integration with the existing ED information system. RESULTS The derivation set included 13,200 ED visits; 903 (6.8%) were patient acuity category 1, 5,530 (41.9%) were patient acuity category 2, and 6,767 (51.3%) were patient acuity category 3. The median and 95th percentile waiting times were 17 and 57 minutes for patient acuity category 2 and 21 and 89 minutes for patient acuity category 3, respectively. The final model used predictors of patient acuity category, patient queue sizes, and flow rates only. In the retrospective validation, 5.9% of patient acuity category 2 and 5.4% of category 3 waiting times were underestimated. The median absolute prediction error was 11.9 minutes (interquantile range [IQR] 5.9 to 22.1 minutes) for patient acuity category 2 and 15.7 minutes (IQR 7.5 to 30.1 minutes) for category 3. In prospective validation, 4.3% of patient acuity category 2 and 5.8% of category 3 waiting times were underestimated. The median absolute prediction error was 9.2 minutes (IQR 4.4 to 15.1 minutes) for patient acuity category 2 and 12.9 minutes (IQR 6.5 to 22.5 minutes) for category 3. CONCLUSION Using only a few data elements available at triage, the model predicts individual patients' waiting time with good accuracy.

[1]  Shirley Taylor Waiting for Service: The Relationship between Delays and Evaluations of Service , 1994 .

[2]  J. Mowen,et al.  Waiting in the emergency room: how to improve patient satisfaction. , 1993, Journal of health care marketing.

[3]  Agnés Durrande-Moreau,et al.  Waiting for service: ten years of empirical research , 1999 .

[4]  Ward Whitt,et al.  The Impact of Delay Announcements in Many-Server Queues with Abandonment , 2009, Oper. Res..

[5]  Gilles Reinhardt,et al.  Analysis of factors influencing length of stay in the emergency department. , 2003, CJEM.

[6]  Edwin D Boudreaux,et al.  Patient satisfaction in the Emergency Department: a review of the literature and implications for practice. , 2004, The Journal of emergency medicine.

[7]  J. George Shanthikumar,et al.  A Psychological Perspective on Service Segmentation Models: The Significance of Accounting for Consumers' Perceptions of Waiting and Service , 1995 .

[8]  J. Hedges,et al.  Patient satisfaction investigations and the emergency department: what does the literature say? , 2000, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[9]  Toros Caglar A Queueing Theoretic Approach to Gridlock Prediction in Emergency Departments , 2005 .

[10]  J. Richards,et al.  Overcrowding in the nation's emergency departments: complex causes and disturbing effects. , 2000, Annals of emergency medicine.

[11]  W. Whitt,et al.  Improving Service by Informing Customers About Anticipated Delays , 1999 .

[12]  S. Zeger,et al.  A randomized controlled trial of the effect of service delivery information on patient satisfaction in an emergency department fast track. , 2011, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[13]  M. Kennedy,et al.  A multifaceted intervention improves patient satisfaction and perceptions of emergency department care. , 2006, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[14]  R. Shaw,et al.  Emergency department satisfaction: what matters most? , 1993, Annals of emergency medicine.

[15]  R. Kirk,et al.  The epidemiology of emergency department attendances in Christchurch. , 2001, The New Zealand medical journal.

[16]  Akihiro Ogawa,et al.  Development of a Waiting Time Prediction System for Hospitals , 2009 .

[17]  J. Benger,et al.  Patient satisfaction in emergency medicine , 2004, Emergency Medicine Journal.

[18]  R. Koenker,et al.  Robust Tests for Heteroscedasticity Based on Regression Quantiles , 1982 .

[19]  L. Baraff,et al.  Effect of emergency department information on patient satisfaction. , 1993, Annals of emergency medicine.

[20]  R. Koenker,et al.  Regression Quantiles , 2007 .

[21]  E J Orav,et al.  Determinants of patient satisfaction and willingness to return with emergency care. , 2000, Annals of emergency medicine.

[22]  Richard C. Larson,et al.  OR Forum - Perspectives on Queues: Social Justice and the Psychology of Queueing , 1987, Oper. Res..

[23]  Dominik Aronsky,et al.  Characterizing waiting room time, treatment time, and boarding time in the emergency department using quantile regression. , 2010, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[24]  Michael K. Hui,et al.  What to Tell Consumers in Waits of Different Lengths: An Integrative Model of Service Evaluation , 1996 .

[25]  L J Shuman,et al.  An emergency department simulation and a neural network metamodel. , 1997, Journal of the Society for Health Systems.

[26]  Ralph Gonzales,et al.  Factors associated with longer ED lengths of stay. , 2007, The American journal of emergency medicine.

[27]  A. Rafaeli,et al.  Numbers or apologies? Customer reactions to telephone waiting time fillers. , 2007, The Journal of applied psychology.

[28]  David P Sklar,et al.  Emergency department crowding, part 1--concept, causes, and moral consequences. , 2009, Annals of emergency medicine.

[29]  Eric R. Zieyel Operations research : applications and algorithms , 1988 .

[30]  L. McCaig,et al.  National Hospital Ambulatory Medical Care Survey: 2000 Emergency Department Summary , 2002 .

[31]  William Gould,et al.  Quantile regression with bootstrapped standard errors , 1993 .