Forecasting Patient Outflow from Wards having No Real-Time Clinical Data

Modelling patient flow is crucial in understanding resource demand and prioritization. To date, there has been limited work in predicting ward-level discharges. Our study investigates forecasting total next-day discharges from an open ward. In the absence of real-time clinical data, we propose to construct a feature set from patient demographics, ward data and discharge time series to derive a random forest model for forecasting daily discharge. Using data from a general ward of a large regional Australian hospital, we compared our random forest model with a classical auto-regressive integrated moving average (ARIMA) for 12,141 patient visits over 1826 days. Forecasting quality was measured using Mean Forecast Error, Mean Absolute Error, symmetric Mean Absolute Percentage Error and Root Mean Square Error. When compared to the baseline model, next day discharge forecasts using random forests achieved 17.4 % improvement in Mean Absolute Error, for all days in the year 2014.

[1]  Elia El-Darzi,et al.  Length of Stay-Based Patient Flow Models: Recent Developments and Future Directions , 2005, Health care management science.

[2]  Winston T. Lin Modeling and forecasting hospital patient movements: Univariate and multiple time series approaches , 1989 .

[3]  Paul Robert Harper,et al.  Modelling for the planning and management of bed capacities in hospitals , 2002, J. Oper. Res. Soc..

[4]  Stephanie Tierney,et al.  Systems and people under pressure: the discharge process in an acute hospital. , 2009, Journal of clinical nursing.

[5]  P. H. Millard,et al.  A simulation modelling approach to evaluating length of stay, occupancy, emptiness and bed blocking in a hospital geriatric department , 1998, Health care management science.

[6]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[7]  Christoph U. Lehmann,et al.  Real-time forecasting of pediatric intensive care unit length of stay using computerized provider orders , 2012, Critical care medicine.

[8]  Carl van Walraven,et al.  Risk of death or readmission among people discharged from hospital on Fridays. , 2002, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[9]  P R Harper,et al.  Mathematical modelling and simulation for planning critical care capacity * , 2003, Anaesthesia.

[10]  Rob J Hyndman,et al.  Another look at measures of forecast accuracy , 2006 .

[11]  Roland R. Draxler,et al.  Root mean square error (RMSE) or mean absolute error (MAE) , 2014 .

[12]  Sally McClean,et al.  A queueing model for bed-occupancy management and planning of hospitals , 2002, J. Oper. Res. Soc..

[13]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[14]  P H Millard,et al.  A decision support system for bed-occupancy management and planning hospitals. , 1995, IMA journal of mathematics applied in medicine and biology.

[15]  Jon Pearson,et al.  Forecasting Demand of Emergency Care , 2002, Health Care Management Science.

[16]  M. Shcherbakov,et al.  A Survey of Forecast Error Measures , 2013 .

[17]  P. A. Blight The Analysis of Time Series: An Introduction , 1991 .

[18]  Mustafa Y. Sir,et al.  Estimating Admissions and Discharges for Planning Purposes – Case of an Academic Health System , 2011 .

[19]  Peter H. Millard,et al.  Using a Queueing Model to Help Plan Bed Allocation in a Department of Geriatric Medicine , 2002, Health care management science.

[20]  Sean L. Barnes,et al.  Real-time prediction of inpatient length of stay for discharge prioritization , 2016, J. Am. Medical Informatics Assoc..

[21]  P H Millard,et al.  A three compartment model of the patient flows in a geriatric department: a decision support approach , 1998, Health care management science.

[22]  Shari J. Welch,et al.  Forecasting daily patient volumes in the emergency department. , 2008, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[23]  M. Mackay Practical experience with bed occupancy management and planning systems: an Australian view , 2001, Health care management science.

[24]  Dominik Aronsky,et al.  Forecasting emergency department crowding: a discrete event simulation. , 2008, Annals of emergency medicine.

[25]  Haiyan Gao,et al.  Length of stay as a performance indicator: robust statistical methodology , 2005 .

[26]  Stephanie Tierney,et al.  Discharge preparation: Do healthcare professionals differ in their opinions? , 2010, Journal of interprofessional care.

[27]  Rob J. Hyndman,et al.  Another Look at Forecast Accuracy Metrics for Intermittent Demand , 2006 .

[28]  Douglas L Wood,et al.  Optimizing weekend availability for sophisticated tests and procedures in a large hospital. , 2005, The American journal of managed care.

[29]  O. Linton Local Regression Models , 2010 .

[30]  A. Kalache,et al.  Active ageing: a policy framework. , 2003, Advances in gerontology = Uspekhi gerontologii.

[31]  Matthew Scotch,et al.  Comparison of ARIMA and Random Forest time series models for prediction of avian influenza H5N1 outbreaks , 2014, BMC Bioinformatics.

[32]  Terence M. Mills,et al.  A Mathematician Goes to Hospital , 2004 .

[33]  Víctor Leiva,et al.  An R Package for a General Class of Inverse Gaussian Distributions , 2008 .

[34]  Dante Morra,et al.  Real-time operational feedback: daily discharge rate as a novel hospital efficiency metric , 2010, Quality and Safety in Health Care.

[35]  Mark Mackay,et al.  Choice of Models for the Analysis and Forecasting of Hospital Beds , 2005, Health care management science.

[36]  L. Ryan,et al.  Concurrent prediction of hospital mortality and length of stay from risk factors on admission. , 2002, Health services research.

[37]  S. J. Littig,et al.  Short term hospital occupancy prediction , 2007, Health care management science.

[38]  Rob J Hyndman,et al.  Automatic Time Series Forecasting: The forecast Package for R , 2008 .

[39]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[40]  Michael Schull,et al.  The development of indicators to measure the quality of clinical care in emergency departments following a modified-delphi approach. , 2002, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[41]  Jordan S Peck,et al.  Predicting emergency department inpatient admissions to improve same-day patient flow. , 2012, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[42]  C. Willmott,et al.  Advantages of the mean absolute error (MAE) over the root mean square error (RMSE) in assessing average model performance , 2005 .

[43]  Jiguo Cao,et al.  Estimating the intensity of ward admission and its effect on emergency department access block. , 2013, Statistics in medicine.

[44]  Alfred Cuschieri,et al.  Instrument for objective assessment of appropriateness of surgical bed occupancy: validation study , 2003, BMJ : British Medical Journal.

[45]  L. Greenfield,et al.  Length of stay has minimal impact on the cost of hospital admission. , 2000, Journal of the American College of Surgeons.

[46]  Dante Morra,et al.  How much do operational processes affect hospital inpatient discharge rates? , 2009, Journal of public health.