Real-time forecasting of pediatric intensive care unit length of stay using computerized provider orders

Objective:To develop a model to produce real-time, updated forecasts of patients’ intensive care unit length of stay using naturally generated provider orders. The model was designed to be integrated within a computerized decision support system to improve patient flow management. Design:Retrospective cohort study. Setting:Twenty-six bed pediatric intensive care unit within an urban, academic children’s hospital using a computerized order entry system. Patients:A total of 2,178 consecutive pediatric intensive care unit admissions during a 16-month time period. Measurements and Main Results:We obtained unit length of stay measurements, time-stamped provider orders, age, admission source, and readmission status. A joint discrete-time logistic regression model was developed to produce probabilistic length of stay forecasts from continuously updated provider orders. Accuracy was assessed by comparing forecasted expected discharge time with observed discharge time, rank probability scoring, and calibration curves. Cross-validation procedures were conducted. The distribution of length of stay was heavily right-skewed with a mean of 3.5 days (95% confidence interval 0.3–19.1). Provider orders were predictive of length of stay in real-time accurately forecasting discharge within a 12-hr window: 46% for patients within 1 day of discharge, 34% for patients within 2 days of discharge, and 27% for patients within 3 days of discharge. The forecast model incorporating predictive orders demonstrated significant improvements in accuracy compared with forecasts based solely on empirical and temporal information. Seventeen predictive orders were found, grouped by medication, ventilation, laboratory, diet, activity, foreign body, and extracorporeal membrane oxygenation. Conclusions:Provider orders reflect dynamic changes in patients’ conditions, making them useful for real-time length of stay prediction and patient flow management. Patients’ length of stay represent a major source of variability in intensive care unit resource utilization and if accurately predicted and communicated, may lead to proactive bed management with more efficient patient flow.

[1]  Christoph U. Lehmann,et al.  Preventing provider errors: online total parenteral nutrition calculator. , 2004, Pediatrics.

[2]  D Aronsky,et al.  Evaluating the effects of increasing surgical volume on emergency department patient access , 2011, Quality and Safety in Health Care.

[3]  S. J. Littig,et al.  Short term hospital occupancy prediction , 2007, Health care management science.

[4]  Jessica H May,et al.  The transition from excess capacity to strained capacity in U.S. hospitals. , 2006, The Milbank quarterly.

[5]  R. Resar,et al.  Patient Flow in Hospitals: Understanding and Controlling It Better , 2004, Frontiers of Health Services Management.

[6]  J. Norrie,et al.  Evaluation of predicted and actual length of stay in 22 Scottish intensive care units using the APACHE III system , 2000, Anaesthesia.

[7]  U. Ruttimann,et al.  An objective method to evaluate rationing of pediatric intensive care beds , 2005, Intensive Care Medicine.

[8]  Eduard E Vasilevskis,et al.  Mortality probability model III and simplified acute physiology score II: assessing their value in predicting length of stay and comparison to APACHE IV. , 2009, Chest.

[9]  M. Pagano,et al.  Variability in Surgical Caseload and Access to Intensive Care Services , 2003, Anesthesiology.

[10]  M. Mackay,et al.  Modelling Variability in Hospital Bed Occupancy , 2005, Health care management science.

[11]  Stephen E. Fienberg,et al.  The Comparison and Evaluation of Forecasters. , 1983 .

[12]  Eugene Litvak.  Optimizing Patient Flow by Managing Its Variability , 2005 .

[13]  G. Cooper,et al.  Severity-adjusted mortality and length of stay in teaching and nonteaching hospitals. Results of a regional study. , 1998, JAMA.

[14]  R. Dittus,et al.  Optimizing cardiology capacity to reduce emergency department boarding: a systems engineering approach. , 2008, American heart journal.

[15]  D. Teres,et al.  Assessing contemporary intensive care unit outcome: An updated Mortality Probability Admission Model (MPM0-III)* , 2007, Critical care medicine.

[16]  H. Nguyen,et al.  Critical care in the emergency department: A physiologic assessment and outcome evaluation. , 2000, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[17]  Donald B. Chalfin,et al.  Impact of delayed transfer of critically ill patients from the emergency department to the intensive care unit* , 2007, Critical care medicine.

[18]  Edward S. Epstein,et al.  A Scoring System for Probability Forecasts of Ranked Categories , 1969 .

[19]  Deborah J Cook,et al.  Rationing critical care beds: A systematic review* , 2004, Critical care medicine.

[20]  Elia El-Darzi,et al.  Length of Stay-Based Patient Flow Models: Recent Developments and Future Directions , 2005, Health care management science.

[21]  Anthony S. Tay,et al.  Evaluating Density Forecasts with Applications to Financial Risk Management , 1998 .

[22]  E. Litvak,et al.  Cost and quality under managed care: irreconcilable differences? , 2000, The American journal of managed care.

[23]  S. Shortell.  Increasing Value: A Research Agenda for Addressing the Managerial and Organizational Challenges Facing Health Care Delivery in the United States , 2004, Medical care research and review : MCRR.

[24]  James Deddens,et al.  Variation in outcomes in Veterans Affairs intensive care units with a computerized severity measure* , 2005, Critical care medicine.

[25]  J. Zimmerman,et al.  Intensive care unit length of stay: Benchmarking based on Acute Physiology and Chronic Health Evaluation (APACHE) IV* , 2006, Critical care medicine.

[26]  S. Lemeshow,et al.  A new Simplified Acute Physiology Score (SAPS II) based on a European/North American multicenter study. , 1993, JAMA.

[27]  Charles L Sprung,et al.  Survival of critically ill patients hospitalized in and out of intensive care units under paucity of intensive care unit beds* , 2004, Critical care medicine.