Identifying patients at highest-risk: the best timing to apply a readmission predictive model

BackgroundMost of readmission prediction models are implemented at the time of patient discharge. However, interventions which include an early in-hospital component are critical in reducing readmissions and improving patient outcomes. Thus, at-discharge high-risk identification may be too late for effective intervention. Nonetheless, the tradeoff between early versus at-discharge prediction and the optimal timing of the risk prediction model application remains to be determined. We examined a high-risk patient selection process with readmission prediction models using data available at two time points: at admission and at the time of hospital discharge.MethodsAn historical prospective study of hospitalized adults (≥65 years) discharged alive from internal medicine units in Clalit’s (the largest integrated payer-provider health fund in Israel) general hospitals in 2015. The outcome was all-cause 30-day emergency readmissions to any internal medicine ward at any hospital. We used the previously validated Preadmission Readmission Detection Model (PREADM) and developed a new model incorporating PREADM with hospital data (PREADM-H). We compared the percentage of overlap between the models and calculated the positive predictive value (PPV) for the subgroups identified by each model separately and by both models.ResultsThe final cohort included 35,156 index hospital admissions. The PREADM-H model included 17 variables with a C-statistic of 0.68 (95% CI: 0.67–0.70) and PPV of 43.0% in the highest-risk categories. Of patients categorized by the PREADM-H in the highest-risk decile, 78% were classified similarly by the PREADM. The 22% (n = 229) classified by the PREADM-H at the highest decile, but not by the PREADM, had a PPV of 37%. Conversely, those classified by the PREADM into the highest decile but not by the PREADM-H (n = 218) had a PPV of 31%.ConclusionsThe timing of readmission risk prediction makes a difference in terms of the population identified at each prediction time point – at-admission or at-discharge. Our findings suggest that readmission risk identification should incorporate a two time-point approach in which preadmission data is used to identify high-risk patients as early as possible during the index admission and an “all-hospital” model is applied at discharge to identify those that incur risk during the hospital stay.

[1]  A. Kramer,et al.  Preparing Patients and Caregivers to Participate in Care Delivered Across Settings: The Care Transitions Intervention , 2004, Journal of the American Geriatrics Society.

[2]  Li Lin,et al.  Estimating the causal effects of chronic disease combinations on 30-day hospital readmissions based on observational Medicaid data , 2018, J. Am. Medical Informatics Assoc..

[3]  John P. A. Ioannidis,et al.  Opportunities and challenges in developing risk prediction models with electronic health records data: a systematic review , 2017, J. Am. Medical Informatics Assoc..

[4]  Rainu Kaushal,et al.  The potential for community-based health information exchange systems to reduce hospital readmissions , 2015, J. Am. Medical Informatics Assoc..

[5]  Ying Ma,et al.  Electronic medical record-based multicondition models to predict the risk of 30 day readmission or death among adult medicine patients: validation and comparison to existing models , 2015, BMC Medical Informatics and Decision Making.

[6]  Xiongcai Cai,et al.  Real-time prediction of mortality, readmission, and length of stay using electronic health record data , 2016, J. Am. Medical Informatics Assoc..

[7]  Grant S. Fletcher,et al.  International Validity of the HOSPITAL Score to Predict 30-Day Potentially Avoidable Hospital Readmissions. , 2016, JAMA internal medicine.

[8]  M. Preyde,et al.  Evidence-based Risk Factors for Adverse Health Outcomes in Older Patients after Discharge Home and Assessment Tools: A Systematic Review , 2011, Journal of evidence-based social work.

[9]  Amanda H. Salanitro,et al.  Risk prediction models for hospital readmission: a systematic review. , 2011, JAMA.

[10]  M. Naylor,et al.  Comprehensive discharge planning for the hospitalized elderly. A randomized clinical trial. , 1994, Annals of internal medicine.

[11]  Bin Huang,et al.  Explaining Racial Disparities in Child Asthma Readmission Using a Causal Inference Approach. , 2016, JAMA pediatrics.

[12]  R. Wachter,et al.  Hospital-Initiated Transitional Care Interventions as a Patient Safety Strategy , 2013, Annals of Internal Medicine.

[13]  Sung-joon Min,et al.  The care transitions intervention: results of a randomized controlled trial. , 2006, Archives of internal medicine.

[14]  S. Dhaliwal,et al.  Utility of models to predict 28-day or 30-day unplanned hospital readmissions: an updated systematic review , 2016, BMJ Open.

[15]  R. Sanson-Fisher,et al.  Effectiveness of interventions utilising telephone follow up in reducing hospital readmission within 30 days for individuals with chronic disease: a systematic review , 2016, BMC Health Services Research.

[16]  Ferdinand T. Velasco,et al.  Predicting all-cause readmissions using electronic health record data from the entire hospitalization: Model development and comparison. , 2016, Journal of hospital medicine.

[17]  Stephen A. Martin,et al.  A Reengineered Hospital Discharge Program to Decrease Rehospitalization , 2009, Annals of Internal Medicine.

[18]  H. Bitterman,et al.  Predicting 30-Day Readmissions With Preadmission Electronic Health Record Data , 2015, Medical care.

[19]  Mark V. Williams,et al.  Interventions to Reduce 30-Day Rehospitalization: A Systematic Review , 2011, Annals of Internal Medicine.

[20]  Hilde van der Togt,et al.  Publisher's Note , 2003, J. Netw. Comput. Appl..

[21]  J. Schnipper,et al.  Potentially avoidable 30-day hospital readmissions in medical patients: derivation and validation of a prediction model. , 2013, JAMA internal medicine.

[22]  J. Hanley,et al.  Statistical analysis of correlated data using generalized estimating equations: an orientation. , 2003, American journal of epidemiology.