Predictive models for hospital readmission risk: A systematic review of methods

OBJECTIVES Hospital readmission risk prediction facilitates the identification of patients potentially at high risk so that resources can be used more efficiently in terms of cost-benefit. In this context, several models for readmission risk prediction have been proposed in recent years. The goal of this review is to give an overview of prediction models for hospital readmission, describe the data analysis methods and algorithms used for building the models, and synthesize their results. METHODS Studies that reported the predictive performance of a model for hospital readmission risk were included. We defined the scope of the review and accordingly built a search query to select the candidate papers. This query string was used as input for the chosen search engines, namely PubMed and Google Scholar. For each study, we recorded the population, feature selection method, classification algorithm, sample size, readmission threshold, readmission rate and predictive performance of the model. RESULTS We identified 77 studies that met the inclusion criteria, out of 265 citations. In 68% of the studies (n = 52) logistic regression or other regression techniques were utilized as the main method. Ten (13%) studies used survival analysis for model construction, while 14 (18%) used machine learning techniques for classification, of which decision tree-based methods and SVM were the most utilized algorithms. Among these, only four studies reported the use of any class imbalance addressing technique, of which resampling is the most frequent (75%). The performance of the models varied significantly among studies, with Area Under the ROC Curve (AUC) values in the ranges between 0.54 and 0.92. CONCLUSION Logistic regression and survival analysis have been traditionally the most widely used techniques for model building. Nevertheless, machine learning techniques are becoming increasingly popular in recent years. Recent comparative studies suggest that machine learning techniques can improve prediction ability over traditional statistical approaches. Regardless, the lack of an appropriate benchmark dataset of hospital readmissions makes a comparison of models' performance across different studies difficult.

[1]  Goodarz Danaei,et al.  A Novel Model for Predicting Rehospitalization Risk Incorporating Physical Function, Cognitive Status, and Psychosocial Support Using Natural Language Processing , 2017, Medical care.

[2]  D. Pascual-Figal,et al.  Trends, causes and timing of 30-day readmissions after hospitalization for heart failure: 11-year population-based analysis with linked data. , 2017, International journal of cardiology.

[3]  Chun Wei Yap,et al.  Identifying Potentially Avoidable Readmissions: A Medication‐Based 15‐Day Readmission Risk Stratification Algorithm , 2017, Pharmacotherapy.

[4]  E John Orav,et al.  The relationship between hospital admission rates and rehospitalizations. , 2011, The New England journal of medicine.

[5]  Devore S. Culver,et al.  Development, Validation and Deployment of a Real Time 30 Day Hospital Readmission Risk Assessment Tool in the Maine Healthcare Information Exchange , 2015, PloS one.

[6]  Ruben Amarasingham,et al.  An automated model using electronic medical record data identifies patients with cirrhosis at high risk for readmission. , 2013, Clinical gastroenterology and hepatology : the official clinical practice journal of the American Gastroenterological Association.

[7]  Kun-Pei Lin,et al.  Predicting Inpatient Readmission and Outpatient Admission in Elderly , 2016, Medicine.

[8]  Pier Luigi Lopalco,et al.  Unplanned readmissions within 30 days after discharge: improving quality through easy prediction. , 2017, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[9]  Glenn Fung,et al.  Predicting Readmission Risk with Institution Specific Prediction Models , 2013, 2013 IEEE International Conference on Healthcare Informatics.

[10]  T A Brennan,et al.  Factors associated with unplanned hospital readmission among patients 65 years of age and older in a Medicare managed care plan. , 1999, The American journal of medicine.

[11]  Javier Marco,et al.  Predictive model of readmission to internal medicine wards. , 2012, European journal of internal medicine.

[12]  Carl van Walraven,et al.  Predicting the risk of unplanned readmission or death within 30 days of discharge after a heart failure hospitalization. , 2012, American heart journal.

[13]  C. Norris,et al.  Predicting cardiovascular intensive care unit readmission after cardiac surgery: derivation and validation of the Alberta Provincial Project for Outcomes Assessment in Coronary Heart Disease (APPROACH) cardiovascular intensive care unit clinical prediction model from a registry cohort of 10,799 surg , 2014, Critical Care.

[14]  Mark V. Williams,et al.  Rehospitalizations among patients in the Medicare fee-for-service program. , 2009, The New England journal of medicine.

[15]  Sharon-Lise T. Normand,et al.  An Administrative Claims Measure Suitable for Profiling Hospital Performance on the Basis of 30-Day All-Cause Readmission Rates Among Patients With Heart Failure , 2008, Circulation. Cardiovascular quality and outcomes.

[16]  Tosha B. Wetterneck,et al.  Hospital Readmission in General Medicine Patients: A Prediction Model , 2009, Journal of General Internal Medicine.

[17]  Patricia Halfon,et al.  Measuring potentially avoidable hospital readmissions. , 2002, Journal of clinical epidemiology.

[18]  Y. Tabak,et al.  An Automated Model to Identify Heart Failure Patients at Risk for 30-Day Readmission or Death Using Electronic Medical Record Data , 2010, Medical care.

[19]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[20]  J. Schnipper,et al.  Potentially avoidable 30-day hospital readmissions in medical patients: derivation and validation of a prediction model. , 2013, JAMA internal medicine.

[21]  Sílvia López-Aguilà,et al.  Predictive model for emergency hospital admission and 6-month readmission. , 2011, The American journal of managed care.

[22]  B. French,et al.  The readmission risk flag: using the electronic health record to automatically identify patients at risk for 30-day readmission. , 2013, Journal of hospital medicine.

[23]  M. Silverstein,et al.  Risk Factors for 30-Day Hospital Readmission in Patients ≥65 Years of Age , 2008, Proceedings.

[24]  Harlan M Krumholz,et al.  Do Non-Clinical Factors Improve Prediction of Readmission Risk?: Results From the Tele-HF Study. , 2016, JACC. Heart failure.

[25]  David M. Smith,et al.  Rates and predictors of 30-day readmission among commercially insured and Medicaid-enrolled patients hospitalized with systolic heart failure. , 2012, Circulation. Heart failure.

[26]  Sung-joon Min,et al.  Posthospital care transitions: patterns, complications, and risk identification. , 2004, Health services research.

[27]  Y. Tabak,et al.  Predicting Readmission at Early Hospitalization Using Electronic Clinical Data , 2016, Medical care.

[28]  P. Austin,et al.  Derivation and validation of an index to predict early death or unplanned readmission after discharge from hospital to the community , 2010, Canadian Medical Association Journal.

[29]  Ali Idri,et al.  Knowledge discovery in cardiology: A systematic literature review , 2017, Int. J. Medical Informatics.

[30]  Arpana R. Vidyarthi,et al.  Redefining readmission risk factors for general medicine patients. , 2011, Journal of hospital medicine.

[31]  Smita Desai,et al.  Associations between physical activity and 30-day readmission risk in chronic obstructive pulmonary disease. , 2014, Annals of the American Thoracic Society.

[32]  Chad Bradford,et al.  Patient and clinical characteristics that heighten risk for heart failure readmission , 2017, Research in social & administrative pharmacy : RSAP.

[33]  A. Zwinderman,et al.  Factors influencing the predictive power of models for predicting mortality and/or heart failure hospitalization in patients with heart failure. , 2014, JACC. Heart failure.

[34]  George Hripcsak,et al.  The effects of data sources, cohort selection, and outcome definition on a predictive model of risk of thirty-day hospital readmissions , 2014, J. Biomed. Informatics.

[35]  Brant E Fries,et al.  Predicting risk of hospital and emergency department use for home care elderly persons through a secondary analysis of cross-national data , 2014, BMC Health Services Research.

[36]  A. David,et al.  Exploring the predictors of early readmission to psychiatric hospital , 2015, Epidemiology and Psychiatric Sciences.

[37]  Nan Liu,et al.  Predicting 30-Day Readmissions in an Asian Population: Building a Predictive Model by Incorporating Markers of Hospitalization Severity , 2016, PloS one.

[38]  Crystal Dea Moore,et al.  Predicting 30-day all-cause hospital readmissions , 2013, Health care management science.

[39]  Molly E Waring,et al.  Reliability of Predicting Early Hospital Readmission After Discharge for an Acute Coronary Syndrome Using Claims-Based Data. , 2016, The American journal of cardiology.

[40]  Leora I. Horwitz,et al.  Diagnoses and timing of 30-day readmissions after hospitalization for heart failure, acute myocardial infarction, or pneumonia. , 2013, JAMA.

[41]  Jerrold H. May,et al.  A mixed-ensemble model for hospital readmission , 2016, Artif. Intell. Medicine.

[42]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement , 2009, BMJ : British Medical Journal.

[43]  Andrew P. Bradley,et al.  The use of the area under the ROC curve in the evaluation of machine learning algorithms , 1997, Pattern Recognit..

[44]  Zosia Kmietowicz Hospitals will be fined for emergency readmissions, says Lansley , 2010, BMJ : British Medical Journal.

[45]  Julia O'Rourke,et al.  Linking electronic health record-extracted psychosocial data in real-time to risk of readmission for heart failure. , 2011, Psychosomatics.

[46]  LeeAnna Spiva,et al.  Validation of a Predictive Model to Identify Patients at High Risk for Hospital Readmission , 2016, Journal for healthcare quality : official publication of the National Association for Healthcare Quality.

[47]  Andrew K. C. Wong,et al.  Classification of Imbalanced Data: a Review , 2009, Int. J. Pattern Recognit. Artif. Intell..

[48]  Elliott Lowy,et al.  Predicting risk of hospitalization or death among patients with heart failure in the veterans health administration. , 2012, The American journal of cardiology.

[49]  Kensaku Kawamoto,et al.  A three-step approach for the derivation and validation of high-performing predictive models using an operational dataset: congestive heart failure readmission case study , 2014, BMC Medical Informatics and Decision Making.

[50]  Koen Milisen,et al.  Characteristics of older adults admitted to the emergency department (ED) and their risk factors for ED readmission based on comprehensive geriatric assessment: a prospective cohort study , 2015, BMC Geriatrics.

[51]  Hadi Kharrazi,et al.  Feasibility of 30-day hospital readmission prediction modeling based on health information exchange data , 2015, Int. J. Medical Informatics.

[52]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[53]  Chandan K. Reddy,et al.  Joint Impact of Clinical and Behavioral Variables on the Risk of Unplanned Readmission and Death after a Heart Failure Hospitalization , 2015, PloS one.

[54]  Michael R Gionfriddo,et al.  Preventing 30-day hospital readmissions: a systematic review and meta-analysis of randomized trials. , 2014, JAMA internal medicine.

[55]  I. Abbass,et al.  Predictors of all-cause 30 day readmission among Medicare patients with type 2 diabetes , 2017, Current medical research and opinion.

[56]  S. Negahban,et al.  Analysis of Machine Learning Techniques for Heart Failure Readmissions , 2016, Circulation. Cardiovascular quality and outcomes.

[57]  D. Tranfield,et al.  Towards a Methodology for Developing Evidence-Informed Management Knowledge by Means of Systematic Review , 2003 .

[58]  Johan Sundström,et al.  A tool for prediction of risk of rehospitalisation and mortality in the hospitalised elderly: secondary analysis of clinical trial data , 2015, BMJ Open.

[59]  Manuel Graña,et al.  Using Anticipative Hybrid Extreme Rotation Forest to predict emergency service readmission risk , 2017, J. Comput. Sci..

[60]  Harlan M Krumholz,et al.  Statistical models and patient predictors of readmission for heart failure: a systematic review. , 2008, Archives of internal medicine.

[61]  Mathias Wargon,et al.  Unscheduled-Return-Visits after an Emergency Department (ED) Attendance and Clinical Link between Both Visits in Patients Aged 75 Years and Over: A Prospective Observational Study , 2015, PloS one.

[62]  Richard Kaplan,et al.  An Electronic Medical Record-Based Model to Predict 30-Day Risk of Readmission and Death Among HIV-Infected Inpatients , 2012, Journal of acquired immune deficiency syndromes.

[63]  James E Graham,et al.  Predictors of 30-Day Readmission Following Inpatient Rehabilitation for Patients at High Risk for Hospital Readmission , 2015, Physical Therapy.

[64]  Patricia M Davidson,et al.  An Absolute Risk Prediction Model to Determine Unplanned Cardiovascular Readmissions for Adults with Chronic Heart Failure. , 2015, Heart, lung & circulation.

[65]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[66]  Mehdi Jamei,et al.  Predicting all-cause risk of 30-day hospital readmission using artificial neural networks , 2017, PloS one.

[67]  SfoungaristosStavros,et al.  A Novel Model to Predict the Risk of Readmission in Patients with Renal Colic , 2014 .

[68]  Lai Yin Wong,et al.  Risk Stratification Model for 30-Day Heart Failure Readmission in a Multiethnic South East Asian Community. , 2017, The American journal of cardiology.

[69]  Gregory M. Garrison,et al.  Predictors of Thirty-Day Readmission Among Hospitalized Family Medicine Patients , 2013, The Journal of the American Board of Family Medicine.

[70]  James J. Chen,et al.  Class-imbalanced classifiers for high-dimensional data , 2013, Briefings Bioinform..

[71]  Mohsen Mesgarpour,et al.  Ensemble Risk Model of Emergency Admissions (ERMER) , 2017, Int. J. Medical Informatics.

[72]  Sandeep Tripathi,et al.  PROPER: Development of an Early Pediatric Intensive Care Unit Readmission Risk Prediction Tool , 2018, Journal of intensive care medicine.

[73]  Manuel Graña,et al.  Emergency Department Readmission Risk Prediction: A Case Study in Chile , 2017, IWINAC.

[74]  Soundar Kumara,et al.  Predicting Patients at Risk for 3-Day Postdischarge Readmissions, ED Visits, and Deaths , 2016, Medical care.

[75]  S. Espinoza,et al.  Influence of Frailty‐Related Diagnoses, High‐Risk Prescribing in Elderly Adults, and Primary Care Use on Readmissions in Fewer than 30 Days for Veterans Aged 65 and Older , 2014, Journal of the American Geriatrics Society.

[76]  H. Bitterman,et al.  Predicting 30-Day Readmissions With Preadmission Electronic Health Record Data , 2015, Medical care.

[77]  Pramil Cheriyath,et al.  A prediction model for COPD readmissions: catching up, catching our breath, and improving a national problem , 2012, Journal of community hospital internal medicine perspectives.

[78]  Paola Berchialla,et al.  An Innovative Model to Predict Pediatric Emergency Department Return Visits , 2016, Pediatric emergency care.

[79]  T. Pawlik,et al.  A validated, risk assessment tool for predicting readmission after open ventral hernia repair , 2016, Hernia.

[80]  C. P. Wong,et al.  Development of an automated model to predict the risk of elderly emergency medical admissions within a month following an index hospital visit: A Hong Kong experience , 2015, Health Informatics J..

[81]  Mary Ann Anderson,et al.  Prediction of Early Readmission in Medical Inpatients Using the Probability of Repeated Admission Instrument , 2008, Nursing research.

[82]  David M Kent,et al.  Prediction model for 30-day hospital readmissions among patients discharged receiving outpatient parenteral antibiotic therapy. , 2014, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[83]  Amanda H. Salanitro,et al.  Risk prediction models for hospital readmission: a systematic review. , 2011, JAMA.

[84]  Sang Won Yoon,et al.  Predictive modeling of hospital readmissions using metaheuristics and data mining , 2015, Expert Syst. Appl..

[85]  J. B. Martin,et al.  Identification of factors associated with hospital readmission and development of a predictive model. , 1992, Health services research.

[86]  Xibiao Ye,et al.  Development and validation of a predictive model for all-cause hospital readmissions in Winnipeg, Canada , 2015, Journal of health services research & policy.

[87]  Sven F. Crone,et al.  Instance sampling in credit scoring: An empirical study of sample size and balancing , 2012 .

[88]  Xiongcai Cai,et al.  Real-time prediction of mortality, readmission, and length of stay using electronic health record data , 2016, J. Am. Medical Informatics Assoc..

[89]  Javier Llorca,et al.  Prediction of 30-day cardiac-related-emergency-readmissions using simple administrative hospital data. , 2013, International journal of cardiology.

[90]  Jean-François Timsit,et al.  A model to predict short-term death or readmission after intensive care unit discharge. , 2012, Journal of critical care.

[91]  S Greenland,et al.  Modeling and variable selection in epidemiologic analysis. , 1989, American journal of public health.

[92]  Wojciech Zareba,et al.  Prior hospital admission predicts thirty-day hospital readmission for heart failure patients. , 2016, Cardiology journal.

[93]  Joseph Futoma,et al.  A comparison of models for predicting early hospital readmissions , 2015, J. Biomed. Informatics.

[94]  James Nguyen,et al.  Incidence and predictors of 30-day readmission among patients hospitalized for advanced liver disease. , 2011, Clinical gastroenterology and hepatology : the official clinical practice journal of the American Gastroenterological Association.

[95]  Thomas Oommen,et al.  Sampling Bias and Class Imbalance in Maximum-likelihood Logistic Regression , 2011 .

[96]  Nathan Herrmann,et al.  READMIT: a clinical risk index to predict 30-day readmission after discharge from acute psychiatric units. , 2015, Journal of psychiatric research.

[97]  John Billings,et al.  Development of a predictive model to identify inpatients at risk of re-admission within 30 days of discharge (PARR-30) , 2012, BMJ Open.