A machine learning model for predicting risk of hospital readmission within 30 days of discharge: validated with LACE index and patient at risk of hospital readmission (PARR) model

The objective of this study was to design and develop a predictive model for 30-day risk of hospital readmission using machine learning techniques. The proposed predictive model was then validated with the two most commonly used risk of readmission models: LACE index and patient at risk of hospital readmission (PARR). The study cohort consisted of 180,118 admissions with 22,565 (12.5%) of actual readmissions within 30 days of hospital discharge, from 01 Jan 2015 to 31 Dec 2016 from two Auckland-region hospitals. We developed a machine learning model to predict 30-day readmissions using the model types XGBoost, Random Forests, and Adaboost with decision stumps as a base learner with different feature combinations and preprocessing procedures. The proposed model achieved the F1-score (0.386 ± 0.006), sensitivity (0.598 ± 0.013), positive predictive value (PPV) (0.285 ± 0.004), and negative predictive value (NPV) (0.932 ± 0.002). When compared with LACE and PARR(NZ) models, the proposed model achieved better F1-score by 12.7% compared with LACE and 23.2% compared with PARR(NZ). The mean sensitivity of the proposed model was 6.0% higher than LACE and 41% higher than PARR(NZ). The mean PPV was 15.9% and 14.6% higher than LACE and PARR(NZ) respectively. We presented an all-cause predictive model for 30-day risk of hospital readmission with an area under the receiver operating characteristics (AUROC) of 0.75 for the entire dataset. Graphical abstract

[1]  John Billings,et al.  Development of a predictive model to identify inpatients at risk of re-admission within 30 days of discharge (PARR-30) , 2012, BMJ Open.

[2]  Rhema Vaithianathan,et al.  A Model for Predicting Readmission Risk in New Zealand , 2012 .

[3]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[4]  Susan Fowler,et al.  Risk factors and screening instruments to predict adverse outcomes for undifferentiated older emergency department patients: a systematic review and meta-analysis. , 2015, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[5]  Martial Hebert,et al.  Learning message-passing inference machines for structured prediction , 2011, CVPR 2011.

[6]  Carl van Walraven,et al.  Predicting post-discharge death or readmission: deterioration of model performance in population having multiple admissions per patient. , 2013, Journal of evaluation in clinical practice.

[7]  E. Yeoh,et al.  Measuring and preventing potentially avoidable hospital readmissions: a review of the literature. , 2010, Hong Kong medical journal = Xianggang yi xue za zhi.

[8]  J. J. Holloway,et al.  Factors influencing read mission risk: Implications for quality monitoring , 1989, Health care financing review.

[9]  Alain Cariou,et al.  Delayed awakening after cardiac arrest: prevalence and risk factors in the Parisian registry , 2016, Intensive Care Medicine.

[10]  E. Coleman,et al.  Age trends in 30 day hospital readmissions: US national retrospective analysis , 2018, British Medical Journal.

[11]  Yashar Maali,et al.  Predicting 7-day, 30-day and 60-day all-cause unplanned readmission: a case study of a Sydney hospital , 2018, BMC Medical Informatics and Decision Making.

[12]  Amanda H. Salanitro,et al.  Risk prediction models for hospital readmission: a systematic review. , 2011, JAMA.

[13]  Crystal Dea Moore,et al.  Predicting 30-day all-cause hospital readmissions , 2013, Health care management science.

[14]  Dayne Freitag,et al.  Machine Learning for Information Extraction in Informal Domains , 2000, Machine Learning.

[15]  P. Austin,et al.  Derivation and validation of an index to predict early death or unplanned readmission after discharge from hospital to the community , 2010, Canadian Medical Association Journal.

[16]  N Mays,et al.  New Zealand's new health sector reforms: back to the future? , 2001, BMJ : British Medical Journal.

[17]  Tim Kendall,et al.  Predicting suicide following self-harm: systematic review of risk factors and risk scales. , 2016, The British journal of psychiatry : the journal of mental science.

[18]  C. Yancy,et al.  Relationship between early physician follow-up and 30-day readmission among Medicare beneficiaries hospitalized for heart failure. , 2010, JAMA.

[19]  Jeffrey Dean,et al.  Scalable and accurate deep learning with electronic health records , 2018, npj Digital Medicine.

[20]  Harlan M Krumholz,et al.  The performance of US hospitals as reflected in risk-standardized 30-day mortality and readmission rates for medicare beneficiaries with pneumonia. , 2010, Journal of hospital medicine.

[21]  Phil Hider,et al.  The validity of readmission rate as a marker of the quality of hospital care, and a recommendation for its definition. , 2009, The New Zealand medical journal.

[22]  Darius M Moshfeghi,et al.  Risk factors predictive of endogenous endophthalmitis among hospitalized patients with hematogenous infections in the United States. , 2015, American journal of ophthalmology.

[23]  Nick Wilson,et al.  Updated New Zealand health system cost estimates from health events by sex, age and proximity to death: further improvements in the age of 'big data'. , 2015, The New Zealand medical journal.

[24]  Peter Nightingale,et al.  Hospital acquired Acute Kidney Injury is associated with increased mortality but not increased readmission rates in a UK acute hospital , 2017, BMC Nephrology.

[25]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[26]  Alex Bottle,et al.  Factors Associated With 30-Day Readmission After Primary Total Hip Arthroplasty: Analysis of 514 455 Procedures in the UK National Health Service , 2017, JAMA surgery.

[27]  Carl van Walraven Md MSc Senior Scientist Adjunct Scientist,et al.  Predicting post-discharge death or readmission: deterioration of model performance in population having multiple admissions per patient , 2012 .

[28]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.