Prediction models for hospital readmissions in patients with heart disease: a systematic review and meta-analysis

Objective To describe the discrimination and calibration of clinical prediction models, identify characteristics that contribute to better predictions and investigate predictors that are associated with unplanned hospital readmissions. Design Systematic review and meta-analysis. Data source Medline, EMBASE, ICTPR (for study protocols) and Web of Science (for conference proceedings) were searched up to 25 August 2020. Eligibility criteria for selecting studies Studies were eligible if they reported on (1) hospitalised adult patients with acute heart disease; (2) a clinical presentation of prediction models with c-statistic; (3) unplanned hospital readmission within 6 months. Primary and secondary outcome measures Model discrimination for unplanned hospital readmission within 6 months measured using concordance (c) statistics and model calibration. Meta-regression and subgroup analyses were performed to investigate predefined sources of heterogeneity. Outcome measures from models reported in multiple independent cohorts and similarly defined risk predictors were pooled. Results Sixty studies describing 81 models were included: 43 models were newly developed, and 38 were externally validated. Included populations were mainly patients with heart failure (HF) (n=29). The average age ranged between 56.5 and 84 years. The incidence of readmission ranged from 3% to 43%. Risk of bias (RoB) was high in almost all studies. The c-statistic was <0.7 in 72 models, between 0.7 and 0.8 in 16 models and >0.8 in 5 models. The study population, data source and number of predictors were significant moderators for the discrimination. Calibration was reported for 27 models. Only the GRACE (Global Registration of Acute Coronary Events) score had adequate discrimination in independent cohorts (0.78, 95% CI 0.63 to 0.86). Eighteen predictors were pooled. Conclusion Some promising models require updating and validation before use in clinical practice. The lack of independent validation studies, high RoB and low consistency in measured predictors limit their applicability. PROSPERO registration number CRD42020159839.

[1]  Elham Mahmoudi,et al.  Use of electronic medical records in development and validation of risk prediction models of hospital readmission: systematic review , 2020, BMJ.

[2]  J. Hermiller,et al.  Predictors and risk calculator of early unplanned hospital readmission following contemporary self-expanding transcatheter aortic valve replacement from the STS/ACC TVT-registry. , 2020, Cardiovascular revascularization medicine : including molecular interventions.

[3]  Francesca N. Delling,et al.  Heart Disease and Stroke Statistics—2020 Update: A Report From the American Heart Association , 2020, Circulation.

[4]  G. D. Di Tanna,et al.  Evaluating risk prediction models for adults with heart failure: A systematic literature review , 2020, PloS one.

[5]  D. Kolte,et al.  Risk Calculator to Predict 30-Day Readmission After Coronary Artery Bypass: A Strategic Decision Support Tool. , 2019, Heart, lung & circulation.

[6]  R. Robinson,et al.  HOSPITAL Score, LACE Index and LACE+ Index as predictors of 30-day readmission in patients with heart failure , 2019, BMJ Evidence-Based Medicine.

[7]  F. Fernández‐Avilés,et al.  Patient-Associated Predictors of 15- and 30-Day Readmission After Hospitalization for Acute Heart Failure , 2019, Current Heart Failure Reports.

[8]  J. Mehaffey,et al.  Examination of a Proposed 30-Day Readmission Risk Score on Discharge Location and Cost. , 2019, The Annals of thoracic surgery.

[9]  Bo-yu Tan,et al.  Electronic medical record-based model to predict the risk of 90-day readmission for patients with heart failure , 2019, BMC Medical Informatics and Decision Making.

[10]  Deepak L. Bhatt,et al.  Derivation and external validation of a simple risk tool to predict 30-day hospital readmissions after transcatheter aortic valve replacement. , 2019, EuroIntervention : journal of EuroPCR in collaboration with the Working Group on Interventional Cardiology of the European Society of Cardiology.

[11]  M. Tinetti,et al.  Thirty-Day Readmission Risk Model for Older Adults Hospitalized With Acute Myocardial Infarction. , 2019, Circulation. Cardiovascular quality and outcomes.

[12]  J. Binongo,et al.  Predicted Risk of Mortality Score predicts 30-day readmission after coronary artery bypass grafting , 2019, General Thoracic and Cardiovascular Surgery.

[13]  A. Bayés‐Genís,et al.  Risk Estimation in Type 2 Myocardial Infarction and Myocardial Injury: The TARRACO Risk Score. , 2019, The American journal of medicine.

[14]  M. Cho,et al.  Risk prediction for 30-day heart failure-specific readmission or death after discharge: Data from the Korean Acute Heart Failure (KorAHF) registry. , 2019, Journal of cardiology.

[15]  S. Deppen,et al.  Developing prediction models for clinical use using logistic regression: an overview. , 2019, Journal of thoracic disease.

[16]  K. Moons,et al.  Electronic healthcare records and prognosis research , 2019, Prognosis Research in Health Care.

[17]  J. Tu,et al.  A Clinical Risk Scoring Tool to Predict Readmission After Cardiac Surgery: An Ontario Administrative and Clinical Population Database Study. , 2018, The Canadian journal of cardiology.

[18]  Jeremiah R. Brown,et al.  Utility of Biomarkers to Improve Prediction of Readmission or Mortality After Cardiac Surgery. , 2018, The Annals of thoracic surgery.

[19]  J. Spertus,et al.  Clinical Model to Predict 90-Day Risk of Readmission After Acute Myocardial Infarction: A Report From the National Cardiovascular Data Registry ACTION Registry , 2018, Circulation. Cardiovascular quality and outcomes.

[20]  Deborah H Ward,et al.  Predictive models for identifying risk of readmission after index hospitalization for heart failure: A systematic review , 2018, European journal of cardiovascular nursing : journal of the Working Group on Cardiovascular Nursing of the European Society of Cardiology.

[21]  P. Austin,et al.  A clinical decision instrument to predict 30‐day death and cardiovascular hospitalizations after an emergency department visit for atrial fibrillation: The Atrial Fibrillation in the Emergency Room, Part 2 (AFTER2) study , 2018, American heart journal.

[22]  S. Collins,et al.  Customizing national models for a medical center's population to rapidly identify patients at high risk of 30‐day all‐cause hospital readmission following a heart failure hospitalization , 2018, Heart & lung : the journal of critical care.

[23]  S. Kimmel,et al.  Incorporating patient‐centered factors into heart failure readmission risk prediction: A mixed‐methods study , 2018, American heart journal.

[24]  D. Lappé,et al.  Predicting readmission risk shortly after admission for CABG surgery , 2018, Journal of cardiac surgery.

[25]  T. Marwick,et al.  Validation of Predictive Score of 30-Day Hospital Readmission or Death in Patients With Heart Failure. , 2018, The American journal of cardiology.

[26]  S. Body,et al.  A Pragmatic Preoperative Prediction Score for Nonhome Discharge After Cardiac Operations. , 2017, The Annals of thoracic surgery.

[27]  Christine S. M. Lau,et al.  Preoperative Scale to Determine All-Cause Readmission After Coronary Artery Bypass Operations. , 2017, The Annals of thoracic surgery.

[28]  D. A. Foley,et al.  Family Help With Medication Management: A Predictive Marker for Early Readmission , 2017, Mayo Clinic proceedings. Innovations, quality & outcomes.

[29]  K. Izawa,et al.  Relationship between Activities of Daily Living and Readmission within 90 Days in Hospitalized Elderly Patients with Heart Failure , 2017, BioMed research international.

[30]  P. Patel,et al.  Atrial fibrillation: Utility of CHADS2 and CHA2DS2-VASc scores as predictors of readmission, mortality and resource utilization. , 2017, International journal of cardiology.

[31]  F. Formiga,et al.  Applicability of the heart failure Readmission Risk score: A first European study. , 2017, International journal of cardiology.

[32]  Lai Yin Wong,et al.  Risk Stratification Model for 30-Day Heart Failure Readmission in a Multiethnic South East Asian Community. , 2017, The American journal of cardiology.

[33]  J. Herrin,et al.  Development and validation of a simple risk score to predict 30‐day readmission after percutaneous coronary intervention in a cohort of medicare patients , 2017, Catheterization and cardiovascular interventions : official journal of the Society for Cardiac Angiography & Interventions.

[34]  Grant S. Fletcher,et al.  The HOSPITAL Score Predicts Potentially Preventable 30-Day Readmissions in Conditions Targeted by the Hospital Readmissions Reduction Program , 2017, Medical care.

[35]  Li Liang,et al.  Prediction of 30-Day All-Cause Readmissions in Patients Hospitalized for Heart Failure: Comparison of Machine Learning and Other Statistical Approaches , 2017, JAMA cardiology.

[36]  A. Phrommintikul,et al.  The prognostic utility of GRACE risk score in predictive cardiovascular event rate in STEMI patients with successful fibrinolysis and delay intervention in non PCI-capable hospital: a retrospective cohort study , 2016, BMC Cardiovascular Disorders.

[37]  S. Lee,et al.  Utility of the LACE index at the bedside in predicting 30-day readmission or death in patients hospitalized with heart failure. , 2016, American heart journal.

[38]  David M. Kent,et al.  Development and Validation of a Predictive Model for Short‐ and Medium‐Term Hospital Readmission Following Heart Valve Surgery , 2016, Journal of the American Heart Association.

[39]  F. Piccinini,et al.  30-day readmission score after cardiac surgery , 2016 .

[40]  Yi Dong,et al.  A prediction model to identify acute myocardial infarction (AMI) patients at risk for 30-day readmission , 2016, SummerSim.

[41]  S. Dhaliwal,et al.  Utility of models to predict 28-day or 30-day unplanned hospital readmissions: an updated systematic review , 2016, BMJ Open.

[42]  Pamela A Shaw,et al.  EVALUATING RISK-PREDICTION MODELS USING DATA FROM ELECTRONIC HEALTH RECORDS. , 2016, The annals of applied statistics.

[43]  K. Bowles,et al.  Patient Characteristics Predicting Readmission Among Individuals Hospitalized for Heart Failure , 2016, Medical care research and review : MCRR.

[44]  Patricia M Davidson,et al.  An Absolute Risk Prediction Model to Determine Unplanned Cardiovascular Readmissions for Adults with Chronic Heart Failure. , 2015, Heart, lung & circulation.

[45]  Gulshan Sharma,et al.  Validation of the Readmission Risk Score in Heart Failure Patients at a Tertiary Hospital. , 2015, Journal of cardiac failure.

[46]  S. Raposeiras-Roubín,et al.  Mortality and cardiovascular morbidity within 30 days of discharge following acute coronary syndrome in a contemporary European cohort of patients: How can early risk prediction be improved? The six-month GRACE risk score. , 2015, Revista portuguesa de cardiologia : orgao oficial da Sociedade Portuguesa de Cardiologia = Portuguese journal of cardiology : an official journal of the Portuguese Society of Cardiology.

[47]  Indranil R. Bardhan,et al.  Predictive Analytics for Readmission of Patients with Congestive Heart Failure , 2015, Inf. Syst. Res..

[48]  J. DiNicolantonio,et al.  Thirty-day readmission rates after PCI in a metropolitan center in Europe: incidence and impact on prognosis , 2015, Journal of cardiovascular medicine.

[49]  Craig R. Smith,et al.  Uniform standards do not apply to readmission following coronary artery bypass surgery: a multi-institutional study. , 2015, The Journal of thoracic and cardiovascular surgery.

[50]  Gary S Collins,et al.  Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD Statement , 2015, BMC Medicine.

[51]  G. Collins,et al.  Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD Statement , 2015, BMC medicine.

[52]  S. Rana,et al.  Predicting unplanned readmission after myocardial infarction from routinely collected administrative hospital data. , 2014, Australian health review : a publication of the Australian Hospital Association.

[53]  Scott Zasadil,et al.  Using Decision Trees to Manage Hospital Readmission Risk for Acute Myocardial Infarction, Heart Failure, and Pneumonia , 2014, Applied Health Economics and Health Policy.

[54]  Hao Wang,et al.  Using the LACE index to predict hospital readmissions in congestive heart failure patients , 2014, BMC Cardiovascular Disorders.

[55]  Prashanth Katrapati,et al.  Impact of prior admissions on 30-day readmissions in medicare heart failure inpatients. , 2014, Mayo Clinic proceedings.

[56]  J. Reed,et al.  Unplanned Readmissions after Hospital Discharge among Heart Failure Patients At Risk for 30-Day Readmission Using an Administrative Dataset and “Off the Shelf” Readmission Models , 2014 .

[57]  Mark Woodward,et al.  Risk prediction in patients with heart failure: a systematic review and analysis. , 2014, JACC. Heart failure.

[58]  Y. Pinto,et al.  A novel discharge risk model for patients hospitalised for acute decompensated heart failure incorporating N-terminal pro-B-type natriuretic peptide levels: a European coLlaboration on Acute decompeNsated Heart Failure: ÉLAN-HF Score , 2013, Heart.

[59]  Sharon-Lise T Normand,et al.  A Prediction Model to Identify Patients at High Risk for 30-Day Readmission After Percutaneous Coronary Intervention , 2013, Circulation. Cardiovascular quality and outcomes.

[60]  R. Habib,et al.  Use of genetic programming, logistic regression, and artificial neural nets to predict readmission after coronary artery bypass surgery , 2013, Journal of Clinical Monitoring and Computing.

[61]  Carl van Walraven,et al.  Predicting the risk of unplanned readmission or death within 30 days of discharge after a heart failure hospitalization. , 2012, American heart journal.

[62]  Patricia M Davidson,et al.  What are the factors in risk prediction models for rehospitalisation for adults with chronic heart failure? , 2012, Australian critical care : official journal of the Confederation of Australian Critical Care Nurses.

[63]  Kathleen F Kerr,et al.  Joint Modeling, Covariate Adjustment, and Interaction: Contrasting Notions in Risk Prediction Models and Risk Prediction Performance , 2011, Epidemiology.

[64]  Harlan M. Krumholz,et al.  An Administrative Claims Measure Suitable for Profiling Hospital Performance Based on 30-Day All-Cause Readmission Rates Among Patients With Acute Myocardial Infarction , 2011, Circulation. Cardiovascular quality and outcomes.

[65]  C. Yancy,et al.  Incremental Value of Clinical Data Beyond Claims Data in Predicting 30-Day Outcomes After Heart Failure Hospitalization , 2011, Circulation. Cardiovascular quality and outcomes.

[66]  Y. Tabak,et al.  An Automated Model to Identify Heart Failure Patients at Risk for 30-Day Readmission or Death Using Electronic Medical Record Data , 2010, Medical care.

[67]  M. Desai,et al.  Statistical Models and Patient Predictors of Readmission for Acute Myocardial Infarction: A Systematic Review , 2009, Circulation. Cardiovascular quality and outcomes.

[68]  Sharon-Lise T. Normand,et al.  An Administrative Claims Measure Suitable for Profiling Hospital Performance on the Basis of 30-Day All-Cause Readmission Rates Among Patients With Heart Failure , 2008, Circulation. Cardiovascular quality and outcomes.

[69]  Harlan M Krumholz,et al.  Statistical models and patient predictors of readmission for heart failure: a systematic review. , 2008, Archives of internal medicine.

[70]  R. Newcombe,et al.  Confidence intervals for an effect size measure based on the Mann–Whitney statistic. Part 2: asymptotic methods and evaluation , 2006, Statistics in medicine.

[71]  R. Harmon,et al.  Risk factors for early hospital readmission after cardiac operations. , 2001, The Journal of thoracic and cardiovascular surgery.

[72]  E Simchen,et al.  Prediction of readmissions after CABG using detailed follow-up data: the Israeli CABG Study (ISCAB) , 1999, Medical care.

[73]  R. Goldberg,et al.  Predicting 30-day mortality and 30-day re-hospitalization risks in Medicare patients with heart failure discharged to skilled nursing facilities: development and validation of models using administrative data. , 2019, The journal of nursing home research sciences.

[74]  G. Collins,et al.  PROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies , 2019, Annals of Internal Medicine.

[75]  E. Halm,et al.  Acute Myocardial Infarction Readmission Risk Prediction Models: A Systematic Review of Model Performance , 2018, Circulation. Cardiovascular quality and outcomes.

[76]  J. Conte,et al.  Development and Validation of a Score to Predict the Risk of Readmission After Adult Cardiac Operations. , 2017, The Annals of thoracic surgery.

[77]  D. Haines,et al.  Preoperative ICD risk score variables predict 30-day readmission after implantable cardioverter defibrillator implantation in patients with heart failure. , 2016, Heart & lung : the journal of critical care.

[78]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. , 2010, International journal of surgery.

[79]  K R Abrams,et al.  Methods for exploring heterogeneity in meta-analysis. , 2001, Evaluation & the health professions.