Systematic review of prognostic prediction models for acute kidney injury (AKI) in general hospital populations

Objective Critically appraise prediction models for hospital-acquired acute kidney injury (HA-AKI) in general populations. Design Systematic review. Data sources Medline, Embase and Web of Science until November 2016. Eligibility Studies describing development of a multivariable model for predicting HA-AKI in non-specialised adult hospital populations. Published guidance followed for data extraction reporting and appraisal. Results 14 046 references were screened. Of 53 HA-AKI prediction models, 11 met inclusion criteria (general medicine and/or surgery populations, 474 478 patient episodes) and five externally validated. The most common predictors were age (n=9 models), diabetes (5), admission serum creatinine (SCr) (5), chronic kidney disease (CKD) (4), drugs (diuretics (4) and/or ACE inhibitors/angiotensin-receptor blockers (3)), bicarbonate and heart failure (4 models each). Heterogeneity was identified for outcome definition. Deficiencies in reporting included handling of predictors, missing data and sample size. Admission SCr was frequently taken to represent baseline renal function. Most models were considered at high risk of bias. Area under the receiver operating characteristic curves to predict HA-AKI ranged 0.71–0.80 in derivation (reported in 8/11 studies), 0.66–0.80 for internal validation studies (n=7) and 0.65–0.71 in five external validations. For calibration, the Hosmer-Lemeshow test or a calibration plot was provided in 4/11 derivations, 3/11 internal and 3/5 external validations. A minority of the models allow easy bedside calculation and potential electronic automation. No impact analysis studies were found. Conclusions AKI prediction models may help address shortcomings in risk assessment; however, in general hospital populations, few have external validation. Similar predictors reflect an elderly demographic with chronic comorbidities. Reporting deficiencies mirrors prediction research more broadly, with handling of SCr (baseline function and use as a predictor) a concern. Future research should focus on validation, exploration of electronic linkage and impact analysis. The latter could combine a prediction model with AKI alerting to address prevention and early recognition of evolving AKI.

[1]  F. Mosteller,et al.  A comparison of results of meta-analyses of randomized control trials and recommendations of clinical experts. Treatments for myocardial infarction. , 1992, JAMA.

[2]  John P A Ioannidis,et al.  Almost all articles on cancer prognostic markers report statistically significant results. , 2007, European journal of cancer.

[3]  Raymond Vanholder,et al.  International Society of Nephrology's 0by25 initiative for acute kidney injury (zero preventable deaths by 2025): a human rights case for nephrology , 2015, The Lancet.

[4]  A. Khwaja KDIGO Clinical Practice Guidelines for Acute Kidney Injury , 2012, Nephron Clinical Practice.

[5]  L. Hooft,et al.  A guide to systematic review and meta-analysis of prediction model performance , 2017, British Medical Journal.

[6]  Chirag R Parikh,et al.  Predicting acute kidney injury after cardiac surgery: a systematic review. , 2012, The Annals of thoracic surgery.

[7]  Joshua C Denny,et al.  Development of Inpatient Risk Stratification Models of Acute Kidney Injury for Use in Electronic Health Records , 2010, Medical decision making : an international journal of the Society for Medical Decision Making.

[8]  L. Forni,et al.  Predicting AKI in emergency admissions: an external validation study of the acute kidney injury prediction score (APS) , 2017, BMJ Open.

[9]  Andre Kushniruk,et al.  A Framework for Usable and Effective Clinical Decision Support: Experience from the iCPR Randomized Clinical Trial , 2015, EGEMS.

[10]  Patrick Royston,et al.  Reporting methods in studies developing prognostic models in cancer: a review , 2010, BMC medicine.

[11]  R. Miller,et al.  Predicting Hospital-Acquired Acute Kidney Injury—A Case-Controlled Study , 2008, Renal failure.

[12]  Jennifer G. Robinson,et al.  2013 ACC/AHA Guideline on the Assessment of Cardiovascular Risk: A Report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines , 2014, Circulation.

[13]  Kelly Zarnke,et al.  Risk prediction models for acute kidney injury following major noncardiac surgery: systematic review. , 2015, Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association - European Renal Association.

[14]  Kensaku Kawamoto,et al.  Systematic review of clinical decision support interventions with potential for inpatient cost reduction , 2013, BMC Medical Informatics and Decision Making.

[15]  G. Collins,et al.  Developing risk prediction models for type 2 diabetes: a systematic review of methodology and reporting , 2011, BMC medicine.

[16]  P. Efron,et al.  National Surgical Quality Improvement Program Underestimates the Risk Associated With Mild and Moderate Postoperative Acute Kidney Injury , 2013, Critical care medicine.

[17]  Z. Harel,et al.  Risk prediction models for contrast induced nephropathy: systematic review , 2015, BMJ : British Medical Journal.

[18]  Douglas G Altman,et al.  Systematic reviews of evaluations of prognostic variables , 2001, BMJ : British Medical Journal.

[19]  A. Phillips,et al.  Epidemiology and outcomes in community-acquired versus hospital-acquired AKI. , 2014, Clinical journal of the American Society of Nephrology : CJASN.

[20]  Simon Coulton,et al.  Development of risk models for the prediction of new or worsening acute kidney injury on or during hospital admission: a cohort and nested study , 2016 .

[21]  Zhangsuo Liu,et al.  Epidemiology and Clinical Correlates of AKI in Chinese Hospitalized Adults. , 2015, Clinical journal of the American Society of Nephrology : CJASN.

[22]  Matthew M Churpek,et al.  Development of a Multicenter Ward-Based AKI Prediction Model. , 2016, Clinical journal of the American Society of Nephrology : CJASN.

[23]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. , 2010, International journal of surgery.

[24]  J. Zimmerman,et al.  Assessing the calibration of mortality benchmarks in critical care: The Hosmer-Lemeshow test revisited* , 2007, Critical care medicine.

[25]  M. Rosner,et al.  Acute kidney injury. , 2009, Current drug targets.

[26]  N. Kolhe,et al.  Use of electronic results reporting to diagnose and monitor AKI in hospitalized patients. , 2012, Clinical journal of the American Society of Nephrology : CJASN.

[27]  E. Elkin,et al.  Decision Curve Analysis: A Novel Method for Evaluating Prediction Models , 2006, Medical decision making : an international journal of the Society for Medical Decision Making.

[28]  K. Wyssusek,et al.  Acute Kidney Injury following Liver Transplantation: A Systematic Review of Published Predictive Models , 2016, Anaesthesia and intensive care.

[29]  K. Tremper,et al.  Predictors of Postoperative Acute Renal Failure after Noncardiac Surgery in Patients with Previously Normal Renal Function , 2007, Anesthesiology.

[30]  Y. Vergouwe,et al.  Validation, updating and impact of clinical prediction rules: a review. , 2008, Journal of clinical epidemiology.

[31]  G. Prescott,et al.  KDIGO-based acute kidney injury criteria operate differently in hospitals and the community—findings from a large population cohort , 2016, Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association - European Renal Association.

[32]  M. Leeflang,et al.  Search Filters for Finding Prognostic and Diagnostic Prediction Studies in Medline to Enhance Systematic Reviews , 2012, PloS one.

[33]  R. Bellomo,et al.  Acute renal failure: time for consensus , 2001, Intensive Care Medicine.

[34]  P. Donnan,et al.  Risk of postoperative acute kidney injury in patients undergoing orthopaedic surgery—development and validation of a risk score and effect of acute kidney injury on survival: observational cohort study , 2015, BMJ : British Medical Journal.

[35]  G. Collins,et al.  Critical Appraisal and Data Extraction for Systematic Reviews of Prediction Modelling Studies: The CHARMS Checklist , 2014, PLoS medicine.

[36]  I. Koulouridis,et al.  World incidence of AKI: a meta-analysis. , 2013, Clinical journal of the American Society of Nephrology : CJASN.

[37]  Lui G. Forni,et al.  Identifying the Patient at Risk of Acute Kidney Injury: A Predictive Scoring System for the Development of Acute Kidney Injury in Acute Medical Patients , 2013, Nephron Clinical Practice.

[38]  Silvia Rabar,et al.  Risk assessment of fragility fractures: summary of NICE guidance , 2012, BMJ : British Medical Journal.

[39]  Trisha Greenhalgh,et al.  Risk models and scores for type 2 diabetes: systematic review , 2011, BMJ : British Medical Journal.

[40]  Amit X. Garg,et al.  MEDLINE clinical queries are robust when searching in recent publishing years , 2013, J. Am. Medical Informatics Assoc..

[41]  K. Tremper,et al.  Development and Validation of an Acute Kidney Injury Risk Index for Patients Undergoing General Surgery: Results from a National Data Set , 2009, Anesthesiology.

[42]  C. Mueller,et al.  Effect and clinical prediction of worsening renal function in acute decompensated heart failure. , 2011, The American journal of cardiology.

[43]  C. O'connor,et al.  Incidence, predictors at admission, and impact of worsening renal function among patients hospitalized with heart failure. , 2004, Journal of the American College of Cardiology.

[44]  Gary S Collins,et al.  Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): Explanation and Elaboration , 2015, Annals of Internal Medicine.

[45]  John A. Kellum,et al.  Acute kidney injury , 2008, Critical care medicine.

[46]  E. Balas,et al.  Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success , 2005, BMJ : British Medical Journal.

[47]  N. Cook Use and Misuse of the Receiver Operating Characteristic Curve in Risk Prediction , 2007, Circulation.

[48]  S. Bagshaw,et al.  Conventional markers of kidney function , 2008, Critical care medicine.

[49]  Tong Yue,et al.  Derivation and validation of a prediction score for acute kidney injury in patients hospitalized with acute heart failure in a Chinese cohort , 2013, Nephrology.

[50]  Jesper Hallas,et al.  Nurses and Physicians in a Medical Admission Unit Can Accurately Predict Mortality of Acutely Admitted Patients: A Prospective Cohort Study , 2014, PloS one.

[51]  E. Steyerberg,et al.  Reporting and Methods in Clinical Prediction Research: A Systematic Review , 2012, PLoS medicine.

[52]  N. Kolhe,et al.  A simple care bundle for use in acute kidney injury: a propensity score-matched cohort study. , 2016, Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association - European Renal Association.

[53]  Jennifer G. Robinson,et al.  2013 ACC/AHA Guideline on the Assessment of Cardiovascular Risk: A Report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines , 2014, Circulation.

[54]  J. Concato,et al.  Importance of events per independent variable in proportional hazards regression analysis. II. Accuracy and precision of regression estimates. , 1995, Journal of clinical epidemiology.

[55]  Holger J Schünemann,et al.  Mortality predictions in the intensive care unit: Comparing physicians with scoring systems* , 2006, Critical care medicine.

[56]  Richard D Riley,et al.  University of Birmingham A systematic review of prognostic models for recurrent venous thromboembolism (VTE) post treatment of first unprovoked VTE , 2016 .

[57]  N. Kolhe,et al.  Impact of Compliance with a Care Bundle on Acute Kidney Injury Outcomes: A Prospective Observational Study , 2015, PloS one.

[58]  Harold I Feldman,et al.  Automated, electronic alerts for acute kidney injury: a single-blind, parallel-group, randomised controlled trial , 2015, The Lancet.

[59]  T. Stijnen,et al.  Review: a gentle introduction to imputation of missing values. , 2006, Journal of clinical epidemiology.

[60]  P. Kimmel,et al.  Furosemide Stress Test and Biomarkers for the Prediction of AKI Severity. , 2015, Journal of the American Society of Nephrology : JASN.

[61]  Richard D Riley,et al.  External validation of clinical prediction models using big datasets from e-health records or IPD meta-analysis: opportunities and challenges , 2016, BMJ.

[62]  M. Devonald,et al.  A real-time electronic alert to improve detection of acute kidney injury in a large teaching hospital. , 2014, Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association - European Renal Association.

[63]  J. Kellum,et al.  Current Use of Biomarkers in Acute Kidney Injury: Report and Summary of Recommendations from the 10th Acute Dialysis Quality Initiative Consensus Conference , 2013, Kidney international.

[64]  Nils Lid Hjort,et al.  Goodness‐of‐fit processes for logistic regression: simulation results , 2002, Statistics in medicine.

[65]  G. Guyatt,et al.  The Science of Reviewing Research a , 1993, Annals of the New York Academy of Sciences.