Development of Inpatient Risk Stratification Models of Acute Kidney Injury for Use in Electronic Health Records

Objective. Patients with hospital-acquired acute kidney injury (AKI) are at risk for increased mortality and further medical complications. Evaluating these patients with a prediction tool easily implemented within an electronic health record (EHR) would identify high-risk patients prior to the development of AKI and could prevent iatrogenically induced episodes of AKI and improve clinical management. Methods. The authors used structured clinical data acquired from an EHR to identify patients with normal kidney function for admissions from 1 August 1999 to 31 July 2003. Using administrative, computerized provider order entry and laboratory test data, they developed a 3-level risk stratification model to predict each of 2 severity levels of in-hospital AKI as defined by RIFLE criteria. The severity levels were defined as 150% or 200% of baseline serum creatinine. Model discrimination and calibration were evaluated using 10-fold cross-validation. Results. Cross-validation of the models resulted in area under the receiver operating characteristic (AUC) curves of 0.75 (150% elevation) and 0.78 (200% elevation). Both models were adequately calibrated as measured by the Hosmer-Lemeshow goodness-of-fit test chi-squared values of 9.7 (P = 0.29) and 12.7 (P = 0.12), respectively. Conclusions. The authors generated risk prediction models for hospital-acquired AKI using only commonly available electronic data. The models identify patients at high risk for AKI who might benefit from early intervention or increased monitoring.

[1]  J. Vincent,et al.  Has mortality from acute renal failure decreased? A systematic review of the literature. , 2005, The American journal of medicine.

[2]  G. Van den Berghe,et al.  Tight blood glucose control is renoprotective in critically ill patients. , 2008, Journal of the American Society of Nephrology : JASN.

[3]  E. Kuijper,et al.  Once versus thrice daily gentamicin in patients with serious infections , 1993, The Lancet.

[4]  J. de Irala,et al.  Prognosis and serum creatinine levels in acute renal failure at the time of nephrology consultation: an observational cohort study , 2007, BMC nephrology.

[5]  Lucila Ohno-Machado,et al.  Discrimination and calibration of mortality risk prediction models in interventional cardiology , 2005, J. Biomed. Informatics.

[6]  P. Banks,et al.  Practice Guidelines in Acute Pancreatitis , 2006, The American Journal of Gastroenterology.

[7]  S. Aronson,et al.  Risk index for perioperative renal dysfunction/failure: critical dependence on pulse pressure hypertension. , 2007, Circulation.

[8]  T. Greene,et al.  Performance of the modification of diet in renal disease and Cockcroft-Gault equations in the estimation of GFR in health and in chronic kidney disease. , 2005, Journal of the American Society of Nephrology : JASN.

[9]  R. Anderson,et al.  Prevention of drug-induced nephrotoxicity in the intensive care unit. , 1995, Journal of critical care.

[10]  A. Meyer,et al.  Predicting survival in the intensive care unit. , 1997, Current problems in surgery.

[11]  Jonathan S Schildcrout,et al.  Research Paper: Medication Administration Discrepancies Persist Despite Electronic Ordering , 2007, J. Am. Medical Informatics Assoc..

[12]  E J Topol,et al.  Readiness for the scorecard era in cardiovascular medicine. , 1995, The American journal of cardiology.

[13]  R. Hatala,et al.  Single daily dosing of aminoglycosides in immunocompromised adults: a systematic review. , 1997, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[14]  John T Granton,et al.  Derivation and validation of a simplified predictive index for renal replacement therapy after cardiac surgery. , 2007, JAMA.

[15]  Jonathan Himmelfarb,et al.  Spectrum of acute renal failure in the intensive care unit: the PICARD experience. , 2004, Kidney international.

[16]  E. Anaissie,et al.  Amphotericin B lipid complex for invasive fungal infections: analysis of safety and efficacy in 556 cases. , 1998, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[17]  J Pascual,et al.  Epidemiology of acute renal failure: A prospective, multicenter, community-based study , 1996 .

[18]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[19]  D. Hosmer,et al.  A review of goodness of fit statistics for use in the development of logistic regression models. , 1982, American journal of epidemiology.

[20]  J. Bonventre,et al.  Acute renal failure. , 2018, The New England journal of medicine.

[21]  M. Cuesta,et al.  Acute renal failure in patients with acute pancreatitis: prevalence, risk factors, and outcome. , 1993, Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association - European Renal Association.

[22]  A. Whelton Nephrotoxicity of nonsteroidal anti-inflammatory drugs: physiologic foundations and clinical implications. , 1999, The American journal of medicine.

[23]  J Pascual,et al.  The spectrum of acute renal failure in the intensive care unit compared with that seen in other settings. The Madrid Acute Renal Failure Study Group. , 1998, Kidney international. Supplement.

[24]  M. Perazella,et al.  Drug‐Induced Renal Failure: Update on New Medications and Unique Mechanisms of Nephrotoxicity , 2003, The American journal of the medical sciences.

[25]  L. Lenert,et al.  Method of Medicare reimbursement and the rate of potentially ineffective care of critically ill patients. , 1997, JAMA.

[26]  L. Newby,et al.  Relationship between risk stratification by cardiac troponin level and adherence to guidelines for non-ST-segment elevation acute coronary syndromes. , 2005, Archives of internal medicine.

[27]  S. Hou,et al.  Hospital-acquired renal insufficiency. , 2002, American journal of kidney diseases : the official journal of the National Kidney Foundation.

[28]  D W Bates,et al.  Predicting acute renal failure after coronary bypass surgery: cross-validation of two risk-stratification algorithms. , 2000, Kidney international.

[29]  Lucila Ohno-Machado,et al.  Research Paper: Monitoring Device Safety in Interventional Cardiology , 2006, J. Am. Medical Informatics Assoc..

[30]  P. Loirat,et al.  Acute renal failure in intensive care units--causes, outcome, and prognostic factors of hospital mortality; a prospective, multicenter study. French Study Group on Acute Renal Failure. , 1996, Critical care medicine.

[31]  F. Harrell,et al.  Prognostic/Clinical Prediction Models: Multivariable Prognostic Models: Issues in Developing Models, Evaluating Assumptions and Adequacy, and Measuring and Reducing Errors , 2005 .

[32]  T. Greene,et al.  Performance of the Cockcroft-Gault and modification of diet in renal disease equations in estimating GFR in ill hospitalized patients. , 2005, American journal of kidney diseases : the official journal of the National Kidney Foundation.

[33]  Todd Dorman,et al.  Predicting patient outcomes, futility, and resource utilization in the intensive care unit: the role of severity scoring systems and general outcome prediction models. , 2005, Mayo Clinic proceedings.

[34]  G. Stone,et al.  A simple risk score for prediction of contrast-induced nephropathy after percutaneous coronary intervention: development and initial validation. , 2004, Journal of the American College of Cardiology.

[35]  Min-hua Fan,et al.  Hospital-Acquired and Community-Acquired Acute Renal Failure in Hospitalized Chinese: A Ten-Year Review , 2007, Renal failure.

[36]  R. Thisted,et al.  Association of Preoperative Risk Factors with Postoperative Acute Renal Failure , 1994, Anesthesia and analgesia.

[37]  Charles Davidson,et al.  Risk prediction of contrast-induced nephropathy. , 2006, The American journal of cardiology.

[38]  R. Bellomo,et al.  Acute renal failure – definition, outcome measures, animal models, fluid therapy and information technology needs: the Second International Consensus Conference of the Acute Dialysis Quality Initiative (ADQI) Group , 2004, Critical care.

[39]  Annette M. Molinaro,et al.  Prediction error estimation: a comparison of resampling methods , 2005, Bioinform..

[40]  J. Turney,et al.  The evolution of acute renal failure, 1956-1988. , 1990, The Quarterly journal of medicine.

[41]  B. A. Mueller,et al.  Drug-associated renal dysfunction. , 2006, Critical care clinics.

[42]  L. Esserman,et al.  Potentially ineffective care. A new outcome to assess the limits of critical care. , 1995, JAMA.

[43]  J. le Gall,et al.  Effect of acute renal failure requiring renal replacement therapy on outcome in critically ill patients* , 2002, Critical care medicine.

[44]  D. Ramsdale,et al.  Intermediate and high peri-operative cardiac enzyme release following isolated coronary artery bypass surgery are independently associated with higher one-year mortality , 2006, Journal of cardiothoracic surgery.

[45]  W. O’Neill,et al.  Acute renal failure after coronary intervention: incidence, risk factors, and relationship to mortality. , 1997, The American journal of medicine.

[46]  G H Guyatt,et al.  Understanding articles comparing outcomes among intensive care units to rate quality of care. Evidence Based Medicine in Critical Care Group. , 1998, Critical care medicine.

[47]  John A Kellum,et al.  Acute renal failure in critically ill patients: a multinational, multicenter study. , 2005, JAMA.

[48]  J. Cohen,et al.  Hospital-acquired renal insufficiency: a prospective study. , 1983, The American journal of medicine.

[49]  Yingye Zheng,et al.  Integrating the predictiveness of a marker with its performance as a classifier. , 2007, American journal of epidemiology.

[50]  E. Cook,et al.  Preoperative renal risk stratification. , 1997, Circulation.

[51]  Lucila Ohno-Machado,et al.  Risk-adjusted sequential probability ratio test control chart methods for monitoring operator and institutional mortality rates in interventional cardiology. , 2008, American heart journal.