Derivation and Validation of Machine Learning Approaches to Predict Acute Kidney Injury after Cardiac Surgery

Machine learning approaches were introduced for better or comparable predictive ability than statistical analysis to predict postoperative outcomes. We sought to compare the performance of machine learning approaches with that of logistic regression analysis to predict acute kidney injury after cardiac surgery. We retrospectively reviewed 2010 patients who underwent open heart surgery and thoracic aortic surgery. Baseline medical condition, intraoperative anesthesia, and surgery-related data were obtained. The primary outcome was postoperative acute kidney injury (AKI) defined according to the Kidney Disease Improving Global Outcomes criteria. The following machine learning techniques were used: decision tree, random forest, extreme gradient boosting, support vector machine, neural network classifier, and deep learning. The performance of these techniques was compared with that of logistic regression analysis regarding the area under the receiver-operating characteristic curve (AUC). During the first postoperative week, AKI occurred in 770 patients (38.3%). The best performance regarding AUC was achieved by the gradient boosting machine to predict the AKI of all stages (0.78, 95% confidence interval (CI) 0.75–0.80) or stage 2 or 3 AKI. The AUC of logistic regression analysis was 0.69 (95% CI 0.66–0.72). Decision tree, random forest, and support vector machine showed similar performance to logistic regression. In our comprehensive comparison of machine learning approaches with logistic regression analysis, gradient boosting technique showed the best performance with the highest AUC and lower error rate. We developed an Internet–based risk estimator which could be used for real-time processing of patient data to estimate the risk of AKI at the end of surgery.

[1]  Lorenzo L. Pesce,et al.  Risk factors for perioperative acute kidney injury after adult cardiac surgery: role of perioperative management. , 2012, The Annals of thoracic surgery.

[2]  Eun-Ho Lee,et al.  Effect of Exogenous Albumin on the Incidence of Postoperative Acute Kidney Injury in Patients Undergoing Off-pump Coronary Artery Bypass Surgery with a Preoperative Albumin Level of Less Than 4.0 g/dl , 2016, Anesthesiology.

[3]  X. León,et al.  Prognostic factors in head and neck squamous cell carcinoma: Comparison of CHAID decision trees technology and cox analysis , 2013, Head & neck.

[4]  Y. Yoo,et al.  Effect of Single Recombinant Human Erythropoietin Injection on Transfusion Requirements in Preoperatively Anemic Patients Undergoing Valvular Heart Surgery , 2011, Anesthesiology.

[5]  Andrew H. Beck,et al.  Diagnostic Assessment of Deep Learning Algorithms for Detection of Lymph Node Metastases in Women With Breast Cancer , 2017, JAMA.

[6]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[7]  Won Ho Kim,et al.  Simplified clinical risk score to predict acute kidney injury after aortic surgery. , 2013, Journal of cardiothoracic and vascular anesthesia.

[8]  Kurt Hornik,et al.  Approximation capabilities of multilayer feedforward networks , 1991, Neural Networks.

[9]  P. Kasbekar,et al.  A Decision Tree Analysis of Diabetic Foot Amputation Risk in Indian Patients , 2017, Front. Endocrinol..

[10]  S. McCluskey,et al.  Acute Kidney Injury After Cardiac Surgery: Focus on Modifiable Risk Factors , 2009, Circulation.

[11]  Youyong Li,et al.  ADMET Evaluation in Drug Discovery. 18. Reliable Prediction of Chemical-Induced Urinary Tract Toxicity by Boosting Machine Learning Approaches. , 2017, Molecular pharmaceutics.

[12]  S. Arrigain,et al.  A clinical score to predict acute renal failure after cardiac surgery. , 2004, Journal of the American Society of Nephrology : JASN.

[13]  D. Fine,et al.  Defining oliguria during cardiopulmonary bypass and its relationship with cardiac surgery-associated acute kidney injury. , 2016, British journal of anaesthesia.

[14]  Karyn S Kunzelman,et al.  Multivariable Prediction of Renal Insufficiency Developing After Cardiac Surgery , 2007, Circulation.

[15]  C. Kim,et al.  Potentially Modifiable Risk Factors For Acute Kidney Injury After Surgery on The Thoracic Aorta , 2015, Medicine.

[16]  Nan Yu,et al.  Multi-label spacecraft electrical signal classification method based on DBN and random forest , 2017, PloS one.

[17]  M Mernik,et al.  ROSE: decision trees, automatic learning and their applications in cardiac medicine. , 1995, Medinfo. MEDINFO.

[18]  William Fleischman,et al.  Prediction of In-hospital Mortality in Emergency Department Patients With Sepsis: A Local Big Data-Driven, Machine Learning Approach. , 2016, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[19]  Andy Liaw,et al.  Extreme Gradient Boosting as a Method for Quantitative Structure-Activity Relationships , 2016, J. Chem. Inf. Model..

[20]  J. Kellum,et al.  What endpoints should be used for clinical studies in acute kidney injury? , 2017, Intensive Care Medicine.

[21]  Gahyun Kim,et al.  Association Between Elevated Echocardiographic Index of Left Ventricular Filling Pressure and Acute Kidney Injury After Off-Pump Coronary Artery Surgery. , 2017, Circulation journal : official journal of the Japanese Circulation Society.

[22]  Mark E. Thomas,et al.  The definition of acute kidney injury and its use in practice. , 2015, Kidney international.

[23]  Shao-Chun Wu,et al.  Derivation and validation of different machine-learning models in mortality prediction of trauma in motorcycle riders: a cross-sectional retrospective study in southern Taiwan , 2018, BMJ Open.

[24]  Pierre Baldi,et al.  Development and Validation of a Deep Neural Network Model for Prediction of Postoperative In-hospital Mortality , 2018, Anesthesiology.

[25]  E. Finkelstein,et al.  Development and Validation of a Deep Learning System for Diabetic Retinopathy and Related Eye Diseases Using Retinal Images From Multiethnic Populations With Diabetes , 2017, JAMA.

[26]  Sun-Kyung Park,et al.  Preoperative aspirin use and acute kidney injury after cardiac surgery: A propensity-score matched observational study , 2017, PloS one.

[27]  E. DeLong,et al.  Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. , 1988, Biometrics.

[28]  W. Kim,et al.  Prediction and Prevention of Acute Kidney Injury after Cardiac Surgery , 2016, BioMed research international.

[29]  John T Granton,et al.  Derivation and validation of a simplified predictive index for renal replacement therapy after cardiac surgery. , 2007, JAMA.

[30]  Y. Yamamoto,et al.  Intraoperative oliguria predicts acute kidney injury after major abdominal surgery , 2017, British journal of anaesthesia.

[31]  Eunhee Kim,et al.  Can We Really Predict Postoperative Acute Kidney Injury after Aortic Surgery? Diagnostic Accuracy of Risk Scores Using Gray Zone Approach , 2015, Thoracic and Cardiovascular Surgeon.

[32]  P. Kimmel,et al.  Acute kidney injury and chronic kidney disease as interconnected syndromes. , 2014, The New England journal of medicine.

[33]  S. Aronson,et al.  Risk Index for Perioperative Renal Dysfunction/Failure: Critical Dependence on Pulse Pressure Hypertension , 2007 .

[34]  Elias Zintzaras,et al.  A tree-based decision rule for identifying profile groups of cases without predefined classes: application in diffuse large B-cell lymphomas , 2007, Comput. Biol. Medicine.

[35]  D W Bates,et al.  Predicting acute renal failure after coronary bypass surgery: cross-validation of two risk-stratification algorithms. , 2000, Kidney international.

[36]  Tingjun Hou,et al.  ADME evaluation in drug discovery , 2002, Journal of molecular modeling.

[37]  Jeffrey M. Hausdorff,et al.  Model-based and Model-free Machine Learning Techniques for Diagnostic Prediction and Classification of Clinical Outcomes in Parkinson’s Disease , 2018, Scientific Reports.

[38]  M. Bes-Rastrollo,et al.  Modern hydroxyethyl starch and acute kidney injury after cardiac surgery: a prospective multicentre cohort. , 2015, British journal of anaesthesia.

[39]  S. Lemon,et al.  Classification and regression tree analysis in public health: Methodological review and comparison with logistic regression , 2003, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[40]  J. Schold,et al.  Acute Kidney Injury Is Associated With Increased Long-Term Mortality After Cardiothoracic Surgery , 2009, Circulation.

[41]  Y. Fei,et al.  Artificial neural networks predict the incidence of portosplenomesenteric venous thrombosis in patients with acute pancreatitis , 2017, Journal of thrombosis and haemostasis : JTH.

[42]  Sean M. O'Brien,et al.  Bedside Tool for Predicting the Risk of Postoperative Dialysis in Patients Undergoing Cardiac Surgery , 2006, Circulation.

[43]  H Robbins,et al.  Complete Convergence and the Law of Large Numbers. , 1947, Proceedings of the National Academy of Sciences of the United States of America.

[44]  S. Lage,et al.  Acute kidney injury prediction following elective cardiac surgery: AKICS Score. , 2007, Kidney international.

[45]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[46]  K. Zou,et al.  Receiver-Operating Characteristic Analysis for Evaluating Diagnostic Tests and Predictive Models , 2007, Circulation.

[47]  P. Rahmanian,et al.  Logistic risk model predicting postoperative renal failure requiring dialysis in cardiac surgery patients. , 2011, European journal of cardio-thoracic surgery : official journal of the European Association for Cardio-thoracic Surgery.