A Random Forest Based Risk Model for Reliable and Accurate Prediction of Receipt of Transfusion in Patients Undergoing Percutaneous Coronary Intervention

Background Transfusion is a common complication of Percutaneous Coronary Intervention (PCI) and is associated with adverse short and long term outcomes. There is no risk model for identifying patients most likely to receive transfusion after PCI. The objective of our study was to develop and validate a tool for predicting receipt of blood transfusion in patients undergoing contemporary PCI. Methods Random forest models were developed utilizing 45 pre-procedural clinical and laboratory variables to estimate the receipt of transfusion in patients undergoing PCI. The most influential variables were selected for inclusion in an abbreviated model. Model performance estimating transfusion was evaluated in an independent validation dataset using area under the ROC curve (AUC), with net reclassification improvement (NRI) used to compare full and reduced model prediction after grouping in low, intermediate, and high risk categories. The impact of procedural anticoagulation on observed versus predicted transfusion rates were assessed for the different risk categories. Results Our study cohort was comprised of 103,294 PCI procedures performed at 46 hospitals between July 2009 through December 2012 in Michigan of which 72,328 (70%) were randomly selected for training the models, and 30,966 (30%) for validation. The models demonstrated excellent calibration and discrimination (AUC: full model  = 0.888 (95% CI 0.877–0.899), reduced model AUC = 0.880 (95% CI, 0.868–0.892), p for difference 0.003, NRI = 2.77%, p = 0.007). Procedural anticoagulation and radial access significantly influenced transfusion rates in the intermediate and high risk patients but no clinically relevant impact was noted in low risk patients, who made up 70% of the total cohort. Conclusions The risk of transfusion among patients undergoing PCI can be reliably calculated using a novel easy to use computational tool (https://bmc2.org/calculators/transfusion). This risk prediction algorithm may prove useful for both bed side clinical decision making and risk adjustment for assessment of quality.

[1]  Sunil V. Rao,et al.  Relationship of blood transfusion and clinical outcomes in patients with acute coronary syndromes. , 2004, JAMA.

[2]  Xavier Robin,et al.  pROC: an open-source package for R and S+ to analyze and compare ROC curves , 2011, BMC Bioinformatics.

[3]  K. Eagle,et al.  Association of a Continuous Quality Improvement Initiative With Practice and Outcome Variations of Contemporary Percutaneous Coronary Interventions , 2006, Circulation.

[4]  Andy Liaw,et al.  Classification and Regression by randomForest , 2007 .

[5]  J. Gardin,et al.  Blood Transfusion and In‐hospital Outcomes in Anemic Patients with Myocardial Infarction Undergoing Percutaneous Coronary Intervention , 2007, Clinical cardiology.

[6]  E. Topol,et al.  Impact of blood transfusion on short- and long-term mortality in patients with ST-segment elevation myocardial infarction. , 2009, JACC. Cardiovascular interventions.

[7]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[8]  Nancy R Cook,et al.  Comments on ‘Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond’ by M. J. Pencina et al., Statistics in Medicine (DOI: 10.1002/sim.2929) , 2008, Statistics in medicine.

[9]  M. Pencina,et al.  Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond , 2008, Statistics in medicine.

[10]  J. Ware,et al.  Comments on ‘Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond’ by M. J. Pencina et al., Statistics in Medicine (DOI: 10.1002/sim.2929) , 2008, Statistics in medicine.

[11]  H. Gurm,et al.  A novel tool for reliable and accurate prediction of renal complications in patients undergoing percutaneous coronary intervention. , 2013, Journal of the American College of Cardiology.

[12]  T. Mihaljevic,et al.  Transfusion in coronary artery bypass grafting is associated with reduced long-term survival. , 2006, The Annals of thoracic surgery.

[13]  Michael J. Pencina,et al.  Thoroughly Modern Risk Prediction? , 2012, Science Translational Medicine.

[14]  E. Topol,et al.  Predictors and impact of major hemorrhage on mortality following percutaneous coronary intervention from the REPLACE-2 Trial. , 2007, The American journal of cardiology.

[15]  D. Holmes,et al.  Bleeding, blood transfusion, and increased mortality after percutaneous coronary intervention: implications for contemporary practice. , 2009, Journal of the American College of Cardiology.

[16]  A. Carter,et al.  The relative safety and efficacy of abciximab and eptifibatide in patients undergoing primary percutaneous coronary intervention: insights from a large regional registry of contemporary percutaneous coronary intervention. , 2008, Journal of the American College of Cardiology.

[17]  D. Atar,et al.  Bleeding in acute coronary syndromes and percutaneous coronary interventions: position paper by the Working Group on Thrombosis of the European Society of Cardiology. , 2011, European heart journal.

[18]  J. Spertus,et al.  Pre-procedural estimate of individualized bleeding risk impacts physicians' utilization of bivalirudin during percutaneous coronary intervention. , 2013, Journal of the American College of Cardiology.

[19]  Sunil V. Rao,et al.  Bleeding in Patients Undergoing Percutaneous Coronary Intervention: The Development of a Clinical Risk Algorithm From the National Cardiovascular Data Registry , 2009, Circulation. Cardiovascular interventions.

[20]  Jos Boekhorst,et al.  Data mining in the Life Sciences with Random Forest: a walk in the park or lost in the jungle? , 2012, Briefings Bioinform..

[21]  A. Kastrati,et al.  Periprocedural bleeding and 1-year outcome after percutaneous coronary interventions: appropriateness of including bleeding as a component of a quadruple end point. , 2008, Journal of the American College of Cardiology.

[22]  I. Rubinfeld,et al.  Looking Beyond Historical Patient Outcomes to Improve Clinical Models , 2012, Science Translational Medicine.