Development and Validation of the DOAC Score: A Novel Bleeding Risk Prediction Tool for Patients With Atrial Fibrillation on Direct-Acting Oral Anticoagulants

BACKGROUND: Current clinical decision tools for assessing bleeding risk in individuals with atrial fibrillation (AF) have limited performance and were developed for individuals treated with warfarin. This study develops and validates a clinical risk score to personalize estimates of bleeding risk for individuals with atrial fibrillation taking direct-acting oral anticoagulants (DOACs). METHODS: Among individuals taking dabigatran 150 mg twice per day from 44 countries and 951 centers in this secondary analysis of the RE-LY trial (Randomized Evaluation of Long-Term Anticoagulation Therapy), a risk score was developed to determine the comparative risk for bleeding on the basis of covariates derived in a Cox proportional hazards model. The risk prediction model was internally validated with bootstrapping. The model was then further developed in the GARFIELD-AF registry (Global Anticoagulant Registry in the Field-Atrial Fibrillation), with individuals taking dabigatran, edoxaban, rivaroxaban, and apixaban. To determine generalizability in external cohorts and among individuals on different DOACs, the risk prediction model was validated in the COMBINE-AF (A Collaboration Between Multiple Institutions to Better Investigate Non-Vitamin K Antagonist Oral Anticoagulant Use in Atrial Fibrillation) pooled clinical trial cohort and the Quebec Régie de l’Assurance Maladie du Québec and Med-Echo Administrative Databases (RAMQ) administrative database. The primary outcome was major bleeding. The risk score, termed the DOAC Score, was compared with the HAS-BLED score. RESULTS: Of the 5684 patients in RE-LY, 386 (6.8%) experienced a major bleeding event, within a median follow-up of 1.74 years. The prediction model had an optimism-corrected C statistic of 0.73 after internal validation with bootstrapping and was well-calibrated based on visual inspection of calibration plots (goodness-of-fit P=0.57). The DOAC Score assigned points for age, creatinine clearance/glomerular filtration rate, underweight status, stroke/transient ischemic attack/embolism history, diabetes, hypertension, antiplatelet use, nonsteroidal anti-inflammatory use, liver disease, and bleeding history, with each additional point scored associated with a 48.7% (95% CI, 38.9%–59.3%; P<0.001) increase in major bleeding in RE-LY. The score had superior performance to the HAS-BLED score in RE-LY (C statistic, 0.73 versus 0.60; P for difference <0.001) and among 12 296 individuals in GARFIELD-AF (C statistic, 0.71 versus 0.66; P for difference = 0.025). The DOAC Score had stronger predictive performance than the HAS-BLED score in both validation cohorts, including 25 586 individuals in COMBINE-AF (C statistic, 0.67 versus 0.63; P for difference <0.001) and 11 945 individuals in RAMQ (C statistic, 0.65 versus 0.58; P for difference <0.001). CONCLUSIONS: In individuals with atrial fibrillation potentially eligible for DOAC therapy, the DOAC Score can help stratify patients on the basis of expected bleeding risk.

[1]  Rahul Wadke,et al.  Atrial fibrillation. , 2022, Disease-a-month : DM.

[2]  R. Cote,et al.  Predicting major bleeding among hospitalized patients using oral anticoagulants for atrial fibrillation after discharge , 2021, PloS one.

[3]  D. Fitzmaurice,et al.  Mortality in Patients With Atrial Fibrillation Receiving Nonrecommended Doses of Direct Oral Anticoagulants. , 2020, Journal of the American College of Cardiology.

[4]  Jeroen J. Bax,et al.  2020 ESC Guidelines for the diagnosis and management of atrial fibrillation developed in collaboration with the European Association of Cardio-Thoracic Surgery (EACTS). , 2020, European heart journal.

[5]  P. Neužil,et al.  Left Atrial Appendage Closure Versus Direct Oral Anticoagulants in High-Risk Patients With Atrial Fibrillation. , 2020, Journal of the American College of Cardiology.

[6]  Hugh Calkins,et al.  2019 AHA/ACC/HRS Focused Update of the 2014 AHA/ACC/HRS Guideline for the Management of Patients With Atrial Fibrillation: A Report of the American College of Cardiology/American Heart Association Task Force on Clinical Practice Guidelines and the Heart Rhythm Society. , 2019, Heart rhythm.

[7]  G. Sanders,et al.  Predicting Thromboembolic and Bleeding Event Risk in Patients with Non-Valvular Atrial Fibrillation: A Systematic Review , 2018, Thrombosis and Haemostasis.

[8]  D. Scherr,et al.  Translating guidelines into practice for the management of atrial fibrillation: results of an European Heart Rhythm Association Survey , 2018, Europace : European pacing, arrhythmias, and cardiac electrophysiology : journal of the working groups on cardiac pacing, arrhythmias, and cardiac cellular electrophysiology of the European Society of Cardiology.

[9]  A. Algra,et al.  Chronic kidney disease and bleeding risk in patients at high cardiovascular risk: a cohort study , 2018, Journal of thrombosis and haemostasis : JTH.

[10]  Gregory Y H Lip,et al.  Non-vitamin K antagonist oral anticoagulant dosing in patients with atrial fibrillation and renal dysfunction. , 2017, Annals of translational medicine.

[11]  J. Spertus,et al.  Development and Validation of a Prediction Rule for Benefit and Harm of Dual Antiplatelet Therapy Beyond 1 Year After Percutaneous Coronary Intervention. , 2016, JAMA.

[12]  Olga V. Demler,et al.  Tests of calibration and goodness‐of‐fit in the survival setting , 2015, Statistics in medicine.

[13]  Gary S Collins,et al.  Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD Statement , 2015, BMC Medicine.

[14]  E. Antman,et al.  Edoxaban versus warfarin in patients with atrial fibrillation. , 2013, The New England journal of medicine.

[15]  D. Atar,et al.  Mass screening for silent atrial fibrillation in high risk patients - preliminary results from the STROKESTOP trial , 2013 .

[16]  M. Fang,et al.  Assessing bleeding risk in patients taking anticoagulants , 2013, Journal of Thrombosis and Thrombolysis.

[17]  Yutao Guo,et al.  Performance of the HEMORR(2)HAGES, ATRIA, and HAS-BLED bleeding risk-prediction scores in patients with atrial fibrillation undergoing anticoagulation: the AMADEUS (evaluating the use of SR34006 compared to warfarin or acenocoumarol in patients with atrial fibrillation) study. , 2012, Journal of the American College of Cardiology.

[18]  D. Singer,et al.  Putting risk prediction in atrial fibrillation into perspective. , 2012, European heart journal.

[19]  D. Singer,et al.  A new risk scheme to predict warfarin-associated hemorrhage: The ATRIA (Anticoagulation and Risk Factors in Atrial Fibrillation) Study. , 2011, Journal of the American College of Cardiology.

[20]  Jun Zhu,et al.  Apixaban in patients with atrial fibrillation. , 2011, The New England journal of medicine.

[21]  Gregory Y H Lip,et al.  Refining clinical risk stratification for predicting stroke and thromboembolism in atrial fibrillation using a novel risk factor-based approach: the euro heart survey on atrial fibrillation. , 2010, Chest.

[22]  S. Yusuf,et al.  Dabigatran versus warfarin in patients with atrial fibrillation. , 2009, The New England journal of medicine.

[23]  D. Singer,et al.  The Net Clinical Benefit of Warfarin Anticoagulation in Atrial Fibrillation , 2009, Annals of Internal Medicine.

[24]  Marc Cohen Expanding the recognition and assessment of bleeding events associated with antiplatelet therapy in primary care. , 2009, Mayo Clinic proceedings.

[25]  M. Rich,et al.  Clinical classification schemes for predicting hemorrhage: results from the National Registry of Atrial Fibrillation (NRAF). , 2006, American heart journal.

[26]  S. Schulman,et al.  Definition of major bleeding in clinical investigations of antihemostatic medicinal products in non‐surgical patients , 2005, Journal of thrombosis and haemostasis : JTH.

[27]  R. D'Agostino,et al.  Presentation of multivariate data for clinical use: The Framingham Study risk score functions , 2004, Statistics in medicine.

[28]  M. Larkin Software , 2003, The Lancet.

[29]  J. Habbema,et al.  Internal validation of predictive models: efficiency of some procedures for logistic regression analysis. , 2001, Journal of clinical epidemiology.

[30]  Robert Gray,et al.  A Proportional Hazards Model for the Subdistribution of a Competing Risk , 1999 .

[31]  D. Levy,et al.  Prediction of coronary heart disease using risk factor categories. , 1998, Circulation.

[32]  E. DeLong,et al.  Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. , 1988, Biometrics.

[33]  Adelaide V. Finch,et al.  September , 1867, The Hospital.

[34]  Y. So,et al.  Evaluating Predictive Accuracy of Survival Models with PROC PHREG , 2017 .

[35]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[36]  G. Lip,et al.  International longitudinal registry of patients with atrial fibrillation at risk of stroke: Global Anticoagulant Registry in the FIELD (GARFIELD). , 2012, American heart journal.

[37]  A. Turpie,et al.  Factors at admission associated with bleeding risk in medical patients: findings from the IMPROVE investigators. , 2011, Chest.

[38]  R. Troughton,et al.  Rivaroxaban versus warfarin in nonvalvular atrial fibrillation. , 2011, The New England journal of medicine.

[39]  K. Jenpanich,et al.  [Drug administration]. , 1976, Thai journal of nursing.