Evaluation of Risk Prediction Models of Atrial Fibrillation (from the Multi-Ethnic Study of Atherosclerosis [MESA]).

Atrial fibrillation (AF) is prevalent and strongly associated with higher cardiovascular disease (CVD) risk. Machine learning is increasingly used to identify novel predictors of CVD risk, but prediction improvements beyond established risk scores are uncertain. We evaluated improvements in predicting 5-year AF risk when adding novel candidate variables identified by machine learning to the CHARGE-AF Enriched score, which includes age, race/ethnicity, height, weight, systolic and diastolic blood pressure, current smoking, use of antihypertensive medication, diabetes, and NT-proBNP. We included 3,534 participants (mean age, 61.3 years; 52.0% female) with complete data from the prospective Multi-Ethnic Study of Atherosclerosis. Incident AF was defined based on study electrocardiograms and hospital discharge diagnosis ICD-9 codes, supplemented by Medicare claims. Prediction performance was evaluated using Cox regression and a parsimonious model was selected using LASSO. Within 5 years of baseline, 124 participants had incident AF. Compared with the CHARGE-AF Enriched model (c-statistic, 0.804), variables identified by machine learning, including biomarkers, cardiac magnetic resonance imaging variables, electrocardiogram variables, and subclinical CVD variables, did not significantly improve prediction. A 23-item score derived by machine learning achieved a c-statistic of 0.806, whereas a parsimonious model including the clinical risk factors age, weight, current smoking, NT-proBNP, coronary artery calcium score, and cardiac troponin-T achieved a c-statistic of 0.802. This analysis confirms that the CHARGE-AF Enriched model and a parsimonious 6-item model performed similarly to a more extensive model derived by machine learning. In conclusion, these simple models remain the gold standard for risk prediction of AF, although addition of the coronary artery calcium score should be considered.

[1]  Francesca N. Delling,et al.  Heart Disease and Stroke Statistics—2019 Update: A Report From the American Heart Association , 2019, Circulation.

[2]  Olle Melander,et al.  Assessment of conventional cardiovascular risk factors and multiple biomarkers for the prediction of incident heart failure and atrial fibrillation. , 2010, Journal of the American College of Cardiology.

[3]  N. Roetker,et al.  Prediction of Atrial Fibrillation in a Racially Diverse Cohort: The Multi‐Ethnic Study of Atherosclerosis (MESA) , 2016, Journal of the American Heart Association.

[4]  N. Obuchowski,et al.  Assessing the Performance of Prediction Models: A Framework for Traditional and Novel Measures , 2010, Epidemiology.

[5]  Daniel Levy,et al.  Plasma natriuretic peptide levels and the risk of cardiovascular events and death. , 2004, The New England journal of medicine.

[6]  R. Kronmal,et al.  Multi-Ethnic Study of Atherosclerosis: objectives and design. , 2002, American journal of epidemiology.

[7]  T. Lumley,et al.  Time‐Dependent ROC Curves for Censored Survival Data and a Diagnostic Marker , 2000, Biometrics.

[8]  Steven Shea,et al.  Cardiovascular Event Prediction by Machine Learning: The Multi-Ethnic Study of Atherosclerosis , 2017, Circulation research.

[9]  E. Soliman,et al.  Coronary Artery Calcium Progression and Atrial Fibrillation: The Multi-Ethnic Study of Atherosclerosis. , 2015, Circulation. Cardiovascular imaging.

[10]  David D. McManus,et al.  Simple Risk Model Predicts Incidence of Atrial Fibrillation in a Racially and Geographically Diverse Population: the CHARGE‐AF Consortium , 2013, Journal of the American Heart Association.

[11]  E. Benjamin,et al.  Pericardial fat volume and incident atrial fibrillation in the Multi-Ethnic Study of Atherosclerosis and Jackson Heart Study , 2017, Obesity.

[12]  D. Levy,et al.  Development of a risk score for atrial fibrillation (Framingham Heart Study): a community-based cohort study , 2009, The Lancet.

[13]  David D. McManus,et al.  Atrial Fibrillation Atrial Fibrillation Current Knowledge and Future Directions in Epidemiology and Genomics , 2011 .

[14]  Elsayed Z Soliman,et al.  A clinical risk score for atrial fibrillation in a biracial prospective cohort (from the Atherosclerosis Risk in Communities [ARIC] study). , 2011, The American journal of cardiology.

[15]  D. Levy,et al.  Relations of Biomarkers of Distinct Pathophysiological Pathways and Atrial Fibrillation Incidence in the Community , 2010, Circulation.

[16]  Mary Cushman,et al.  Atrial Fibrillation and Risk of ST-Segment–Elevation Versus Non–ST-Segment–Elevation Myocardial Infarction: The Atherosclerosis Risk in Communities (ARIC) Study , 2015, Circulation.

[17]  R. Luben,et al.  Performance of the CHARGE-AF risk model for incident atrial fibrillation in the EPIC Norfolk cohort , 2015, European journal of preventive cardiology.

[18]  Kathleen F. Kerr,et al.  Testing for improvement in prediction model performance , 2013, Statistics in medicine.

[19]  J. Lindholt,et al.  Coronary artery calcium score and the long-term risk of atrial fibrillation in patients undergoing non-contrast cardiac computed tomography for suspected coronary artery disease: a Danish registry-based cohort study , 2018, European heart journal cardiovascular Imaging.

[20]  Olga V. Demler,et al.  Tests of calibration and goodness‐of‐fit in the survival setting , 2015, Statistics in medicine.

[21]  E. Soliman,et al.  Coronary artery calcium and risk of atrial fibrillation (from the multi-ethnic study of atherosclerosis). , 2014, The American journal of cardiology.

[22]  O. Franco,et al.  B-type natriuretic peptide and C-reactive protein in the prediction of atrial fibrillation risk: the CHARGE-AF Consortium of community-based cohort studies. , 2014, Europace : European pacing, arrhythmias, and cardiac electrophysiology : journal of the working groups on cardiac pacing, arrhythmias, and cardiac cellular electrophysiology of the European Society of Cardiology.

[23]  L. Di Biase,et al.  Validation of the Framingham Heart Study and CHARGE-AF Risk Scores for Atrial Fibrillation in Hispanics, African-Americans, and Non-Hispanic Whites. , 2016, The American journal of cardiology.

[24]  M. Pencina,et al.  Overall C as a measure of discrimination in survival analysis: model specific population value and confidence interval estimation , 2004, Statistics in medicine.

[25]  R B D'Agostino,et al.  Impact of atrial fibrillation on mortality, stroke, and medical costs. , 1998, Archives of internal medicine.

[26]  K. Borgwardt,et al.  Machine Learning in Medicine , 2015, Mach. Learn. under Resour. Constraints Vol. 3.

[27]  Moyses Szklo,et al.  Coronary calcium as a predictor of coronary events in four racial or ethnic groups. , 2008, The New England journal of medicine.

[28]  D. Singer,et al.  Prevalence of diagnosed atrial fibrillation in adults: national implications for rhythm management and stroke prevention: the AnTicoagulation and Risk Factors in Atrial Fibrillation (ATRIA) Study. , 2001, JAMA.

[29]  Richard A. Kronmal,et al.  N-Terminal Pro-B-Type Natriuretic Peptide Is a Major Predictor of the Development of Atrial Fibrillation: The Cardiovascular Health Study , 2009, Circulation.

[30]  R. Tibshirani The lasso method for variable selection in the Cox model. , 1997, Statistics in medicine.