An artificial intelligence-enabled ECG algorithm for the identification of patients with atrial fibrillation during sinus rhythm: a retrospective analysis of outcome prediction

BACKGROUND Atrial fibrillation is frequently asymptomatic and thus underdetected but is associated with stroke, heart failure, and death. Existing screening methods require prolonged monitoring and are limited by cost and low yield. We aimed to develop a rapid, inexpensive, point-of-care means of identifying patients with atrial fibrillation using machine learning. METHODS We developed an artificial intelligence (AI)-enabled electrocardiograph (ECG) using a convolutional neural network to detect the electrocardiographic signature of atrial fibrillation present during normal sinus rhythm using standard 10-second, 12-lead ECGs. We included all patients aged 18 years or older with at least one digital, normal sinus rhythm, standard 10-second, 12-lead ECG acquired in the supine position at the Mayo Clinic ECG laboratory between Dec 31, 1993, and July 21, 2017, with rhythm labels validated by trained personnel under cardiologist supervision. We classified patients with at least one ECG with a rhythm of atrial fibrillation or atrial flutter as positive for atrial fibrillation. We allocated ECGs to the training, internal validation, and testing datasets in a 7:1:2 ratio. We calculated the area under the curve (AUC) of the receiver operatoring characteristic curve for the internal validation dataset to select a probability threshold, which we applied to the testing dataset. We evaluated model performance on the testing dataset by calculating the AUC and the accuracy, sensitivity, specificity, and F1 score with two-sided 95% CIs. FINDINGS We included 180 922 patients with 649 931 normal sinus rhythm ECGs for analysis: 454 789 ECGs recorded from 126 526 patients in the training dataset, 64 340 ECGs from 18 116 patients in the internal validation dataset, and 130 802 ECGs from 36 280 patients in the testing dataset. 3051 (8·4%) patients in the testing dataset had verified atrial fibrillation before the normal sinus rhythm ECG tested by the model. A single AI-enabled ECG identified atrial fibrillation with an AUC of 0·87 (95% CI 0·86-0·88), sensitivity of 79·0% (77·5-80·4), specificity of 79·5% (79·0-79·9), F1 score of 39·2% (38·1-40·3), and overall accuracy of 79·4% (79·0-79·9). Including all ECGs acquired during the first month of each patient's window of interest (ie, the study start date or 31 days before the first recorded atrial fibrillation ECG) increased the AUC to 0·90 (0·90-0·91), sensitivity to 82·3% (80·9-83·6), specificity to 83·4% (83·0-83·8), F1 score to 45·4% (44·2-46·5), and overall accuracy to 83·3% (83·0-83·7). INTERPRETATION An AI-enabled ECG acquired during normal sinus rhythm permits identification at point of care of individuals with atrial fibrillation. FUNDING None.

[1]  Raymond C S Seet,et al.  Prolonged Rhythm Monitoring for the Detection of Occult Paroxysmal Atrial Fibrillation in Ischemic Stroke of Unknown Cause , 2011, Circulation.

[2]  G. Lip,et al.  Antithrombotic Therapy for Atrial Fibrillation: CHEST Guideline and Expert Panel Report , 2012, Chest.

[3]  K. Furie,et al.  A comparison of warfarin and aspirin for the prevention of recurrent ischemic stroke. , 2001, The New England journal of medicine.

[4]  Aacc,et al.  2015 ACC/AHA/HRS Guideline for the Management of Adult Patients With Supraventricular Tachycardia: Executive Summary: A Report of the American College of Cardiology/American Heart Association Task Force on Clinical Practice Guidelines and the Heart Rhythm Society. , 2016, Circulation.

[5]  Y. Yoon,et al.  SYSTEMIC INFLAMMATION IS ASSOCIATED WITH CORONARY ARTERY CALCIFICATION AND ALL-CAUSE MORTALITY IN PATIENTS WITH CHRONIC KIDNEY DISEASE , 2016 .

[6]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[7]  S. Connolly,et al.  Rivaroxaban for Stroke Prevention after Embolic Stroke of Undetermined Source , 2018, The New England journal of medicine.

[8]  Michael J Ackerman,et al.  Noninvasive blood potassium measurement using signal-processed, single-lead ecg acquired from a handheld smartphone. , 2017, Journal of electrocardiology.

[9]  S. Kasner,et al.  Comparison of warfarin and aspirin for symptomatic intracranial arterial stenosis. , 2005, The New England journal of medicine.

[10]  A. Bayés‐Genís,et al.  Interatrial block and atrial arrhythmias in centenarians: Prevalence, associations, and clinical implications. , 2016, Heart rhythm.

[11]  Sudha Seshadri,et al.  50 year trends in atrial fibrillation prevalence, incidence, risk factors, and mortality in the Framingham Heart Study: a cohort study , 2015, The Lancet.

[12]  W. Manning,et al.  Mechanical Discordance of the Left Atrium and Appendage: A Novel Mechanism of Stroke in Paroxysmal Atrial Fibrillation , 2014, Stroke.

[13]  Frank Beckers,et al.  Cryptogenic stroke and underlying atrial fibrillation. , 2014, The New England journal of medicine.

[14]  D. Long,et al.  CHADS2 and CHA2DS2-VASc Scores Predict the Risk of Ischemic Stroke Outcome in Patients with Interatrial Block without Atrial Fibrillation , 2017, Journal of atherosclerosis and thrombosis.

[15]  S. Connolly,et al.  Embolic strokes of undetermined source: the case for a new clinical construct , 2014, The Lancet Neurology.

[16]  Hugh Calkins,et al.  2014 AHA/ACC/HRS guideline for the management of patients with atrial fibrillation: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines and the Heart Rhythm Society. , 2014, Journal of the American College of Cardiology.

[17]  J. Jansson,et al.  Estimating the prevalence of atrial fibrillation in a general population using validated electronic health data , 2013, Clinical epidemiology.

[18]  A. Rabinstein,et al.  Prolonged cardiac monitoring for detection of paroxysmal atrial fibrillation after cerebral ischemia. , 2014, Stroke.

[19]  H. Kottkamp Human atrial fibrillation substrate: towards a specific fibrotic atrial cardiomyopathy. , 2013, European heart journal.

[20]  A. Arboix,et al.  Bayés syndrome and acute cardioembolic ischemic stroke , 2017, World journal of clinical cases.

[21]  Yingying Lin,et al.  PAX1 and SOX1 methylation as an initial screening method for cervical cancer: a meta-analysis of individual studies in Asians. , 2016, Annals of translational medicine.

[22]  David J Gladstone,et al.  Atrial fibrillation in patients with cryptogenic stroke. , 2014, The New England journal of medicine.

[23]  P. Clopton,et al.  Diagnostic ability of B-type natriuretic peptide and impedance cardiography: testing to identify left ventricular dysfunction in hypertensive patients. , 2005, American journal of hypertension.

[24]  Rickey E. Carter,et al.  Screening for cardiac contractile dysfunction using an artificial intelligence–enabled electrocardiogram , 2019, Nature Medicine.

[25]  G. Lupi,et al.  Left atrial appendage function assessed by transesophageal echocardiography before and on the day after elective cardioversion for nonvalvular atrial fibrillation. , 1998, The American journal of cardiology.

[26]  P. Kirchhof,et al.  2016 ESC Guidelines for the management of atrial fibrillation developed in collaboration with EACTS. , 2016, European heart journal.

[27]  S. Warach,et al.  Timing of anticoagulation after recent ischaemic stroke in patients with atrial fibrillation , 2019, The Lancet Neurology.

[28]  G. Lip,et al.  Randomized trial of atrial arrhythmia monitoring to guide anticoagulation in patients with implanted defibrillator and cardiac resynchronization devices. , 2015, European heart journal.

[29]  Xavier Robin,et al.  pROC: an open-source package for R and S+ to analyze and compare ROC curves , 2011, BMC Bioinformatics.

[30]  H. Calkins,et al.  2015 ACC/AHA/HRS Guideline for the Management of Adult Patients With Supraventricular Tachycardia: Executive Summary: A Report of the American College of Cardiology/American Heart Association Task Force on Clinical Practice Guidelines and the Heart Rhythm Society. , 2016, Journal of the American College of Cardiology.