Prediction of mortality from 12-lead electrocardiogram voltage data using a deep neural network

The electrocardiogram (ECG) is a widely used medical test, consisting of voltage versus time traces collected from surface recordings over the heart 1 . Here we hypothesized that a deep neural network (DNN) can predict an important future clinical event, 1-year all-cause mortality, from ECG voltage–time traces. By using ECGs collected over a 34-year period in a large regional health system, we trained a DNN with 1,169,662 12-lead resting ECGs obtained from 253,397 patients, in which 99,371 events occurred. The model achieved an area under the curve (AUC) of 0.88 on a held-out test set of 168,914 patients, in which 14,207 events occurred. Even within the large subset of patients ( n  = 45,285) with ECGs interpreted as ‘normal’ by a physician, the performance of the model in predicting 1-year mortality remained high (AUC = 0.85). A blinded survey of cardiologists demonstrated that many of the discriminating features of these normal ECGs were not apparent to expert reviewers. Finally, a Cox proportional-hazard model revealed a hazard ratio of 9.5 ( P  < 0.005) for the two predicted groups (dead versus alive 1 year after ECG) over a 25-year follow-up period. These results show that deep learning can add substantial prognostic information to the interpretation of 12-lead resting ECGs, even in cases that are interpreted as normal by physicians. By using data from electrocardiograms, a deep learning algorithm outperforms traditional risk scores in predicting death over the course of the next year and identifies at-risk individuals with seemingly normal electrocardiograms.

[1]  G. Lanza,et al.  The electrocardiogram as a prognostic tool for predicting major cardiac events. , 2007, Progress in cardiovascular diseases.

[2]  Rickey E Carter,et al.  Prospective validation of a deep learning electrocardiogram algorithm for the detection of left ventricular systolic dysfunction , 2019, Journal of cardiovascular electrophysiology.

[3]  U. Rajendra Acharya,et al.  A deep convolutional neural network model to classify heartbeats , 2017, Comput. Biol. Medicine.

[4]  Á. Avezum,et al.  A validated prediction model for all forms of acute coronary syndrome:estimating the risk of 6-month postdischarge death in an international registry , 2004 .

[5]  Douglas K Owens,et al.  Screening for Cardiovascular Disease Risk With Electrocardiography: US Preventive Services Task Force Recommendation Statement , 2018, JAMA.

[6]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[7]  W. Fye,et al.  A history of the origin, evolution, and impact of electrocardiography. , 1994, The American journal of cardiology.

[8]  Jin He,et al.  Real-Time Multilead Convolutional Neural Network for Myocardial Infarction Detection , 2018, IEEE Journal of Biomedical and Health Informatics.

[9]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[10]  J. McMurray,et al.  Value of the electrocardiogram in identifying heart failure due to left ventricular systolic dysfunction , 1996, BMJ.

[11]  W. Hwang,et al.  Effects of integrated delivery system on cost and quality. , 2013, The American journal of managed care.

[12]  Heinrich Taegtmeyer,et al.  Obesity and the risk of heart failure. , 2002, The New England journal of medicine.

[13]  L. Goldman,et al.  MULTIFACTORIAL INDEX OF CARDIAC RISK IN NONCARDIAC SURGICAL PROCEDURES , 1978 .

[14]  William Robson Schwartz,et al.  ECG-based heartbeat classification for arrhythmia detection: A survey , 2016, Comput. Methods Programs Biomed..

[15]  Gustavo Belforte,et al.  A Contribution to the Automatic Processing of Electrocardiograms Using Syntactic Methods , 1979, IEEE Transactions on Biomedical Engineering.

[16]  E. Kaplan,et al.  Nonparametric Estimation from Incomplete Observations , 1958 .

[17]  LeBlanc Ar Quantitative analysis of cardiac arrhythmias. , 1986 .

[18]  Chiadi E. Ndumele,et al.  Use of Risk Assessment Tools to Guide Decision-Making in the Primary Prevention of Atherosclerotic Cardiovascular Disease: A Special Report From the American Heart Association and American College of Cardiology. , 2019, Journal of the American College of Cardiology.

[19]  Seyed Kamaledin Setarehdan,et al.  Support vector machine-based arrhythmia classification using reduced features of heart rate variability signal , 2008, Artif. Intell. Medicine.

[20]  M. Motwani,et al.  Machine learning for prediction of all-cause mortality in patients with suspected coronary artery disease: a 5-year multicentre prospective registry analysis , 2016, European heart journal.

[21]  D. Levy,et al.  Prediction of coronary heart disease using risk factor categories. , 1998, Circulation.

[22]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[23]  Qiang Chen,et al.  Network In Network , 2013, ICLR.

[24]  Masoumeh Haghpanahi,et al.  Cardiologist-level arrhythmia detection and classification in ambulatory electrocardiograms using a deep neural network , 2019, Nature Medicine.

[25]  Chiadi E. Ndumele,et al.  Use of Risk Assessment Tools to Guide Decision-Making in the Primary Prevention of Atherosclerotic Cardiovascular Disease: A Special Report From the American Heart Association and American College of Cardiology. , 2019, Circulation.

[26]  George Manis,et al.  Heartbeat Time Series Classification With Support Vector Machines , 2009, IEEE Transactions on Information Technology in Biomedicine.

[27]  Giuseppe De Pietro,et al.  A deep learning approach for ECG-based heartbeat classification for arrhythmia detection , 2018, Future Gener. Comput. Syst..

[28]  Tianqi Chen,et al.  Higgs Boson Discovery with Boosted Trees , 2014, HEPML@NIPS.

[29]  Andrew Y. Ng,et al.  Improving palliative care with deep learning , 2017, 2017 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[30]  M. Pencina,et al.  General Cardiovascular Risk Profile for Use in Primary Care: The Framingham Heart Study , 2008, Circulation.

[31]  Willis J. Tompkins,et al.  A Real-Time QRS Detection Algorithm , 1985, IEEE Transactions on Biomedical Engineering.

[32]  Thomas Brox,et al.  Striving for Simplicity: The All Convolutional Net , 2014, ICLR.

[33]  Naif Alajlan,et al.  Deep learning approach for active classification of electrocardiogram signals , 2016, Inf. Sci..

[34]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[35]  E. W. Hancock,et al.  Recommendations for the standardization and interpretation of the electrocardiogram: part I: the electrocardiogram and its technology a scientific statement from the American Heart Association Electrocardiography and Arrhythmias Committee, Council on Clinical Cardiology; the American College of Card , 2007, Journal of the American College of Cardiology.

[36]  H. Quan,et al.  Coding Algorithms for Defining Comorbidities in ICD-9-CM and ICD-10 Administrative Data , 2005, Medical care.

[37]  A R LeBlanc Quantitative analysis of cardiac arrhythmias. , 1986, Critical reviews in biomedical engineering.

[38]  Michael A. Burke,et al.  Phenomapping for Novel Classification of Heart Failure With Preserved Ejection Fraction , 2015, Circulation.

[39]  Rickey E Carter,et al.  An artificial intelligence-enabled ECG algorithm for the identification of patients with atrial fibrillation during sinus rhythm: a retrospective analysis of outcome prediction , 2019, The Lancet.

[40]  R Roberts,et al.  Thrombolysis in Myocardial Infarction (TIMI) Trial, Phase I: A comparison between intravenous tissue plasminogen activator and intravenous streptokinase. Clinical findings through hospital discharge. , 1987, Circulation.

[41]  Danny Eytan,et al.  Towards Understanding ECG Rhythm Classification Using Convolutional Neural Networks and Attention Mappings , 2018, MLHC.

[42]  J. Killian,et al.  Participation in cardiac rehabilitation, readmissions, and death after acute myocardial infarction. , 2014, The American journal of medicine.

[43]  M. Arthanari,et al.  Classification of ECG Signals Using Extreme Learning Machine , 2011, Comput. Inf. Sci..

[44]  I. Ringqvist,et al.  Electrocardiogram and B-type natriuretic peptide as screening tools for left ventricular systolic dysfunction in a population-based sample of 75-year-old men and women. , 2004, American heart journal.

[45]  Sung-Nien Yu,et al.  Electrocardiogram beat classification based on wavelet transformation and probabilistic neural network , 2007, Pattern Recognit. Lett..

[46]  Paul S Addison,et al.  Wavelet transforms and the ECG: a review , 2005, Physiological measurement.

[47]  Lutz Prechelt,et al.  Early Stopping-But When? , 1996, Neural Networks: Tricks of the Trade.

[48]  Jürgen Schmidhuber,et al.  Flat Minima , 1997, Neural Computation.

[49]  R. Orglmeister,et al.  The principles of software QRS detection , 2002, IEEE Engineering in Medicine and Biology Magazine.

[50]  Rickey E. Carter,et al.  Screening for cardiac contractile dysfunction using an artificial intelligence–enabled electrocardiogram , 2019, Nature Medicine.

[51]  D. Mozaffarian,et al.  The Seattle Heart Failure Model: Prediction of Survival in Heart Failure , 2006, Circulation.

[52]  P. C. Cortez,et al.  An innovative approach of QRS segmentation based on first-derivative, Hilbert and Wavelet Transforms. , 2012, Medical engineering & physics.

[53]  J. Rapin,et al.  A deep neural network learning algorithm outperforms a conventional algorithm for emergency department electrocardiogram interpretation. , 2019, Journal of electrocardiology.

[54]  KyungMann Kim,et al.  Contrasting treatment‐specific survival using double‐robust estimators , 2012 .

[55]  Stef van Buuren,et al.  MICE: Multivariate Imputation by Chained Equations in R , 2011 .

[56]  Á. Avezum,et al.  A validated prediction model for all forms of acute coronary syndrome: estimating the risk of 6-month postdischarge death in an international registry. , 2004, JAMA.

[57]  Carlos Guestrin,et al.  XGBoost : Reliable Large-scale Tree Boosting System , 2015 .