Automatic Diagnosis of the Short-Duration 12-Lead ECG using a Deep Neural Network: the CODE Study

We present a Deep Neural Network (DNN) model for predicting electrocardiogram (ECG) abnormalities in short-duration 12-lead ECG recordings. The analysis of the digital ECG obtained in a clinical setting can provide a full evaluation of the cardiac electrical activity and have not been studied in an end-to-end machine learning scenario. Using the database of the Telehealth Network of Minas Gerais, under the scope of the CODE (Clinical Outcomes in Digital Electrocardiology) study, we built a novel dataset with more than 2 million ECG tracings, orders of magnitude larger than those used in previous studies. Moreover, our dataset is more realistic, as it consists of 12-lead ECGs recorded during standard in-clinic exams. Using this data, we trained a residual neural network with 9 convolutional layers to map ECG signals with a duration of 7 to 10 seconds into 6 different classes of ECG abnormalities. High-performance measures were obtained for all ECG abnormalities, with F1 scores above $80\%$ and specificity indexes over $99\%$. We compare the performance with cardiology and emergency resident medical doctors as well as medical students and, considering the F1 score, the DNN matches or outperforms the medical residents and students for all abnormalities. These results indicate that end-to-end automatic ECG analysis based on DNNs, previously used only in a single-lead setup, generalizes well to the 12-lead ECG. This is an important result in that it takes this technology much closer to standard clinical practice.

[1]  Q. Mcnemar Note on the sampling error of the difference between correlated proportions or percentages , 1947, Psychometrika.

[2]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[3]  A. Marty Minnesota Code Manual of Electrocardiographic Findings , 1983 .

[4]  P W Macfarlane,et al.  Testing the performance of ECG computer programs: the CSE diagnostic pilot study. , 1987, Journal of electrocardiology.

[5]  P W Macfarlane,et al.  Methodology of ECG Interpretation in the Glasgow Program , 1990, Methods of Information in Medicine.

[6]  J. L. Willems,et al.  The diagnostic performance of computer programs for the interpretation of electrocardiograms. , 1992, The New England journal of medicine.

[7]  E. Antman,et al.  A Neural Network System for Detection of Atrial Fibrillation in Ambulatory Electrocardiograms , 1994, Journal of cardiovascular electrophysiology.

[8]  P W Macfarlane,et al.  Automated serial ECG comparison based on the Minnesota code. , 1996, Journal of electrocardiology.

[9]  Jeffrey M. Hausdorff,et al.  Physionet: Components of a New Research Resource for Complex Physiologic Signals". Circu-lation Vol , 2000 .

[10]  Alan D. Lopez,et al.  The Global Burden of Disease Study , 2003 .

[11]  P. Macfarlane,et al.  The university of glasgow (Uni-G) ECG analysis program , 2005, Computers in Cardiology, 2005.

[12]  A. Shah,et al.  Errors in the computerized electrocardiogram interpretation of cardiac rhythm. , 2007, Journal of electrocardiology.

[13]  E. W. Hancock,et al.  Recommendations for the standardization and interpretation of the electrocardiogram. Part II: Electrocardiography diagnostic statement list. A scientific statement from the American Heart Association Electrocardiography and Arrhythmias Committee, Council on Clinical Cardiology; the American College , 2007, Heart rhythm.

[14]  M. Kenward,et al.  An Introduction to the Bootstrap , 2007 .

[15]  G. Lip,et al.  Accuracy of diagnosing atrial fibrillation on electrocardiogram by primary care practitioners and interpretative diagnostic software: analysis of data from screening for atrial fibrillation in the elderly (SAFE) trial , 2007, BMJ : British Medical Journal.

[16]  E. W. Hancock,et al.  AHA/ACCF/HRS recommendations for the standardization and interpretation of the electrocardiogram: part IV: the ST segment, T and U waves, and the QT interval: a scientific statement from the American Heart Association Electrocardiography and Arrhythmias Committee, Council on Clinical Cardiology; the , 2009, Journal of the American College of Cardiology.

[17]  Sven Behnke,et al.  Evaluation of Pooling Operations in Convolutional Architectures for Object Recognition , 2010, ICANN.

[18]  S. Luo,et al.  A review of electrocardiogram filtering. , 2010, Journal of electrocardiology.

[19]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups , 2012, IEEE Signal Processing Magazine.

[20]  M. B. Alkmim,et al.  Improving patient access to specialized health care: the Telehealth Network of Minas Gerais, Brazil. , 2012, Bulletin of the World Health Organization.

[21]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[22]  N. Estes,et al.  Computerized Interpretation of ECGs Supplement Not a Substitute , 2013 .

[23]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[24]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[25]  Takaya Saito,et al.  The Precision-Recall Plot Is More Informative than the ROC Plot When Evaluating Binary Classifiers on Imbalanced Datasets , 2015, PloS one.

[26]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[27]  Shweta H. Jambukia,et al.  Classification of ECG signals using machine learning techniques: A survey , 2015, 2015 International Conference on Advances in Computer Engineering and Applications.

[28]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[29]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Naif Alajlan,et al.  Deep learning approach for active classification of electrocardiogram signals , 2016, Inf. Sci..

[31]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[32]  E. Beck,et al.  Protecting the confidentiality and security of personal health information in low- and middle-income countries in the era of SDGs and Big Data , 2016, Global health action.

[33]  G. Veronese,et al.  Emergency physician accuracy in interpreting electrocardiograms with potential ST-segment elevation myocardial infarction: Is it enough? , 2016, Acute cardiac care.

[34]  Qiao Li,et al.  AF classification from a short single lead ECG recording: The PhysioNet/computing in cardiology challenge 2017 , 2017, 2017 Computing in Cardiology (CinC).

[35]  H. Wellens,et al.  Computer-Interpreted Electrocardiograms: Benefits and Limitations. , 2017, Journal of the American College of Cardiology.

[36]  R. Sassi,et al.  PDF-ECG in clinical practice: A model for long-term preservation of digital 12-lead ECG data. , 2017, Journal of electrocardiology.

[37]  U. Rajendra Acharya,et al.  Application of deep convolutional neural network for automated detection of myocardial infarction using ECG signals , 2017, Inf. Sci..

[38]  Andrew H. Beck,et al.  Diagnostic Assessment of Deep Learning Algorithms for Detection of Lymph Node Metastases in Women With Breast Cancer , 2017, JAMA.

[39]  Saeed Babaeizadeh,et al.  Densely connected convolutional networks and signal quality analysis to detect atrial fibrillation using short single-lead ECG recordings , 2017, 2017 Computing in Cardiology (CinC).

[40]  W. Stead Clinical Implications and Challenges of Artificial Intelligence and Deep Learning. , 2018, JAMA.

[41]  C. Naylor,et al.  On the Prospects for a (Deep) Learning Health Care System , 2018, JAMA.

[42]  Geraint Rees,et al.  Clinically applicable deep learning for diagnosis and referral in retinal disease , 2018, Nature Medicine.

[43]  Pablo Laguna,et al.  Computational techniques for ECG analysis and interpretation in light of their contribution to medical advances , 2018, Journal of The Royal Society Interface.

[44]  Shamim Nemati,et al.  Detection of Paroxysmal Atrial Fibrillation using Attention-based Bidirectional Recurrent Neural Networks , 2018, KDD.

[45]  Barbara C. A. Marino,et al.  Implementing myocardial infarction systems of care in low/middle-income countries , 2018, Heart.

[46]  Geoffrey E. Hinton Deep Learning-A Technology With the Potential to Transform Health Care. , 2018, JAMA.

[47]  Masoumeh Haghpanahi,et al.  Cardiologist-level arrhythmia detection and classification in ambulatory electrocardiograms using a deep neural network , 2019, Nature Medicine.