Artificial Intelligence System for Detection and Screening of Cardiac Abnormalities using Electrocardiogram Images

The artificial intelligence (AI) system has achieved expert-level performance in electrocardiogram (ECG) signal analysis. However, in underdeveloped countries or regions where the healthcare information system is imperfect, only paper ECGs can be provided. Analysis of real-world ECG images (photos or scans of paper ECGs) remains challenging due to complex environments or interference. In this study, we present an AI system developed to detect and screen cardiac abnormalities (CAs) from real-world ECG images. The system was evaluated on a large dataset of 52,357 patients from multiple regions and populations across the world. On the detection task, the AI system obtained area under the receiver operating curve (AUC) of 0.996 (hold-out test), 0.994 (external test 1), 0.984 (external test 2), and 0.979 (external test 3), respectively. Meanwhile, the detection results of AI system showed a strong correlation with the diagnosis of cardiologists (cardiologist 1 (R=0.794, p<1e-3), cardiologist 2 (R=0.812, p<1e-3)). On the screening task, the AI system achieved AUCs of 0.894 (hold-out test) and 0.850 (external test). The screening performance of the AI system was better than that of the cardiologists (AI system (0.846) vs. cardiologist 1 (0.520) vs. cardiologist 2 (0.480)). Our study demonstrates the feasibility of an accurate, objective, easy-to-use, fast, and low-cost AI system for CA detection and screening. The system has the potential to be used by healthcare professionals, caregivers, and general users to assess CAs based on real-world ECG images.

[1]  S. Pittaluga,et al.  SARS-CoV-2 infection and persistence in the human body and brain at autopsy , 2022, Nature.

[2]  D. Khullar,et al.  Data-driven identification of post-acute SARS-CoV-2 infection subphenotypes , 2022, Nature Medicine.

[3]  S. Sidik Heart disease after COVID: what the data say , 2022, Nature.

[4]  Hui Liu,et al.  A large-scale multi-label 12-lead electrocardiogram database with standardized diagnostic statements , 2022, Scientific data.

[5]  Rizwan Kalani,et al.  Heart Disease and Stroke Statistics—2022 Update: A Report From the American Heart Association , 2022, Circulation.

[6]  A. L. Ribeiro,et al.  Automated multilabel diagnosis on electrocardiographic images and signals , 2021, Nature Communications.

[7]  Gari D Clifford,et al.  Will Two Do? Varying Dimensions in Electrocardiography: The PhysioNet/Computing in Cardiology Challenge 2021 , 2021, 2021 Computing in Cardiology (CinC).

[8]  Zeming Li,et al.  YOLOX: Exceeding YOLO Series in 2021 , 2021, ArXiv.

[9]  Dae-Hyeok Kim,et al.  A new deep learning algorithm of 12-lead electrocardiogram for identifying atrial fibrillation during sinus rhythm , 2021, Scientific Reports.

[10]  Quoc V. Le,et al.  EfficientNetV2: Smaller Models and Faster Training , 2021, ICML.

[11]  Rui Zhang,et al.  Artificial-Intelligence-Enhanced Mobile System for Cardiovascular Health Management , 2021, Sensors.

[12]  Sathish Kumar Jayapal,et al.  Global Burden of Cardiovascular Diseases and Risk Factors, 1990–2019 , 2020, Journal of the American College of Cardiology.

[13]  Mingquan Ye,et al.  Multimodal Glioma Image Segmentation Using Dual Encoder Structure and Channel Spatial Attention Block , 2020, Frontiers in Neuroscience.

[14]  Ali Bahrami Rad,et al.  Classification of 12-lead ECGs: the PhysioNet/Computing in Cardiology Challenge 2020 , 2020, 2020 Computing in Cardiology.

[15]  Shenda Hong,et al.  CardioLearn: A Cloud Deep Learning Service for Cardiac Disease Detection from Electrocardiogram , 2020, WWW.

[16]  Cyril Rakovski,et al.  Optimal Multi-Stage Arrhythmia Classification Approach , 2020, Scientific Reports.

[17]  Hangyuan Guo,et al.  A 12-lead electrocardiogram database for arrhythmia research covering more than 10,000 patients , 2020, Scientific Data.

[18]  Jimeng Sun,et al.  Opportunities and challenges of deep learning methods for electrocardiogram data: A systematic review , 2019, Comput. Biol. Medicine.

[19]  Rickey E Carter,et al.  An artificial intelligence-enabled ECG algorithm for the identification of patients with atrial fibrillation during sinus rhythm: a retrospective analysis of outcome prediction , 2019, The Lancet.

[20]  T. Khoshgoftaar,et al.  A survey on Image Data Augmentation for Deep Learning , 2019, Journal of Big Data.

[21]  Xiangyu Zhang,et al.  Signal Quality Assessment and Lightweight QRS Detection for Wearable ECG SmartVest System , 2019, IEEE Internet of Things Journal.

[22]  Jon Kleinberg,et al.  Transfusion: Understanding Transfer Learning for Medical Imaging , 2019, NeurIPS.

[23]  A. Ng,et al.  Cardiologist-level arrhythmia detection and classification in ambulatory electrocardiograms using a deep neural network , 2019, Nature Medicine.

[24]  Sally L. Baxter,et al.  The practical implementation of artificial intelligence technologies in medicine , 2019, Nature Medicine.

[25]  P. Noseworthy,et al.  Screening for cardiac contractile dysfunction using an artificial intelligence–enabled electrocardiogram , 2019, Nature Medicine.

[26]  Mohammed Baydoun,et al.  High Precision Digitization of Paper-Based ECG Records: A Step Toward Machine Learning , 2019, IEEE Journal of Translational Engineering in Health and Medicine.

[27]  Dong Zhao,et al.  Epidemiology of cardiovascular disease in China: current features and implications , 2018, Nature Reviews Cardiology.

[28]  Shoushui Wei,et al.  An Open Access Database for Evaluating the Algorithms of Electrocardiogram Rhythm and Morphology Abnormality Detection , 2018, Journal of Medical Imaging and Health Informatics.

[29]  Bingli Jiao,et al.  QRS Detection and Measurement Method of ECG Paper Based on Convolutional Neural Networks , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[30]  Aaron Carass,et al.  Why rankings of biomedical image analysis competitions should be interpreted with care , 2018, Nature Communications.

[31]  Selcan Kaplan Berkaya,et al.  A survey on ECG analysis , 2018, Biomed. Signal Process. Control..

[32]  A. Arboix,et al.  Bayés syndrome and acute cardioembolic ischemic stroke , 2017, World journal of clinical cases.

[33]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[34]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[35]  Tomas B. Garcia,et al.  12-Lead ECG: The Art of Interpretation , 2013 .

[36]  Lech Poloński,et al.  An Introduction to ECG Interpretation , 2012 .

[37]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  Jeffrey M. Hausdorff,et al.  Physionet: Components of a New Research Resource for Complex Physiologic Signals". Circu-lation Vol , 2000 .

[39]  Ralf Bousseljot,et al.  Nutzung der EKG-Signaldatenbank CARDIODAT der PTB über das Internet , 2009 .