COV-ECGNET: COVID-19 detection using ECG trace images with deep convolutional neural network

The reliable and rapid identification of the COVID-19 has become crucial to prevent the rapid spread of the disease, ease lockdown restrictions and reduce pressure on public health infrastructures. Recently, several methods and techniques have been proposed to detect the SARS-CoV-2 virus using different images and data. However, this is the first study that will explore the possibility of using deep convolutional neural network (CNN) models to detect COVID-19 from electrocardiogram (ECG) trace images. In this work, COVID-19 and other cardiovascular diseases (CVDs) were detected using deep-learning techniques. A public dataset of ECG images consisting of 1937 images from five distinct categories, such as normal, COVID-19, myocardial infarction (MI), abnormal heartbeat (AHB), and recovered myocardial infarction (RMI) were used in this study. Six different deep CNN models (ResNet18, ResNet50, ResNet101, InceptionV3, DenseNet201, and MobileNetv2) were used to investigate three different classification schemes: (i) two-class classification (normal vs COVID-19); (ii) three-class classification (normal, COVID-19, and other CVDs), and finally, (iii) five-class classification (normal, COVID-19, MI, AHB, and RMI). For two-class and three-class classification, Densenet201 outperforms other networks with an accuracy of 99.1%, and 97.36%, respectively; while for the five-class classification, InceptionV3 outperforms others with an accuracy of 97.83%. ScoreCAM visualization confirms that the networks are learning from the relevant area of the trace images. Since the proposed method uses ECG trace images which can be captured by smartphones and are readily available facilities in low-resources countries, this study will help in faster computer-aided diagnosis of COVID-19 and other cardiac abnormalities.

[1]  Yin Zhong-ke.  Study on illumination compensation method for images , 2008 .

[2]  P. Alam,et al.  R , 1823, The Herodotus Encyclopedia.

[3]  Mehmet Akif Ozdemir,et al.  Classification of COVID-19 electrocardiograms by using hexaxial feature mapping and deep learning , 2021, BMC Medical Informatics and Decision Making.

[4]  Saad Kashem,et al.  Transfer Learning with Deep Convolutional Neural Network (CNN) for Pneumonia Detection using Chest X-ray , 2020, Applied Sciences.

[5]  M. Hussain,et al.  ECG Images dataset of Cardiac and COVID-19 Patients , 2021, Data in Brief.

[6]  Abdulkadir Şengür,et al.  The investigation of multiresolution approaches for chest X-ray image based COVID-19 detection , 2020, Health Inf. Sci. Syst..

[7]  Hao Wu,et al.  CXNet-m1: Anomaly Detection on Chest X-Rays With Image-Based Deep Learning , 2019, IEEE Access.

[8]  P. Alam.  ‘L’ , 2021, Composites Engineering: An A–Z Guide.

[9]  S. Kiranyaz,et al.  An Intelligent and Low-Cost Eye-Tracking System for Motorized Wheelchair Control , 2020, Sensors.

[10]  Muhammad Arif,et al.  COVID-CheXNet: hybrid deep learning framework for identifying COVID-19 virus in chest X-rays images , 2020, Soft computing.

[11]  Abdulkadir Şengür,et al.  Deep learning approaches for COVID-19 detection based on chest X-ray images , 2020, Expert Systems with Applications.

[12]  Marios Anthimopoulos,et al.  Multi-source Transfer Learning with Convolutional Neural Networks for Lung Pattern Analysis , 2016, IEEE journal of biomedical and health informatics.

[13]  Moncef Gabbouj,et al.  COVID-19 infection map generation and detection from chest X-ray images , 2020, Health Information Science and Systems.

[14]  Serkan Kiranyaz,et al.  Exploring the effect of image enhancement techniques on COVID-19 detection using chest X-ray images , 2020, Computers in Biology and Medicine.

[15]  Li Yu,et al.  FM-ECG: A fine-grained multi-label framework for ECG image classification , 2021, Inf. Sci..

[16]  Piyush Kumar Shukla,et al.  Deep Transfer Learning Based Classification Model for COVID-19 Disease , 2020, IRBM.

[17]  Qiurong Ruan,et al.  Clinical predictors of mortality due to COVID-19 based on an analysis of data of 150 patients from Wuhan, China , 2020, Intensive Care Medicine.

[18]  Toby P. Breckon,et al.  Transfer learning using convolutional neural networks for object classification within X-ray baggage security imagery , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[19]  Aditya Khamparia,et al.  A Novel Transfer Learning Based Approach for Pneumonia Detection in Chest X-ray Images , 2020, Applied Sciences.

[20]  P. Alam.  ‘S’ , 2021, Composites Engineering: An A–Z Guide.

[21]  Serkan Kiranyaz,et al.  Coronavirus: Comparing COVID-19, SARS and MERS in the eyes of AI , 2020, ArXiv.

[22]  Nima Tajbakhsh,et al.  Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning? , 2016, IEEE Transactions on Medical Imaging.

[23]  Moncef Gabbouj,et al.  Robust R-Peak Detection in Low-Quality Holter ECGs Using 1D Convolutional Neural Network , 2020, IEEE Transactions on Biomedical Engineering.

[24]  Amith Khandakar,et al.  An Early Warning Tool for Predicting Mortality Risk of COVID-19 Patients Using Machine Learning , 2020, Cogn. Comput..

[25]  Vineeth N. Balasubramanian,et al.  Grad-CAM++: Generalized Gradient-Based Visual Explanations for Deep Convolutional Networks , 2017, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[26]  David A Morrow,et al.  Myocardial Infarction: A Companion to Braunwald's Heart Disease , 2016 .

[27]  Bin Yao,et al.  ECG Arrhythmia Classification Using STFT-Based Spectrogram and Convolutional Neural Network , 2019, IEEE Access.

[28]  Hua Yang,et al.  Transfer-Learning-Based Online Mura Defect Classification , 2018, IEEE Transactions on Semiconductor Manufacturing.

[29]  A. Ng,et al.  Deep learning for chest radiograph diagnosis: A retrospective comparison of the CheXNeXt algorithm to practicing radiologists , 2018, PLoS medicine.

[30]  Martin Wattenberg,et al.  SmoothGrad: removing noise by adding noise , 2017, ArXiv.

[31]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[32]  Philip R. O. Payne,et al.  Computational analysis to repurpose drugs for COVID-19 based on transcriptional response of host cells to SARS-CoV-2 , 2021, BMC Medical Informatics and Decision Making.

[33]  Farayi Musharavati,et al.  Detection and Severity Classification of COVID-19 in CT Images Using Deep Learning , 2021, Diagnostics.

[34]  Satish T. S. Bukkapatnam,et al.  A Dynamic Systems Approach for Detecting and Localizing of Infarct-Related Artery in Acute Myocardial Infarction Using Compressed Paper-Based Electrocardiogram (ECG) , 2020, Sensors.

[35]  Juan Yu,et al.  Multi-resolution convolutional networks for chest X-ray radiograph based lung nodule detection , 2019, Artif. Intell. Medicine.

[36]  Mamun Bin Ibne Reaz,et al.  Can AI Help in Screening Viral and COVID-19 Pneumonia? , 2020, IEEE Access.

[37]  Murat Ucar,et al.  Computer-Aided Detection of Lung Nodules in Chest X-Rays using Deep Convolutional Neural Networks , 2019 .

[38]  A deep learning algorithm using CT images to screen for Corona virus disease (COVID-19) , 2021, European Radiology.

[39]  Aras Masood Ismael,et al.  IKONOS: an intelligent tool to support diagnosis of COVID-19 by texture analysis of X-ray images , 2020, Research on Biomedical Engineering.

[40]  Serkan Kiranyaz,et al.  EDITH : ECG Biometrics Aided by Deep Learning for Reliable Individual Authentication , 2021, IEEE Transactions on Emerging Topics in Computational Intelligence.

[41]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[42]  Yuedong Yang,et al.  Deep Learning Enables Accurate Diagnosis of Novel Coronavirus (COVID-19) With CT Images , 2020, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[43]  U. Rajendra Acharya,et al.  Automated detection of COVID-19 cases using deep neural networks with X-ray images , 2020, Computers in Biology and Medicine.

[44]  Yann LeCun,et al.  Convolutional networks and applications in vision , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[45]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[46]  Chang Liu,et al.  TX-CNN: Detecting tuberculosis in chest X-ray images using convolutional neural network , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[47]  Covid-19 diagnosis by combining RT-PCR and pseudo-convolutional machines to characterize virus sequences , 2021, Scientific reports.

[48]  Zumray Dokur,et al.  X-Ray Chest Image Classification by A Small-Sized Convolutional Neural Network , 2019, 2019 Scientific Meeting on Electrical-Electronics & Biomedical Engineering and Computer Science (EBBT).

[49]  N. Sri Madhava Raja,et al.  Deep-learning framework to detect lung abnormality - A study with chest X-Ray and lung CT scan images , 2020, Pattern Recognit. Lett..

[50]  James Parker,et al.  on Knowledge and Data Engineering, , 1990 .

[51]  Bijaya Ketan Panigrahi,et al.  Deep transfer learning-based automated detection of COVID-19 from lung CT scan slices , 2020, Applied Intelligence.

[52]  L. Fabbri,et al.  Electrocardiographic features of patients with COVID-19 pneumonia , 2020, European Journal of Internal Medicine.

[53]  Su Ruan,et al.  Multi-task deep learning based CT imaging analysis for COVID-19 pneumonia: Classification and segmentation , 2020, Computers in Biology and Medicine.

[54]  Amith Khandakar,et al.  Reliable Tuberculosis Detection Using Chest X-Ray With Deep Learning, Segmentation and Visualization , 2020, IEEE Access.

[55]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[56]  G. Dhiman,et al.  ADOPT: automatic deep learning and optimization-based approach for detection of novel coronavirus COVID-19 disease using X-ray images , 2021, Journal of biomolecular structure & dynamics.

[57]  Wei Wang,et al.  Early prediction of disease progression in COVID-19 pneumonia patients with chest CT and clinical characteristics , 2020, Nature Communications.

[58]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[59]  Zijian Zhang,et al.  Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networks , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).