Detecting COVID-19 from digitized ECG printouts using 1D convolutional neural networks

The COVID-19 pandemic has exposed the vulnerability of healthcare services worldwide, raising the need to develop novel tools to provide rapid and cost-effective screening and diagnosis. Clinical reports indicated that COVID-19 infection may cause cardiac injury, and electrocardiograms (ECG) may serve as a diagnostic biomarker for COVID-19. This study aims to utilize ECG signals to detect COVID-19 automatically. We propose a novel method to extract ECG signals from ECG paper records, which are then fed into one-dimensional convolution neural network (1D-CNN) to learn and diagnose the disease. To evaluate the quality of digitized signals, R peaks in the paper-based ECG images are labeled. Afterward, RR intervals calculated from each image are compared to RR intervals of the corresponding digitized signal. Experiments on the COVID-19 ECG images dataset demonstrate that the proposed digitization method is able to capture correctly the original signals, with a mean absolute error of 28.11 ms. The 1D-CNN model (SEResNet18), which is trained on the digitized ECG signals, allows to identify between individuals with COVID-19 and other subjects accurately, with classification accuracies of 98.42% and 98.50% for classifying COVID-19 vs. Normal and COVID-19 vs. other classes, respectively. Furthermore, the proposed method also achieves a high-level of performance for the multi-classification task. Our findings indicate that a deep learning system trained on digitized ECG signals can serve as a potential tool for diagnosing COVID-19.

[1]  Khiem H. Le,et al.  Enhancing Deep Learning-based 3-lead ECG Classification with Heartbeat Counting and Demographic Data Integration , 2022, 2022 IEEE-EMBS Conference on Biomedical Engineering and Sciences (IECBES).

[2]  Khiem H. Le,et al.  LightX3ECG: A Lightweight and eXplainable Deep Learning System for 3-lead Electrocardiogram Classification , 2022, Biomed. Signal Process. Control..

[3]  The Lancet Infectious Diseases Transitioning to endemicity with COVID-19 research , 2022, The Lancet Infectious Diseases.

[4]  Emrah Irmak COVID-19 disease diagnosis from paper-based ECG trace image data using a novel convolutional neural network model , 2022, Physical and Engineering Sciences in Medicine.

[5]  Omneya Attallah,et al.  ECG-BiCoNet: An ECG-based pipeline for COVID-19 diagnosis using Bi-Layers of deep features integration , 2022, Computers in Biology and Medicine.

[6]  Jinyong Cheng,et al.  ECG signal classification based on deep CNN and BiLSTM , 2021, BMC Medical Informatics and Decision Making.

[7]  M. Halloran,et al.  Transition to endemicity: Understanding COVID-19 , 2021, Immunity.

[8]  Mehmet Akif Ozdemir,et al.  Classification of COVID-19 electrocardiograms by using hexaxial feature mapping and deep learning , 2021, BMC Medical Informatics and Decision Making.

[9]  Mohammed Hjouj,et al.  Correlation of Chest CT and RT-PCR Testing for Coronavirus Disease 2020(COVID-19) in Palestine: A Report of 200 Cases , 2021 .

[10]  M. Hussain,et al.  ECG Images dataset of Cardiac and COVID-19 Patients , 2021, Data in Brief.

[11]  Anuradha Bhamidipaty,et al.  A Transformer-based Framework for Multivariate Time Series Representation Learning , 2020, KDD.

[12]  N. Mehendale,et al.  ECG Paper Record Digitization and Diagnosis Using Deep Learning , 2020, Journal of Medical and Biological Engineering.

[13]  Jan C. Brammer,et al.  NeuroKit2: A Python toolbox for neurophysiological signal processing , 2020, Behavior Research Methods.

[14]  Hieu H. Pham,et al.  Interpreting Chest X-rays via CNNs that Exploit Hierarchical Disease Dependencies and Uncertainty Labels , 2020, Neurocomputing.

[15]  Mohiudding Ahmad,et al.  Numerical Data Extraction from ECG Paper Recording Using Image Processing Technique , 2020, 2020 11th International Conference on Electrical and Computer Engineering (ICECE).

[16]  Jun Wang,et al.  Deep learning for digitizing highly noisy paper-based ECG records , 2020, Comput. Biol. Medicine.

[17]  Jingyi Wang,et al.  Electrocardiogram analysis of patients with different types of COVID‐19 , 2020, Annals of noninvasive electrocardiology : the official journal of the International Society for Holter and Noninvasive Electrocardiology, Inc.

[18]  M. Bertini,et al.  Electrocardiographic features of 431 consecutive, critically ill COVID-19 patients: an insight into the mechanisms of cardiac involvement , 2020, Europace : European pacing, arrhythmias, and cardiac electrophysiology : journal of the working groups on cardiac pacing, arrhythmias, and cardiac cellular electrophysiology of the European Society of Cardiology.

[19]  K. Raghu,et al.  Impact of COVID-19 on the Cardiovascular System: A Review of Available Reports , 2020, Cardiovascular Drugs and Therapy.

[20]  A. Baranchuk,et al.  Value of electrocardiography in coronavirus disease 2019 (COVID-19) , 2020, Journal of Electrocardiology.

[21]  O. Morel,et al.  Impact of COVID-19 on the Cardiovascular System: A Review , 2020, Journal of clinical medicine.

[22]  Hui Chen,et al.  CT imaging changes of corona virus disease 2019(COVID-19): a multi-center study in Southwest China , 2020, Journal of Translational Medicine.

[23]  Subrata Ghosh,et al.  Implications of COVID-19 for patients with pre-existing digestive diseases , 2020, The Lancet Gastroenterology & Hepatology.

[24]  Su Zeng,et al.  Recent advances and perspectives of nucleic acid detection for coronavirus , 2020, Journal of Pharmaceutical Analysis.

[25]  Q. Tao,et al.  Correlation of Chest CT and RT-PCR Testing in Coronavirus Disease 2019 (COVID-19) in China: A Report of 1014 Cases , 2020, Radiology.

[26]  Z. Fayad,et al.  Chest CT Findings in Coronavirus Disease-19 (COVID-19): Relationship to Duration of Infection , 2020, Radiology.

[27]  Z. Fayad,et al.  CT Imaging Features of 2019 Novel Coronavirus (2019-nCoV) , 2020, Radiology.

[28]  Victor M Corman,et al.  Detection of 2019 novel coronavirus (2019-nCoV) by real-time RT-PCR , 2020, Euro surveillance : bulletin Europeen sur les maladies transmissibles = European communicable disease bulletin.

[29]  Geoffrey I. Webb,et al.  InceptionTime: Finding AlexNet for time series classification , 2019, Data Mining and Knowledge Discovery.

[30]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Xin Liu,et al.  Stroke Sequence-Dependent Deep Convolutional Neural Network for Online Handwritten Chinese Character Recognition , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[32]  Zidong Wang,et al.  Integration of residual network and convolutional neural network along with various activation functions and global pooling for time series classification , 2019, Neurocomputing.

[33]  Amir Asif,et al.  XceptionTime: A Novel Deep Architecture based on Depthwise Separable Convolutions for Hand Gesture Classification , 2019, ArXiv.

[34]  Kuanquan Wang,et al.  A Novel Method for ECG Paper Records Digitization , 2019, 2019 Computing in Cardiology (CinC).

[35]  Magdy A. Bayoumi,et al.  Deep Gated Recurrent and Convolutional Network Hybrid Model for Univariate Time Series Classification , 2018, International Journal of Advanced Computer Science and Applications.

[36]  Ying Liu,et al.  A Comparison of 1-D and 2-D Deep Convolutional Neural Networks in ECG Classification , 2018, Conference proceedings : ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual Conference.

[37]  Houshang Darabi,et al.  LSTM Fully Convolutional Networks for Time Series Classification , 2017, IEEE Access.

[38]  Tim Oates,et al.  Time series classification from scratch with deep neural networks: A strong baseline , 2016, 2017 International Joint Conference on Neural Networks (IJCNN).

[39]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[40]  Frank Hutter,et al.  SGDR: Stochastic Gradient Descent with Warm Restarts , 2016, ICLR.

[41]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[42]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .