Classification of COVID-19 electrocardiograms by using hexaxial feature mapping and deep learning

Background Coronavirus disease 2019 (COVID-19) has become a pandemic since its first appearance in late 2019. Deaths caused by COVID-19 are still increasing day by day and early diagnosis has become crucial. Since current diagnostic methods have many disadvantages, new investigations are needed to improve the performance of diagnosis. Methods A novel method is proposed to automatically diagnose COVID-19 by using Electrocardiogram (ECG) data with deep learning for the first time. Moreover, a new and effective method called hexaxial feature mapping is proposed to represent 12-lead ECG to 2D colorful images. Gray-Level Co-Occurrence Matrix (GLCM) method is used to extract features and generate hexaxial mapping images. These generated images are then fed into a new Convolutional Neural Network (CNN) architecture to diagnose COVID-19. Results Two different classification scenarios are conducted on a publicly available paper-based ECG image dataset to reveal the diagnostic capability and performance of the proposed approach. In the first scenario, ECG data labeled as COVID-19 and No-Findings (normal) are classified to evaluate COVID-19 classification ability. According to results, the proposed approach provides encouraging COVID-19 detection performance with an accuracy of 96.20% and F1-Score of 96.30%. In the second scenario, ECG data labeled as Negative (normal, abnormal, and myocardial infarction) and Positive (COVID-19) are classified to evaluate COVID-19 diagnostic ability. The experimental results demonstrated that the proposed approach provides satisfactory COVID-19 prediction performance with an accuracy of 93.00% and F1-Score of 93.20%. Furthermore, different experimental studies are conducted to evaluate the robustness of the proposed approach. Conclusion Automatic detection of cardiovascular changes caused by COVID-19 can be possible with a deep learning framework through ECG data. This not only proves the presence of cardiovascular changes caused by COVID-19 but also reveals that ECG can potentially be used in the diagnosis of COVID-19. We believe the proposed study may provide a crucial decision-making system for healthcare professionals. Source code All source codes are made publicly available at: https://github.com/mkfzdmr/COVID-19-ECG-Classification

[1]  Su Ruan,et al.  Multi-task deep learning based CT imaging analysis for COVID-19 pneumonia: Classification and segmentation , 2020, Computers in Biology and Medicine.

[2]  Yuedong Yang,et al.  Deep Learning Enables Accurate Diagnosis of Novel Coronavirus (COVID-19) With CT Images , 2020, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[3]  U. Rajendra Acharya,et al.  Automated detection of COVID-19 cases using deep neural networks with X-ray images , 2020, Computers in Biology and Medicine.

[4]  M. Hussain,et al.  ECG Images dataset of Cardiac and COVID-19 Patients , 2021, Data in Brief.

[5]  Z. Fayad,et al.  Chest CT Findings in Coronavirus Disease-19 (COVID-19): Relationship to Duration of Infection , 2020, Radiology.

[6]  R. Ronsoni,et al.  The Electrocardiogram in the Differential Diagnosis of Cardiologic Conditions Related to the COVID-19 Pandemic , 2020 .

[7]  D. Sado,et al.  Life-threatening cardiac tamponade complicating myo-pericarditis in COVID-19 , 2020, European heart journal.

[8]  P. Sathyanarayana,et al.  Image Texture Feature Extraction Using GLCM Approach , 2013 .

[9]  P. Okin,et al.  Electrocardiographic Findings in Coronavirus Disease-19: Insights on Mortality and Underlying Myocardial Processes , 2020, Journal of Cardiac Failure.

[10]  Xiaolong Zhai,et al.  Automated ECG Classification Using Dual Heartbeat Coupling Based on Convolutional Neural Network , 2018, IEEE Access.

[11]  Jun Liu,et al.  Chest CT for Typical 2019-nCoV Pneumonia: Relationship to Negative RT-PCR Testing , 2020, Radiology.

[12]  Muhammad Arif,et al.  COVID-CheXNet: hybrid deep learning framework for identifying COVID-19 virus in chest X-rays images , 2020, Soft computing.

[13]  Philip R. O. Payne,et al.  Computational analysis to repurpose drugs for COVID-19 based on transcriptional response of host cells to SARS-CoV-2 , 2021, BMC Medical Informatics and Decision Making.

[14]  Ali Mohammad Alqudah,et al.  ECG CLASSIFICATION USING HIGHER ORDER SPECTRAL ESTIMATION AND DEEP LEARNING TECHNIQUES , 2019, Neural Network World.

[15]  Mesut Toğaçar,et al.  COVID-19 detection using deep learning models to exploit Social Mimic Optimization and structured chest X-ray images using fuzzy color and stacking approaches , 2020, Computers in Biology and Medicine.

[16]  Jean-Daniel Boissonnat,et al.  Smooth surface reconstruction via natural neighbour interpolation of distance functions , 2000, SCG '00.

[17]  R. Nemati,et al.  Electrocardiography in Early Diagnosis of Cardiovascular Complications of COVID-19; a Systematic Literature Review , 2020, Archives of academic emergency medicine.

[18]  Mohd Javaid,et al.  Medical 4.0 and Its Role in Healthcare During COVID-19 Pandemic: A Review , 2020 .

[19]  A. Baranchuk,et al.  Value of electrocardiography in coronavirus disease 2019 (COVID-19) , 2020, Journal of Electrocardiology.

[20]  S. Lo,et al.  A familial cluster of pneumonia associated with the 2019 novel coronavirus indicating person-to-person transmission: a study of a family cluster , 2020, The Lancet.

[21]  M. Javaid,et al.  Effects of COVID-19 pandemic in daily life , 2020, Current Medicine Research and Practice.

[22]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[23]  Optimization of frontal-plane electrocardiographic lead data in the 30° hexaxial system , 1973 .

[24]  C. Lau,et al.  Cardiovascular sequalae in uncomplicated COVID-19 survivors , 2021, PloS one.

[25]  U. Rajendra Acharya,et al.  Application of deep learning technique to manage COVID-19 in routine clinical practice using CT images: Results of 10 convolutional neural networks , 2020, Computers in Biology and Medicine.

[26]  B. Pavri,et al.  Behavior of the PR interval with increasing heart rate in patients with COVID-19 , 2020, Heart Rhythm.

[27]  Aydin Akan,et al.  EEG-based emotion recognition with deep convolutional neural networks , 2020, Biomedizinische Technik. Biomedical engineering.

[28]  G. Kay,et al.  Atrial Arrhythmias in COVID-19 Patients , 2020, JACC: Clinical Electrophysiology.

[29]  R. Debiasi,et al.  Enhanced electrocardiographic monitoring of patients with Coronavirus Disease 2019 , 2020, Heart Rhythm.

[30]  M. Javaid,et al.  3D printing for development of medical equipment amidst coronavirus (COVID-19) pandemic—review and advancements , 2020, Research on Biomedical Engineering.

[31]  M. N. Taib,et al.  GLCM texture classification for EEG spectrogram image , 2010, 2010 IEEE EMBS Conference on Biomedical Engineering and Sciences (IECBES).

[32]  Jingyi Wang,et al.  Electrocardiogram analysis of patients with different types of COVID‐19 , 2020, Annals of noninvasive electrocardiology : the official journal of the International Society for Holter and Noninvasive Electrocardiology, Inc.

[33]  Abdulkadir Şengür,et al.  Deep learning approaches for COVID-19 detection based on chest X-ray images , 2020, Expert Systems with Applications.

[34]  Tapio Seppänen,et al.  Experiences in digitizing and digitally measuring a paper-based ECG archive. , 2017, Journal of electrocardiology.

[35]  M. Javaid,et al.  Internet of Medical Things (IoMT) for orthopaedic in COVID-19 pandemic: Roles, challenges, and applications , 2020, Journal of Clinical Orthopaedics and Trauma.

[36]  Joseph C. Tsai,et al.  Using machine learning of clinical data to diagnose COVID-19: a systematic review and meta-analysis , 2020, BMC Medical Informatics and Decision Making.

[37]  U. Rajendra Acharya,et al.  Arrhythmia detection using deep convolutional neural network with long duration ECG signals , 2018, Comput. Biol. Medicine.

[38]  R. Suman,et al.  Industry 4.0 technologies and their applications in fighting COVID-19 pandemic , 2020, Diabetes & Metabolic Syndrome: Clinical Research & Reviews.

[39]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[40]  Nianyin Zeng,et al.  Morphological Arrhythmia Automated Diagnosis Method Using Gray-Level Co-Occurrence Matrix Enhanced Convolutional Neural Network , 2019, IEEE Access.

[41]  M. Tuncer,et al.  Interpretation of arrhythmogenic effects of COVID-19 disease through ECG , 2020, The aging male : the official journal of the International Society for the Study of the Aging Male.

[42]  Mohd Javaid,et al.  Areas of academic research with the impact of COVID-19 , 2020, The American Journal of Emergency Medicine.

[43]  Bijaya Ketan Panigrahi,et al.  Deep transfer learning-based automated detection of COVID-19 from lung CT scan slices , 2020, Applied Intelligence.

[44]  L. Fabbri,et al.  Electrocardiographic features of patients with COVID-19 pneumonia , 2020, European Journal of Internal Medicine.

[45]  Ozlem Karabiber Cura,et al.  Abnormal ECG Beat Detection Based on Convolutional Neural Networks , 2020, 2020 Medical Technologies Congress (TIPTEKNO).

[46]  Guilherme Duprat Ceniccola,et al.  Current technologies in body composition assessment: advantages and disadvantages. , 2019, Nutrition.

[47]  G E Dower,et al.  Deriving the 12-lead electrocardiogram from four (EASI) electrodes. , 1988, Journal of electrocardiology.

[48]  Sunghoon Jung,et al.  Atrial fibrillation classification based on convolutional neural networks , 2019, BMC Medical Informatics and Decision Making.

[49]  Esmita Charani,et al.  Comparison of deep learning with regression analysis in creating predictive models for SARS-CoV-2 outcomes , 2020, BMC Medical Informatics and Decision Making.

[50]  G. Dhiman,et al.  ADOPT: automatic deep learning and optimization-based approach for detection of novel coronavirus COVID-19 disease using X-ray images , 2021, Journal of biomolecular structure & dynamics.

[51]  Henggui Zhang,et al.  Automatic Detection of Atrial Fibrillation Based on Continuous Wavelet Transform and 2D Convolutional Neural Networks , 2018, Front. Physiol..

[52]  Qiming Liu,et al.  Characteristic Electrocardiographic Manifestations in Patients With COVID-19 , 2020, Canadian Journal of Cardiology.

[53]  Stefanos Karakanis,et al.  Lightweight deep learning models for detecting COVID-19 from chest X-ray images , 2020, Computers in Biology and Medicine.

[54]  E. Garde,et al.  Chloroquine-induced QTc prolongation in COVID-19 patients , 2020, Netherlands Heart Journal.

[55]  Mohit Tyagi,et al.  Significant applications of virtual reality for COVID-19 pandemic , 2020, Diabetes & Metabolic Syndrome: Clinical Research & Reviews.

[56]  Mohammed Baydoun,et al.  High Precision Digitization of Paper-Based ECG Records: A Step Toward Machine Learning , 2019, IEEE Journal of Translational Engineering in Health and Medicine.

[57]  K. Lam,et al.  ECG: essential in care of patients with COVID‐19 , 2020, Medical Journal of Australia.

[58]  Aydin Akan,et al.  Epileptic EEG Classification by Using Time-Frequency Images for Deep Learning , 2021, Int. J. Neural Syst..

[59]  Aydin Akan,et al.  Cardiac Arrhythmia Detection from 2D ECG Images by Using Deep Learning Technique , 2019, 2019 Medical Technologies Congress (TIPTEKNO).

[60]  Ozal Yildirim,et al.  1D-CADCapsNet: One dimensional deep capsule networks for coronary artery disease detection using ECG signals. , 2020, Physica medica : PM : an international journal devoted to the applications of physics to medicine and biology : official journal of the Italian Association of Biomedical Physics.

[61]  Aydin Akan,et al.  Arrhythmic Heartbeat Classification Using 2D Convolutional Neural Networks , 2021, IRBM.

[62]  Publisher's Note , 2018, Anaesthesia.

[63]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[64]  R. Suman,et al.  Internet of things (IoT) applications to fight against COVID-19 pandemic , 2020, Diabetes & Metabolic Syndrome: Clinical Research & Reviews.

[65]  W. Manning,et al.  COVID-19-Associated Stress (Takotsubo) Cardiomyopathy. , 2020, Circulation. Cardiovascular imaging.

[66]  Muhammad Bilal,et al.  Classification of Arrhythmia by Using Deep Learning with 2-D ECG Spectral Image Representation , 2020, Remote. Sens..

[67]  Bin Yao,et al.  ECG Arrhythmia Classification Using STFT-Based Spectrogram and Convolutional Neural Network , 2019, IEEE Access.

[68]  Myung K. Park,et al.  How to Read Pediatric ECGs , 1981 .

[69]  Risk factors and electrocardiogram characteristics for mortality in critical inpatients with COVID‐19 , 2020, Clinical cardiology.

[70]  Victor M Corman,et al.  Detection of 2019 novel coronavirus (2019-nCoV) by real-time RT-PCR , 2020, Euro surveillance : bulletin Europeen sur les maladies transmissibles = European communicable disease bulletin.

[71]  Satish T. S. Bukkapatnam,et al.  A Dynamic Systems Approach for Detecting and Localizing of Infarct-Related Artery in Acute Myocardial Infarction Using Compressed Paper-Based Electrocardiogram (ECG) , 2020, Sensors.

[72]  M. Bertini,et al.  Electrocardiographic features of 431 consecutive, critically ill COVID-19 patients: an insight into the mechanisms of cardiac involvement , 2020, Europace : European pacing, arrhythmias, and cardiac electrophysiology : journal of the working groups on cardiac pacing, arrhythmias, and cardiac cellular electrophysiology of the European Society of Cardiology.

[73]  M. Vidovich.  Transient Brugada-Like Electrocardiographic Pattern in a Patient With COVID-19 , 2020, JACC Case Reports.

[74]  Dhanashree Gadkari,et al.  Image Quality Analysis Using Glcm , 2004 .

[75]  Tomasz Rymarczyk,et al.  The Use of Time-Frequency Moments as Inputs of LSTM Network for ECG Signal Classification , 2020, Electronics.

[76]  Bo Xu,et al.  A deep learning algorithm using CT images to screen for Corona virus disease (COVID-19) , 2020, European Radiology.

[77]  Jun Wang,et al.  Deep learning for digitizing highly noisy paper-based ECG records , 2020, Comput. Biol. Medicine.

[78]  Shervan Fekri Ershad,et al.  Texture image analysis and texture classification methods - A review , 2019, ArXiv.

[79]  Piyush Kumar Shukla,et al.  Deep Transfer Learning Based Classification Model for COVID-19 Disease , 2020, IRBM.

[80]  D. Brodie,et al.  The Variety of Cardiovascular Presentations of COVID-19 , 2020, Circulation.

[81]  N. Brunetti,et al.  QTc interval prolongation and life-threatening arrhythmias during hospitalization in patients with COVID-19. Results from a multi-center prospective registry , 2020, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[82]  Mohd Javaid,et al.  Industry 5.0: Potential Applications in COVID-19 , 2020, Journal of Industrial Integration and Management.

[83]  Ali Işın,et al.  Cardiac arrhythmia detection using deep learning , 2017 .