Automated ECG classification using a non-local convolutional block attention module

BACKGROUND AND OBJECTIVE Recent advances in deep learning have been applied to ECG detection and obtained great success. The spatial and temporal information from ECG signals is fused by combining convolutional neural networks (CNN) with recurrent neural network (RNN). However, these networks ignore the different contribution of local and global segments of a feature map extracted from the ECG and the correlation relationship between the above two segments. To address this issue, a novel convolutional neural network with non-local convolutional block attention module(NCBAM) is proposed to automatically classify ECG heartbeats. METHODS Our proposed method consists of a 33-layer CNN architecture followed by a NCBAM module. Initially, preprocessed electrocardiogram (ECG) signals are fed into the CNN architecture to extract the spatial and channel features. Further, long-range dependencies of representative features along spatial and channel axis are captured by non-local attention. Finally, the spatial, channel and temporal information of ECG are fused by a learned matrix. The learned matrix is to mine rich relationship information across the above three types of information to make up for the different contribution. RESULTS AND CONCLUSION The proposed method achieves an average F1 score of 0.9664 on MIT-BIH arrhythmia database, as well as AUC of 0.9314 and Fmax of 0.8507 on PTB-XL ECG database. Compared with the state-of-the-art attention mechanism based on the same public database, NCBAM achieves an obvious improvement in classifying ECG heartbeats. The results demonstrate the proposed method is reliable and efficient for ECG beat classification.

[1]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[2]  Sunita Sarawagi,et al.  Discriminative Methods for Multi-labeled Classification , 2004, PAKDD.

[3]  Francesca N. Delling,et al.  Heart Disease and Stroke Statistics—2019 Update: A Report From the American Heart Association , 2019, Circulation.

[4]  Jing Zhang,et al.  ECG-based multi-class arrhythmia detection using spatio-temporal attention-based convolutional recurrent neural network , 2020, Artif. Intell. Medicine.

[5]  Matin Hashemi,et al.  LSTM-Based ECG Classification for Continuous Monitoring on Personal Wearable Devices , 2018, IEEE Journal of Biomedical and Health Informatics.

[6]  Geoffrey I. Webb,et al.  InceptionTime: Finding AlexNet for time series classification , 2019, Data Mining and Knowledge Discovery.

[7]  U. Rajendra Acharya,et al.  Automated beat-wise arrhythmia diagnosis using modified U-net on extended electrocardiographic recordings with heterogeneous arrhythmia types , 2019, Comput. Biol. Medicine.

[8]  Zhengya Sun,et al.  Inter-Patient ECG Classification With Symbolic Representations and Multi-Perspective Convolutional Neural Networks , 2020, IEEE Journal of Biomedical and Health Informatics.

[9]  Jeffrey M. Hausdorff,et al.  Physionet: Components of a New Research Resource for Complex Physiologic Signals". Circu-lation Vol , 2000 .

[10]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[11]  Andrew McCallum,et al.  Collective multi-label classification , 2005, CIKM '05.

[12]  Arnab Bhattacharjee,et al.  Deep Learning Approach to Cardiovascular Disease Classification Employing Modified ECG Signal from Empirical Mode Decomposition , 2019, Biomed. Signal Process. Control..

[13]  Masoumeh Haghpanahi,et al.  Cardiologist-level arrhythmia detection and classification in ambulatory electrocardiograms using a deep neural network , 2019, Nature Medicine.

[14]  In-So Kweon,et al.  CBAM: Convolutional Block Attention Module , 2018, ECCV.

[15]  Anthony Choi,et al.  Using neural networks to predict cardiac arrhythmias , 2012, 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[16]  Ricardo Buettner,et al.  Efficient machine learning based detection of heart disease , 2019, 2019 IEEE International Conference on E-health Networking, Application & Services (HealthCom).

[17]  G.B. Moody,et al.  The impact of the MIT-BIH Arrhythmia Database , 2001, IEEE Engineering in Medicine and Biology Magazine.

[18]  William Robson Schwartz,et al.  ECG-based heartbeat classification for arrhythmia detection: A survey , 2016, Comput. Methods Programs Biomed..

[19]  Chengjin Qin,et al.  Automated heartbeat classification based on deep neural network with multiple input layers , 2020, Knowl. Based Syst..

[20]  Majid Sarrafzadeh,et al.  ECG Heartbeat Classification: A Deep Transferable Representation , 2018, 2018 IEEE International Conference on Healthcare Informatics (ICHI).

[21]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Amir Feder,et al.  Active deep learning to detect demographic traits in free-form clinical notes , 2020, J. Biomed. Informatics.

[23]  Philip S. Yu,et al.  Multi-label Ensemble Learning , 2011, ECML/PKDD.

[24]  Yu Wang,et al.  Pattern recognition and prognostic analysis of longitudinal blood pressure records in hemodialysis treatment based on a convolutional neural network , 2019, J. Biomed. Informatics.

[25]  Naif Alajlan,et al.  Deep learning approach for active classification of electrocardiogram signals , 2016, Inf. Sci..

[26]  Patrick T. Ellinor,et al.  Frequency of Cardiac Rhythm Abnormalities in a Half Million Adults , 2018, Circulation. Arrhythmia and electrophysiology.

[27]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[28]  U. Rajendra Acharya,et al.  Application of deep learning techniques for heartbeats detection using ECG signals-analysis and review , 2020, Comput. Biol. Medicine.

[29]  Sachin S. Talathi,et al.  Improving performance of recurrent neural network with relu nonlinearity , 2015, ArXiv.

[30]  Wojciech Samek,et al.  PTB-XL, a large publicly available electrocardiography dataset , 2020, Scientific Data.

[31]  U. Rajendra Acharya,et al.  Application of deep convolutional neural network for automated detection of myocardial infarction using ECG signals , 2017, Inf. Sci..

[32]  Abhinav Gupta,et al.  Non-local Neural Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[33]  Min-Ling Zhang,et al.  A Review on Multi-Label Learning Algorithms , 2014, IEEE Transactions on Knowledge and Data Engineering.

[34]  Zhi Zhang,et al.  Bag of Tricks for Image Classification with Convolutional Neural Networks , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Ramesh Kumar Sunkaria,et al.  Inferior myocardial infarction detection using stationary wavelet transform and machine learning approach , 2017, Signal, Image and Video Processing.

[36]  S. T. Sanamdikar,et al.  A Literature Review on Arrhythmia Analysis of ECG Signal , 2015 .

[37]  June-Goo Lee,et al.  Deep Learning in Medical Imaging: General Overview , 2017, Korean journal of radiology.

[38]  U. Rajendra Acharya,et al.  Arrhythmia detection using deep convolutional neural network with long duration ECG signals , 2018, Comput. Biol. Medicine.

[39]  Ruxin Wang,et al.  Multi-class Arrhythmia detection from 12-lead varied-length ECG using Attention-based Time-Incremental Convolutional Neural Network , 2020, Inf. Fusion.

[40]  U. Rajendra Acharya,et al.  A deep convolutional neural network model to classify heartbeats , 2017, Comput. Biol. Medicine.

[41]  U. Raghavendra,et al.  Automated identification of shockable and non-shockable life-threatening ventricular arrhythmias using convolutional neural network , 2018, Future Gener. Comput. Syst..

[42]  Marco Maggini,et al.  An Unsupervised Character-Aware Neural Approach to Word and Context Representation Learning , 2018, ICANN.

[43]  Wojciech Samek,et al.  Deep Learning for ECG Analysis: Benchmarks and Insights from PTB-XL , 2020, IEEE Journal of Biomedical and Health Informatics.

[44]  Tim Oates,et al.  Time series classification from scratch with deep neural networks: A strong baseline , 2016, 2017 International Joint Conference on Neural Networks (IJCNN).

[45]  Henry J.L. Marriott,et al.  Ventricular Fusion Beats , 1962 .

[46]  U. Rajendra Acharya,et al.  Automated diagnosis of arrhythmia using combination of CNN and LSTM techniques with variable length heart beats , 2018, Comput. Biol. Medicine.

[47]  Pankoo Kim,et al.  A Deep Bidirectional GRU Network Model for Biometric Electrocardiogram Classification Based on Recurrent Neural Networks , 2019, IEEE Access.

[48]  Hongling Zhu,et al.  Automatic multilabel electrocardiogram diagnosis of heart rhythm or conduction abnormalities with deep learning: a cohort study. , 2020, The Lancet. Digital health.

[49]  Ali Işın,et al.  Cardiac arrhythmia detection using deep learning , 2017 .

[50]  Wei Zhang,et al.  Emotion recognition by assisted learning with convolutional neural networks , 2018, Neurocomputing.