Multi-information fusion neural networks for arrhythmia automatic detection

BACKGROUND AND OBJECTIVES . The electrocardiograms (ECGs) are widely used to diagnose a variety of arrhythmias. Generally, the abnormalities of ECG signals mainly consist of ill-shaped ECG beat morphologies and irregular intervals. The ill-shaped ECG beat morphologies represent morphological information, while the irregular intervals denote the temporal information of ECG signals. But it is difficult to utilize morphological information and temporal information simultaneously when dealing with single ECG heartbeats, because RR interval is not contained in a single short heartbeat. Therefore, to handle this problems, a novel Multi-information Fusion Convolutional Bidirectional Recurrent Neural Network (MF-CBRNN) is proposed for arrhythmia automatic detection. METHODS . The MF-CBRNN is designed with two parallel hybrid branches that can simultaneously focus on the beat-based information in the ECG beats and the segment-based information in the adjacent segments of the beats. A single ECG beat provides the morphological information. At the same time, the adjacent segment of the ECG beat enriches the temporal information, so the two branches are designed to exploit the multiple information contained in ECGs. Furthermore, a combination of convolutional neural networks (CNNs) and a bidirectional long short memory (BLSTM) in each branch is utilized to capture the information from the two inputs. And all the features extracted from the two branches are fused for information aggregation. RESULTS . To evaluate the performance of the proposed model, the ECG signals from MIT-BIH databases are used for intra-patient and inter-patient paradigms. The proposed model yields an accuracy of 99.56% and an F1-score of 96.40% under the intra-patient paradigm. And it obtains an overall accuracy of 96.77% and F1-score of 77.83% under the inter-patient paradigm. CONCLUSIONS . Compared with other studies on arrhythmia detection, our method achieves a state-of-the-art performance. It indicates that the proposed model is a promising arrhythmia detection algorithm for computer-aided diagnostic systems.

[1]  Kenneth E. Barner,et al.  A novel application of deep learning for single-lead ECG classification , 2018, Comput. Biol. Medicine.

[2]  Philip de Chazal,et al.  A Patient-Adapting Heartbeat Classifier Using ECG Morphology and Heartbeat Interval Features , 2006, IEEE Transactions on Biomedical Engineering.

[3]  Gang Sun,et al.  Squeeze-and-Excitation Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[4]  U. Rajendra Acharya,et al.  Novel deep genetic ensemble of classifiers for arrhythmia detection using ECG signals , 2019, Neural Computing and Applications.

[5]  Lovekesh Vig,et al.  Anomaly detection in ECG time signals via deep long short-term memory networks , 2015, 2015 IEEE International Conference on Data Science and Advanced Analytics (DSAA).

[6]  Yixiang Huang,et al.  An Improved Convolutional Neural Network Based Approach for Automated Heartbeat Classification , 2019, Journal of Medical Systems.

[7]  Juan Pablo Martínez,et al.  Heartbeat Classification Using Feature Selection Driven by Database Generalization Criteria , 2011, IEEE Transactions on Biomedical Engineering.

[8]  U. Rajendra Acharya,et al.  ECG beat classification using PCA, LDA, ICA and Discrete Wavelet Transform , 2013, Biomed. Signal Process. Control..

[9]  Qiang Chen,et al.  Network In Network , 2013, ICLR.

[10]  William Robson Schwartz,et al.  ECG-based heartbeat classification for arrhythmia detection: A survey , 2016, Comput. Methods Programs Biomed..

[11]  Gaetano D Gargiulo,et al.  Towards Real-Time Heartbeat Classification: Evaluation of Nonlinear Morphological Features and Voting Method , 2019, Sensors.

[12]  Heasoo Hwang,et al.  A robust deep convolutional neural network with batch-weighted loss for heartbeat classification , 2019, Expert Syst. Appl..

[13]  Kuldip K. Paliwal,et al.  Bidirectional recurrent neural networks , 1997, IEEE Trans. Signal Process..

[14]  Moloud Abdar,et al.  Novel Methodology for Cardiac Arrhythmias Classification Based on Long-Duration ECG Signal Fragments Analysis , 2019, Series in BioEngineering.

[15]  Man-Wai Mak,et al.  Towards End-to-End ECG Classification With Raw Signal Extraction and Deep Neural Networks , 2019, IEEE Journal of Biomedical and Health Informatics.

[16]  Moncef Gabbouj,et al.  Real-Time Patient-Specific ECG Classification by 1-D Convolutional Neural Networks , 2016, IEEE Transactions on Biomedical Engineering.

[17]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[18]  Samy Bengio,et al.  Scheduled Sampling for Sequence Prediction with Recurrent Neural Networks , 2015, NIPS.

[19]  Hao Wang,et al.  Multiple-feature-branch convolutional neural network for myocardial infarction diagnosis using electrocardiogram , 2018, Biomed. Signal Process. Control..

[20]  Willis J. Tompkins,et al.  A Real-Time QRS Detection Algorithm , 1985, IEEE Transactions on Biomedical Engineering.

[21]  U. Rajendra Acharya,et al.  A deep convolutional neural network model to classify heartbeats , 2017, Comput. Biol. Medicine.

[22]  Xiaohe Chen,et al.  Arrhythmia Recognition and Classification Using ECG Morphology and Segment Feature Analysis , 2019, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[23]  Sebastian Zaunseder,et al.  Optimization of ECG Classification by Means of Feature Selection , 2011, IEEE Transactions on Biomedical Engineering.

[24]  Philip de Chazal,et al.  Automatic classification of heartbeats using ECG morphology and heartbeat interval features , 2004, IEEE Transactions on Biomedical Engineering.

[25]  Arantza Illarramendi,et al.  Real-time classification of ECGs on a PDA , 2005, IEEE Transactions on Information Technology in Biomedicine.

[26]  Michael Schukat,et al.  Deep Reinforcement Learning: An Overview , 2016, IntelliSys.

[27]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[29]  U. Rajendra Acharya,et al.  SleepEEGNet: Automated sleep stage scoring with sequence to sequence deep learning approach , 2019, PloS one.

[30]  Özal Yildirim,et al.  A novel wavelet sequence based on deep bidirectional LSTM network model for ECG signal classification , 2018, Comput. Biol. Medicine.

[31]  U. Rajendra Acharya,et al.  A new machine learning technique for an accurate diagnosis of coronary artery disease , 2019, Comput. Methods Programs Biomed..

[32]  Yixiang Huang,et al.  A hierarchical method based on weighted extreme gradient boosting in ECG heartbeat classification , 2019, Comput. Methods Programs Biomed..

[33]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[34]  Vincenzo Piuri,et al.  Deep-ECG: Convolutional Neural Networks for ECG biometric recognition , 2019, Pattern Recognit. Lett..

[35]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[36]  Praveen Sankaran,et al.  ECG Beat Classification Using Evidential K -Nearest Neighbours☆ , 2016 .

[37]  C.-C. Jay Kuo,et al.  ECG-based biometrics using recurrent neural networks , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[38]  Sengul Dogan,et al.  Automated arrhythmia detection using novel hexadecimal local pattern and multilevel wavelet transform with ECG signals , 2019, Knowl. Based Syst..

[39]  Kup-Sze Choi,et al.  Heartbeat classification using disease-specific feature selection , 2014, Comput. Biol. Medicine.

[40]  Hermann Ney,et al.  Translation Modeling with Bidirectional Recurrent Neural Networks , 2014, EMNLP.

[41]  U. Rajendra Acharya,et al.  Automated diagnosis of arrhythmia using combination of CNN and LSTM techniques with variable length heart beats , 2018, Comput. Biol. Medicine.

[42]  Masoumeh Haghpanahi,et al.  Cardiologist-level arrhythmia detection and classification in ambulatory electrocardiograms using a deep neural network , 2019, Nature Medicine.

[43]  Sandeep Raj,et al.  ECG Signal Analysis Using DCT-Based DOST and PSO Optimized SVM , 2017, IEEE Transactions on Instrumentation and Measurement.

[44]  Manuel G. Penedo,et al.  Heartbeat classification fusing temporal and morphological information of ECGs via ensemble of classifiers , 2019, Biomed. Signal Process. Control..

[45]  B. V. K. Vijaya Kumar,et al.  Heartbeat Classification Using Morphological and Dynamic Features of ECG Signals , 2012, IEEE Transactions on Biomedical Engineering.

[46]  Selcan Kaplan Berkaya,et al.  A survey on ECG analysis , 2018, Biomed. Signal Process. Control..

[47]  Jian Li,et al.  Heartbeat classification using projected and dynamic features of ECG signal , 2017, Biomed. Signal Process. Control..

[48]  Pawel Plawiak,et al.  Novel genetic ensembles of classifiers applied to myocardium dysfunction recognition based on ECG signals , 2017, Swarm Evol. Comput..

[49]  Adnan Acan,et al.  ECG classification using three-level fusion of different feature descriptors , 2018, Expert Syst. Appl..

[50]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.