ECG classification using three-level fusion of different feature descriptors

Abstract Fusion of feature descriptors extracted from a signal through different methods is an important issue for the exploitation of representational power of each descriptor. In this research work, a novel system which exploits multi-stage features from a trained convolutional neural network (CNN) and precisely combines these features with a selection of handcrafted features is proposed. The set of handcrafted features consists of three subsets namely, wavelet transform based morphological features representing localized signal behaviour, statistical features exhibiting overall variational characteristics of the signal and temporal features representing the signal's behaviour on the time axis. The proposed system utilizes a novel decision-level fusion of features for ECG classification by three different approaches; the first one uses normalized feature-level fusion of handcrafted global statistical and local temporal features by uniting these features into one set, the second one uses the morphological feature subset, and the third one combines features extracted from multiple layers of a CNN through using a score-level based refinement procedure. The main impact of the proposed approach is the score-level based fusion of automatically learned features extracted from multiple layers of trained CNN and the decision-level fusion of features characterising the signal in totally different representational spaces. The individual decisions of the three different classifiers are fused together based on the majority voting and a unified decision is reached for the input ECG signal classification. The results over the MIT-BIH arrhythmia benchmarks database exhibited that the proposed system achieves a superior classification accuracy compared to all of the state-of-the-art ECG classification methods.

[1]  David Menotti,et al.  ECG arrhythmia classification based on optimum-path forest , 2013, Expert Syst. Appl..

[2]  Nico Karssemeijer,et al.  Unsupervised Deep Learning Applied to Breast Density Segmentation and Mammographic Risk Scoring , 2016, IEEE Transactions on Medical Imaging.

[3]  Jinsul Kim,et al.  An Automated ECG Beat Classification System Using Convolutional Neural Networks , 2016, 2016 6th International Conference on IT Convergence and Security (ICITCS).

[4]  Pornchai Phukpattaranont,et al.  QRS detection algorithm based on the quadratic filter , 2015, Expert Syst. Appl..

[5]  José Carlos Príncipe,et al.  Time-Based Compression and Classification of Heartbeats , 2012, IEEE Transactions on Biomedical Engineering.

[6]  D Sambhu,et al.  Automatic Classification of ECG Signalswith Features Extracted Using WaveletTransform and Support Vector Machines , 2013 .

[7]  M. Friedman A Comparison of Alternative Tests of Significance for the Problem of $m$ Rankings , 1940 .

[8]  Willis J. Tompkins,et al.  A Real-Time QRS Detection Algorithm , 1985, IEEE Transactions on Biomedical Engineering.

[9]  Kup-Sze Choi,et al.  Heartbeat classification using disease-specific feature selection , 2014, Comput. Biol. Medicine.

[10]  Amy Loutfi,et al.  Sleep Stage Classification Using Unsupervised Feature Learning , 2012, Adv. Artif. Neural Syst..

[11]  William Robson Schwartz,et al.  ECG-based heartbeat classification for arrhythmia detection: A survey , 2016, Comput. Methods Programs Biomed..

[12]  Sebastian Zaunseder,et al.  Optimization of ECG Classification by Means of Feature Selection , 2011, IEEE Transactions on Biomedical Engineering.

[13]  Eric L. Miller,et al.  Nonlocal Means Denoising of ECG Signals , 2012, IEEE Transactions on Biomedical Engineering.

[14]  F. Melgani,et al.  Detecting premature ventricular contractions in ECG signals with Gaussian processes , 2008, 2008 Computers in Cardiology.

[15]  Moncef Gabbouj,et al.  Real-Time Patient-Specific ECG Classification by 1-D Convolutional Neural Networks , 2016, IEEE Transactions on Biomedical Engineering.

[16]  Samit Ari,et al.  ECG Beats Classification Using Mixture of Features , 2014, International scholarly research notices.

[17]  Moncef Gabbouj,et al.  A Generic and Robust System for Automated Patient-Specific Classification of ECG Signals , 2009, IEEE Transactions on Biomedical Engineering.

[18]  Raúl Alcaraz,et al.  Classification of Paroxysmal and Persistent Atrial Fibrillation in Ambulatory ECG Recordings , 2011, IEEE Transactions on Biomedical Engineering.

[19]  Khashayar Khorasani,et al.  Feature leaning with deep Convolutional Neural Networks for screening patients with paroxysmal atrial fibrillation , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[20]  Christos Panagiotou,et al.  On the Detection of Myocadial Scar Based on ECG/VCG Analysis , 2013, IEEE Transactions on Biomedical Engineering.

[21]  Ali Ghaffari,et al.  ECG arrhythmia recognition via a neuro-SVM-KNN hybrid classifier with virtual QRS image-based geometrical features , 2012, Expert Syst. Appl..

[22]  U. Rajendra Acharya,et al.  A deep convolutional neural network model to classify heartbeats , 2017, Comput. Biol. Medicine.

[23]  P. N. Druzhkov,et al.  A survey of deep learning methods and software tools for image classification and object detection , 2016, Pattern Recognition and Image Analysis.

[24]  Sugata Munshi,et al.  Correlation technique and least square support vector machine combine for frequency domain based ECG beat classification. , 2010, Medical engineering & physics.

[25]  Sung-Nien Yu,et al.  Integration of independent component analysis and neural networks for ECG beat classification , 2008, Expert Syst. Appl..

[26]  Danni Ai,et al.  Fast multi-scale feature fusion for ECG heartbeat classification , 2015, EURASIP J. Adv. Signal Process..

[27]  Sam Kwong,et al.  G-MS2F: GoogLeNet based multi-stage feature fusion of deep CNN for scene recognition , 2017, Neurocomputing.

[28]  Yongqiang Ye,et al.  Parallel-type fractional zero-phase filtering for ECG signal denoising , 2015, Biomed. Signal Process. Control..

[29]  Yunchao Wei,et al.  Deep Learning with S-Shaped Rectified Linear Activation Units , 2015, AAAI.

[30]  Jianqing Li,et al.  Patient-Specific Deep Architectural Model for ECG Classification , 2017, Journal of healthcare engineering.

[31]  Pei-Chann Chang,et al.  Myocardial infarction classification with multi-lead ECG using hidden Markov models and Gaussian mixture models , 2012, Appl. Soft Comput..

[32]  Brij N. Singh,et al.  Optimal selection of wavelet basis function applied to ECG signal denoising , 2006, Digit. Signal Process..

[33]  Pingzhi Fan,et al.  Performance evaluation of score level fusion in multimodal biometric systems , 2010, Pattern Recognit..

[34]  Christian Jutten,et al.  A Nonlinear Bayesian Filtering Framework for ECG Denoising , 2007, IEEE Transactions on Biomedical Engineering.

[35]  Reza Ebrahimpour,et al.  Classification of ECG arrhythmia by a modular neural network based on Mixture of Experts and Negatively Correlated Learning , 2013, Biomed. Signal Process. Control..

[36]  U. Rajendra Acharya,et al.  ECG beat classification using PCA, LDA, ICA and Discrete Wavelet Transform , 2013, Biomed. Signal Process. Control..

[37]  Philip de Chazal,et al.  Automatic classification of heartbeats using ECG morphology and heartbeat interval features , 2004, IEEE Transactions on Biomedical Engineering.

[38]  Yu-Liang Hsu,et al.  ECG arrhythmia classification using a probabilistic neural network with a feature reduction method , 2013, Neurocomputing.

[39]  Amit Acharyya,et al.  Development of an Automated Updated Selvester QRS Scoring System Using SWT-Based QRS Fractionation Detection and Classification , 2014, IEEE Journal of Biomedical and Health Informatics.

[40]  Michel Verleysen,et al.  Weighted Conditional Random Fields for Supervised Interpatient Heartbeat Classification , 2012, IEEE Transactions on Biomedical Engineering.

[41]  Philip de Chazal,et al.  A Patient-Adapting Heartbeat Classifier Using ECG Morphology and Heartbeat Interval Features , 2006, IEEE Transactions on Biomedical Engineering.

[42]  Ivan W. Selesnick,et al.  Biomedical Signal Processing and Control Ecg Enhancement and Qrs Detection Based on Sparse Derivatives , 2022 .

[43]  Önsen Toygar,et al.  Animal classification using facial images with score-level fusion , 2018, IET Comput. Vis..

[44]  José Luis Rojo-Álvarez,et al.  Detection of Life-Threatening Arrhythmias Using Feature Selection and Support Vector Machines , 2014, IEEE Transactions on Biomedical Engineering.

[45]  Farid Melgani,et al.  Classification of Electrocardiogram Signals With Support Vector Machines and Particle Swarm Optimization , 2008, IEEE Transactions on Information Technology in Biomedicine.

[46]  B. V. K. Vijaya Kumar,et al.  Heartbeat Classification Using Morphological and Dynamic Features of ECG Signals , 2012, IEEE Transactions on Biomedical Engineering.

[47]  Junmo Kim,et al.  Image Classification Using Convolutional Neural Networks With Multi-stage Feature , 2014, RiTA.

[48]  Gokhan Bilgin,et al.  Cell segmentation in histopathological images with deep learning algorithms by utilizing spatial relationships , 2017, Medical & Biological Engineering & Computing.

[49]  Yakup Kutlu,et al.  Feature extraction for ECG heartbeats using higher order statistics of WPD coefficients , 2012, Comput. Methods Programs Biomed..

[50]  Hadi Seyedarabi,et al.  Fusion of ECG and ABP signals based on wavelet transform for cardiac arrhythmias classification , 2017, Comput. Methods Programs Biomed..

[51]  Victor Alves,et al.  Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images , 2016, IEEE Transactions on Medical Imaging.

[52]  U. Rajendra Acharya,et al.  Automated detection of arrhythmias using different intervals of tachycardia ECG segments with convolutional neural network , 2017, Inf. Sci..

[53]  Naif Alajlan,et al.  Detection of premature ventricular contraction arrhythmias in electrocardiogram signals with kernel methods , 2012, Signal, Image and Video Processing.