Impact of ECG Dataset Diversity on Generalization of CNN Model for Detecting QRS Complex

Detection of QRS complexes in electrocardiogram (ECG) signal is crucial for automated cardiac diagnosis. Automated QRS detection has been a research topic for over three decades and several of the traditional QRS detection methods show acceptable detection accuracy, however, the applicability of these methods beyond their study-specific databases was not explored. The non-stationary nature of ECG and signal variance of intra and inter-patient recordings impose significant challenges on single QRS detectors to achieve reasonable performance. In real life, a promising QRS detector may be expected to achieve acceptable accuracy over diverse ECG recordings and, thus, investigation of the model’s generalization capability is crucial. This paper investigates the generalization capability of convolutional neural network (CNN) based-models from intra (subject wise leave-one-out and five-fold cross validation) and inter-database (training with single and multiple databases) points-of-view over three publicly available ECG databases, namely MIT-BIH Arrhythmia, INCART, and QT. Leave-one-out test accuracy reports 99.22%, 97.13%, and 96.25% for these databases accordingly and inter-database tests report more than 90% accuracy with the single exception of INCART. The performance variation reveals the fact that a CNN model’s generalization capability does not increase simply by adding more training samples, rather the inclusion of samples from a diverse range of subjects is necessary for reasonable QRS detection accuracy.

[1]  Majid Sarrafzadeh,et al.  ECG Heartbeat Classification: A Deep Transferable Representation , 2018, 2018 IEEE International Conference on Healthcare Informatics (ICHI).

[2]  Xuemei Guo,et al.  A deep learning approach for fetal QRS complex detection , 2018, Physiological measurement.

[3]  B. S. Chandra,et al.  Robust Heartbeat Detection From Multimodal Data via CNN-Based Generalizable Information Fusion , 2018, IEEE Transactions on Biomedical Engineering.

[4]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[5]  Messaoud Benidir,et al.  Multiresolution wavelet-based QRS complex detection algorithm suited to several abnormal morphologies , 2014, IET Signal Process..

[6]  H L Chan,et al.  Continuous and online analysis of heart rate variability , 2005, Journal of medical engineering & technology.

[7]  Trevor Darrell,et al.  Part-Based R-CNNs for Fine-Grained Category Detection , 2014, ECCV.

[8]  R. Orglmeister,et al.  The principles of software QRS detection , 2002, IEEE Engineering in Medicine and Biology Magazine.

[9]  Marko Sarlija,et al.  A convolutional neural network based approach to QRS detection , 2017, Proceedings of the 10th International Symposium on Image and Signal Processing and Analysis.

[10]  P.E. Trahanias,et al.  An approach to QRS complex detection using mathematical morphology , 1993, IEEE Transactions on Biomedical Engineering.

[11]  Yaping Lin,et al.  Synthetic minority oversampling technique for multiclass imbalance problems , 2017, Pattern Recognit..

[12]  Nikhil Ketkar,et al.  Introduction to PyTorch , 2021, Deep Learning with Python.

[13]  Moncef Gabbouj,et al.  Convolutional Neural Networks for patient-specific ECG classification , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[14]  Willis J. Tompkins,et al.  Adaptive matched filtering for QRS detection , 1988, Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[15]  Yu-Lun Lo,et al.  Sleep-wake classification via quantifying heart rate variability by convolutional neural network , 2018, Physiological measurement.

[16]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[17]  C. Li,et al.  Detection of ECG characteristic points using wavelet transforms. , 1995, IEEE transactions on bio-medical engineering.

[18]  Sang Woo Kim,et al.  Fetal QRS Detection Based on Convolutional Neural Networks in Noninvasive Fetal Electrocardiogram , 2018, 2018 4th International Conference on Frontiers of Signal Processing (ICFSP).

[19]  Yann LeCun,et al.  What is the best multi-stage architecture for object recognition? , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[20]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[21]  Jacek M. Zurada,et al.  Training neural network classifiers for medical decision making: The effects of imbalanced datasets on classification performance , 2008, Neural Networks.

[22]  Daniël M Pelt,et al.  A mixed-scale dense convolutional neural network for image analysis , 2017, Proceedings of the National Academy of Sciences.

[23]  Jing Hu,et al.  A Multiscale Fusion Convolutional Neural Network for Plant Leaf Recognition , 2018, IEEE Signal Processing Letters.

[24]  Bingli Jiao,et al.  QRS Detection and Measurement Method of ECG Paper Based on Convolutional Neural Networks , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[25]  Willis J. Tompkins,et al.  Quantitative Investigation of QRS Detection Rules Using the MIT/BIH Arrhythmia Database , 1986, IEEE Transactions on Biomedical Engineering.

[26]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[27]  Wei Shen,et al.  Multi-scale Convolutional Neural Networks for Lung Nodule Classification , 2015, IPMI.

[28]  H. K. Verma,et al.  ANN-based QRS-complex analysis of ECG. , 1998, Journal of medical engineering & technology.

[29]  P. C. Cortez,et al.  An innovative approach of QRS segmentation based on first-derivative, Hilbert and Wavelet Transforms. , 2012, Medical engineering & physics.

[30]  Yoshua Bengio,et al.  Convolutional networks for images, speech, and time series , 1998 .

[31]  Xuan Zeng,et al.  HeartID: A Multiresolution Convolutional Neural Network for ECG-Based Biometric Human Identification in Smart Health Applications , 2017, IEEE Access.

[32]  Moncef Gabbouj,et al.  Real-Time Patient-Specific ECG Classification by 1-D Convolutional Neural Networks , 2016, IEEE Transactions on Biomedical Engineering.

[33]  Ali Işın,et al.  Cardiac arrhythmia detection using deep learning , 2017 .

[34]  U. Rajendra Acharya,et al.  Automated detection of arrhythmias using different intervals of tachycardia ECG segments with convolutional neural network , 2017, Inf. Sci..

[35]  U. Rajendra Acharya,et al.  Application of deep convolutional neural network for automated detection of myocardial infarction using ECG signals , 2017, Inf. Sci..

[36]  Yuxin Peng,et al.  The application of two-level attention models in deep convolutional neural network for fine-grained image classification , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  Goran Krstačić,et al.  Optimizing the detection of characteristic waves in ECG based on exploration of processing steps combinations , 2017 .

[38]  Jeffrey M. Hausdorff,et al.  Physionet: Components of a New Research Resource for Complex Physiologic Signals". Circu-lation Vol , 2000 .

[39]  Zhitao Lin,et al.  Automatic QRS complex detection using two-level convolutional neural network , 2018, BioMedical Engineering OnLine.

[40]  U. Rajendra Acharya,et al.  Automated detection of coronary artery disease using different durations of ECG segments with convolutional neural network , 2017, Knowl. Based Syst..