ECG-DelNet: Delineation of Ambulatory Electrocardiograms with Mixed Quality Labeling Using Neural Networks

Electrocardiogram (ECG) detection and delineation are key steps for numerous tasks in clinical practice, as ECG is the most performed non-invasive test for assessing cardiac condition. State-of-the-art algorithms employ digital signal processing (DSP), which require laborious rule adaptation to new morphologies. In contrast, deep learning (DL) algorithms, especially for classification, are gaining weight in academic and industrial settings. However, the lack of model explainability and small databases hinder their applicability. We demonstrate DL can be successfully applied to low interpretative tasks by embedding ECG detection and delineation onto a segmentation framework. For this purpose, we adapted and validated the most used neural network architecture for image segmentation, the U-Net, to one-dimensional data. The model was trained using PhysioNet's QT database, comprised of 105 ambulatory ECG recordings, for single- and multi-lead scenarios. To alleviate data scarcity, data regularization techniques such as pre-training with low-quality data labels, performing ECG-based data augmentation and applying strong model regularizers to the architecture were attempted. Other variations in the model's capacity (U-Net's depth and width), alongside the application of state-of-the-art additions, were evaluated. These variations were exhaustively validated in a 5-fold cross-validation manner. The best performing configuration reached precisions of 90.12%, 99.14% and 98.25% and recalls of 98.73%, 99.94% and 99.88% for the P, QRS and T waves, respectively, on par with DSP-based approaches. Despite being a data-hungry technique trained on a small dataset, DL-based approaches demonstrate to be a viable alternative to traditional DSP-based ECG processing techniques.

[1]  Jonathan Tompson,et al.  Efficient object localization using Convolutional Networks , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Pablo Laguna,et al.  A database for evaluation of algorithms for measurement of QT and other waveform intervals in the ECG , 1997, Computers in Cardiology 1997.

[3]  Razvan Pascanu,et al.  On the difficulty of training recurrent neural networks , 2012, ICML.

[4]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Jeffrey M. Hausdorff,et al.  Physionet: Components of a New Research Resource for Complex Physiologic Signals". Circu-lation Vol , 2000 .

[6]  Tao Zhang,et al.  A Survey of Model Compression and Acceleration for Deep Neural Networks , 2017, ArXiv.

[7]  Lars Kaderali,et al.  A convolutional neural network for ECG annotation as the basis for classification of cardiac rhythms , 2018, Physiological measurement.

[8]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[9]  O. Camara,et al.  U-Net Architecture for the Automatic Detection and Delineation of the Electrocardiogram , 2019, 2019 Computing in Cardiology (CinC).

[10]  Jing Yuan,et al.  HyperDense-Net: A Hyper-Densely Connected CNN for Multi-Modal Image Segmentation , 2018, IEEE Transactions on Medical Imaging.

[11]  Pu Wang,et al.  LSTM-Based Auto-Encoder Model for ECG Arrhythmias Classification , 2020, IEEE Transactions on Instrumentation and Measurement.

[12]  Josien P. W. Pluim,et al.  Not‐so‐supervised: A survey of semi‐supervised, multi‐instance, and transfer learning in medical image analysis , 2018, Medical Image Anal..

[13]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[14]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[15]  Emilia Gómez,et al.  Machine Learning for Clinical Decision-Making: Challenges and Opportunities , 2019 .

[16]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[17]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[18]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Pablo Laguna,et al.  Computational techniques for ECG analysis and interpretation in light of their contribution to medical advances , 2018, Journal of The Royal Society Interface.

[20]  Ana Mincholé,et al.  Deep Learning Based QRS Multilead Delineator in Electrocardiogram Signals , 2018, 2018 Computing in Cardiology Conference (CinC).

[21]  Jean-Marc Boucher,et al.  Hidden Markov tree model applied to ECG delineation , 2005, IEEE Transactions on Instrumentation and Measurement.

[22]  U. Rajendra Acharya,et al.  Deep learning for healthcare applications based on physiological signals: A review , 2018, Comput. Methods Programs Biomed..

[23]  C. Li,et al.  Detection of ECG characteristic points using wavelet transforms. , 1995, IEEE transactions on bio-medical engineering.

[24]  Luis Perez,et al.  The Effectiveness of Data Augmentation in Image Classification using Deep Learning , 2017, ArXiv.

[25]  Julià Camps,et al.  Machine learning in the electrocardiogram. , 2019, Journal of electrocardiology.

[26]  Jürgen Schmidhuber,et al.  Connectionist temporal classification: labelling unsegmented sequence data with recurrent neural networks , 2006, ICML.

[27]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Gérard Dreyfus,et al.  Automatic ECG wave extraction in long-term recordings using Gaussian mesa function models and nonlinear probability estimators , 2007, Comput. Methods Programs Biomed..

[29]  José García Rodríguez,et al.  A survey on deep learning techniques for image and video semantic segmentation , 2018, Appl. Soft Comput..

[30]  Rajarshi Gupta,et al.  Delineation of ECG characteristic features using multiresolution wavelet analysis method , 2012 .

[31]  Raúl Alcaraz,et al.  Application of the phasor transform for automatic delineation of single-lead ECG fiducial points , 2010, Physiological measurement.

[32]  Pablo Laguna,et al.  A wavelet-based ECG delineator: evaluation on standard databases , 2004, IEEE Transactions on Biomedical Engineering.

[33]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Colin Raffel,et al.  Realistic Evaluation of Deep Semi-Supervised Learning Algorithms , 2018, NeurIPS.

[35]  Bin Yao,et al.  ECG Arrhythmia Classification Using STFT-Based Spectrogram and Convolutional Neural Network , 2019, IEEE Access.

[36]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[37]  Hedayat Abrishami,et al.  Supervised ECG Interval Segmentation Using LSTM Neural Network , 2018 .

[38]  Gary Marcus,et al.  Deep Learning: A Critical Appraisal , 2018, ArXiv.

[39]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Jaime S. Cardoso,et al.  Evolution, Current Challenges, and Future Possibilities in ECG Biometrics , 2018, IEEE Access.

[41]  A. Mincholé,et al.  Artificial intelligence for the electrocardiogram , 2019, Nature Medicine.

[42]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[43]  Vladlen Koltun,et al.  An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling , 2018, ArXiv.

[44]  Jonathan H. Chen,et al.  Machine Learning and Prediction in Medicine - Beyond the Peak of Inflated Expectations. , 2017, The New England journal of medicine.

[45]  Geoffrey H. Tison,et al.  Automated and Interpretable Patient ECG Profiles for Disease Detection, Tracking, and Discovery , 2018, Circulation. Cardiovascular quality and outcomes.

[46]  Daniel Cremers,et al.  Regularization for Deep Learning: A Taxonomy , 2017, ArXiv.