Improving the Efficacy of Deep-Learning Models for Heart Beat Detection on Heterogeneous Datasets

Deep learning (DL) has greatly contributed to bioelectric signal processing, in particular to extract physiological markers. However, the efficacy and applicability of the results proposed in the literature is often constrained to the population represented by the data used to train the models. In this study, we investigate the issues related to applying a DL model on heterogeneous datasets. In particular, by focusing on heart beat detection from electrocardiogram signals (ECG), we show that the performance of a model trained on data from healthy subjects decreases when applied to patients with cardiac conditions and to signals collected with different devices. We then evaluate the use of transfer learning (TL) to adapt the model to the different datasets. In particular, we show that the classification performance is improved, even with datasets with a small sample size. These results suggest that a greater effort should be made towards the generalizability of DL models applied on bioelectric signals, in particular, by retrieving more representative datasets.

[1]  Masoud Daneshtalab,et al.  A review on deep learning methods for ECG arrhythmia classification , 2020, Expert Syst. Appl. X.

[2]  Glenn Van Steenkiste,et al.  Transfer Learning in ECG Classification from Human to Horse Using a Novel Parallel Neural Network Architecture , 2020, Scientific Reports.

[3]  Shouqian Sun,et al.  A Systematic Exploration of Deep Neural Networks for EDA-Based Emotion Recognition , 2020, Inf..

[4]  Honglak Lee,et al.  Understanding and Improving Convolutional Neural Networks via Concatenated Rectified Linear Units , 2016, ICML.

[5]  Johannes Wagner,et al.  From Physiological Signals to Emotions: Implementing and Comparing Selected Methods for Feature Extraction and Classification , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[6]  Linda M. Eerikäinen,et al.  Reduction of false arrhythmia alarms using signal selection and machine learning , 2016, Physiological measurement.

[7]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[8]  Rickey E Carter,et al.  An artificial intelligence-enabled ECG algorithm for the identification of patients with atrial fibrillation during sinus rhythm: a retrospective analysis of outcome prediction , 2019, The Lancet.

[9]  Andrea Bizzego,et al.  fNIRS-QC: Crowd-Sourced Creation of a Dataset and Machine Learning Model for fNIRS Quality Control , 2021, Applied Sciences.

[10]  R. Vinayakumar,et al.  Real-Time Detection of Atrial Fibrillation from Short Time Single Lead ECG Traces Using Recurrent Neural Networks , 2017 .

[11]  Thomas G. Dietterich,et al.  To transfer or not to transfer , 2005, NIPS 2005.

[12]  Amir H. Gandomi,et al.  Machine learning-based left ventricular hypertrophy detection using multi-lead ECG signal , 2020, Neural Computing and Applications.

[13]  Kenneth E. Barner,et al.  A novel application of deep learning for single-lead ECG classification , 2018, Comput. Biol. Medicine.

[14]  Cesare Furlanello,et al.  pyphysio: A physiological signal processing library for data science approaches in physiology , 2019, SoftwareX.

[15]  Man-Wai Mak,et al.  Towards End-to-End ECG Classification With Raw Signal Extraction and Deep Neural Networks , 2019, IEEE Journal of Biomedical and Health Informatics.

[16]  Taghi M. Khoshgoftaar,et al.  A survey of transfer learning , 2016, Journal of Big Data.

[17]  Elizabeth F. Wanner,et al.  QRS Detection in ECG Signal with Convolutional Network , 2018, CIARP.

[18]  Cesare Furlanello,et al.  Comparison of Wearable and Clinical Devices for Acquisition of Peripheral Nervous System Signals , 2020, bioRxiv.

[19]  Trevor Hastie,et al.  Transparency and reproducibility in artificial intelligence , 2020, Nature.

[20]  Riccardo Bernardini,et al.  Stress Detection Through Electrodermal Activity (EDA) and Electrocardiogram (ECG) Analysis in Car Drivers , 2019, 2019 27th European Signal Processing Conference (EUSIPCO).

[21]  Suman Samui,et al.  An experimental study on upper limb position invariant EMG signal classification based on deep neural network , 2020, Biomed. Signal Process. Control..

[22]  Cesare Furlanello,et al.  Evaluating reproducibility of AI algorithms in digital pathology with DAPPER , 2018, bioRxiv.

[23]  Jeffrey M. Feldman,et al.  A Robust Sensor Fusion Method for Heart Rate Estimation , 2004, Journal of Clinical Monitoring.

[24]  G.B. Moody,et al.  The impact of the MIT-BIH Arrhythmia Database , 2001, IEEE Engineering in Medicine and Biology Magazine.

[25]  Cesare Furlanello,et al.  Comparison of Wearable and Clinical Devices for Acquisition of Peripheral Nervous System Signals , 2020, Sensors.

[26]  Lukasz Wieclaw,et al.  Biometrie identification from raw ECG signal using deep learning techniques , 2017, 2017 9th IEEE International Conference on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications (IDAACS).

[27]  Jiann-Shiun Yuan,et al.  ECG Arrhythmia Classification Using Transfer Learning from 2- Dimensional Deep CNN Features , 2018, 2018 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[28]  Michael J Ackerman,et al.  Detection of Hypertrophic Cardiomyopathy Using a Convolutional Neural Network-Enabled Electrocardiogram. , 2020, Journal of the American College of Cardiology.

[29]  Dario Izzo,et al.  Learning the optimal state-feedback using deep networks , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[30]  Wenqing Sun,et al.  Automatic feature learning using multichannel ROI based on deep structured algorithms for computerized lung cancer diagnosis , 2017, Comput. Biol. Medicine.

[31]  Wei Cao,et al.  Deep Learning based Radiomics (DLR) and its usage in noninvasive IDH1 prediction for low grade glioma , 2017, Scientific Reports.

[32]  Hui-Min Xie,et al.  Clinical review: The impact of noise on patients' sleep and the effectiveness of noise reduction strategies in intensive care units , 2009, Critical care.

[33]  Boaz Lerner,et al.  Machine learning applied to multi-sensor information to reduce false alarm rate in the ICU , 2019, Journal of Clinical Monitoring and Computing.

[34]  R G Mark,et al.  Robust heart rate estimation from multiple asynchronous noisy sources using signal quality indices and a Kalman filter , 2008, Physiological measurement.

[35]  Giulio Gabrieli,et al.  PySiology: A Python Package for Physiological Feature Extraction , 2020, Neural Approaches to Dynamics of Signal Exchanges.

[36]  Giulio Gabrieli,et al.  A Machine Learning Approach for the Automatic Estimation of Fixation-Time Data Signals’ Quality , 2020, Sensors.

[37]  B. Drew,et al.  Insights into the Problem of Alarm Fatigue with Physiologic Monitor Devices: A Comprehensive Observational Study of Consecutive Intensive Care Unit Patients , 2014, PloS one.

[38]  Antonio Manzalini,et al.  Towards a Quantum Field Theory for Optical Artificial Intelligence , 2019, Annals of Emerging Technologies in Computing.

[39]  M. Chambrin Alarms in the intensive care unit: how can the number of false alarms be reduced? , 2001, Critical care.

[40]  Jeffrey M. Hausdorff,et al.  Physionet: Components of a New Research Resource for Complex Physiologic Signals". Circu-lation Vol , 2000 .

[41]  Maryellen Giger,et al.  Special Section Guest Editorial: Radiomics and Deep Learning , 2017, Journal of medical imaging.

[42]  Ali Farhadi,et al.  Transfer Learning in Sign language , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[43]  Mert R. Sabuncu,et al.  Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labels , 2018, NeurIPS.

[44]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[45]  Eric J Topol,et al.  High-performance medicine: the convergence of human and artificial intelligence , 2019, Nature Medicine.

[46]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[47]  David Menotti,et al.  Towards better heartbeat segmentation with deep learning classification , 2020, Scientific Reports.

[48]  Yakoub Bazi,et al.  Convolutional Neural Networks for Electrocardiogram Classification , 2018, Journal of Medical and Biological Engineering.

[49]  T. Conrad,et al.  Transfer learning for ECG classification , 2021, Scientific Reports.

[50]  Cesare Furlanello,et al.  Integrating deep and radiomics features in cancer bioimaging , 2019 .

[51]  P. A. Karthick,et al.  Surface electromyography based muscle fatigue detection using high-resolution time-frequency methods and machine learning algorithms , 2018, Comput. Methods Programs Biomed..

[52]  R. Orglmeister,et al.  The principles of software QRS detection , 2002, IEEE Engineering in Medicine and Biology Magazine.

[53]  Rickey E. Carter,et al.  Screening for cardiac contractile dysfunction using an artificial intelligence–enabled electrocardiogram , 2019, Nature Medicine.

[54]  Issam El Naqa,et al.  Machine Learning and Imaging Informatics in Oncology , 2018, Oncology.

[55]  M. Funk,et al.  Alarm fatigue: a patient safety concern. , 2013, AACN advanced critical care.

[56]  Halil-Ibrahim Bülbül,et al.  Classification of ECG Arrhythmia with Machine Learning Techniques , 2017, 2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA).

[57]  G. Esposito,et al.  Deep Neural Networks and Transfer Learning on a Multivariate Physiological Signal Dataset , 2021, Bioengineering.

[58]  Matthew D. Zeiler ADADELTA: An Adaptive Learning Rate Method , 2012, ArXiv.

[59]  M. Bornstein,et al.  Assessing Mothers’ Postpartum Depression From Their Infants’ Cry Vocalizations , 2020, Behavioral sciences.

[60]  L. Tarassenko,et al.  Medical signal processing using the Software Monitor , 2001 .

[61]  Robert D. Sorkin,et al.  FORUM: Why are people turning off our alarms? , 1988 .

[62]  D. Brat,et al.  Predicting cancer outcomes from histology and genomics using convolutional networks , 2017, Proceedings of the National Academy of Sciences.

[63]  Hidetaka Arimura,et al.  Radiomics with artificial intelligence for precision medicine in radiation therapy , 2018, Journal of radiation research.

[64]  Andrea Bizzego,et al.  Computational Methods for the Assessment of Empathic Synchrony , 2017, IIH-MSP.