Training neural networks with synthetic electrocardiograms

We present a method for training neural networks with synthetic electrocardiograms that mimic signals produced by a wearable single lead electrocardiogram monitor. We use domain randomization where the synthetic signal properties such as the waveform shape, RR-intervals and noise are varied for every training example. Models trained with synthetic data are compared to their counterparts trained with real data. Detection of r-waves in electrocardiograms recorded during different physical activities and in atrial fibrillation is used to compare the models. By allowing the randomization to increase beyond what is typically observed in the real-world data the performance is on par or superseding the performance of networks trained with real data. Experiments show robust performance with different seeds and training examples on different test sets without any test set specific tuning. The method makes possible to train neural networks using practically free-to-collect data with accurate labels without the need for manual annotations and it opens up the possibility of extending the use of synthetic data on cardiac disease classification when disease specific a priori information is used in the electrocardiogram generation. Additionally the distribution of data can be controlled eliminating class imbalances that are typically observed in health related data and additionally the generated data is inherently private.

[1]  Jeffrey M. Hausdorff,et al.  Physionet: Components of a New Research Resource for Complex Physiologic Signals". Circu-lation Vol , 2000 .

[2]  T. Conrad,et al.  Transfer learning for ECG classification , 2021, Scientific Reports.

[3]  Mingzhe Jiang,et al.  Robust ECG R-peak detection using LSTM , 2020, SAC.

[4]  Matti Kaisti,et al.  Radiometric Resolution Analysis and a Simulation Model , 2016, Remote. Sens..

[5]  Madalena Costa,et al.  Multiscale entropy analysis of complex physiologic time series. , 2002, Physical review letters.

[6]  Stanley T. Birchfield,et al.  Structured Domain Randomization: Bridging the Reality Gap by Context-Aware Synthetic Data , 2018, 2019 International Conference on Robotics and Automation (ICRA).

[7]  Varun Jampani,et al.  Training Deep Networks with Synthetic Data: Bridging the Reality Gap by Domain Randomization , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[8]  Sadasivan Puthusserypady,et al.  DENS-ECG: A Deep Learning Approach for ECG Signal Delineation , 2020, Expert Syst. Appl..

[9]  Daniel Roggen,et al.  Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition , 2016, Sensors.

[10]  J. Timmer,et al.  On generating power law noise. , 1995 .

[11]  Sergey Levine,et al.  Sim-To-Real via Sim-To-Sim: Data-Efficient Robotic Grasping via Randomized-To-Canonical Adaptation Networks , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Wojciech Zaremba,et al.  Domain randomization for transferring deep neural networks from simulation to the real world , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[13]  Rik Willems,et al.  Which QT Correction Formulae to Use for QT Monitoring? , 2016, Journal of the American Heart Association.

[14]  Jan W. Kantelhardt,et al.  Modeling transient correlations in heartbeat dynamics during sleep , 2003 .

[15]  Patrick E. McSharry,et al.  A dynamical model for generating synthetic electrocardiogram signals , 2003, IEEE Transactions on Biomedical Engineering.

[16]  José Luis Rojo-Álvarez,et al.  Deep Learning and Big Data in Healthcare: A Double Review for Critical Beginners , 2019, Applied Sciences.

[17]  Micah J. Sheller,et al.  The future of digital health with federated learning , 2020, npj Digital Medicine.

[18]  Malcolm s thaler,et al.  The Only EKG Book You'll Ever Need , 1988 .

[19]  Nikhil Muralidhar,et al.  Incorporating Prior Domain Knowledge into Deep Neural Networks , 2018, 2018 IEEE International Conference on Big Data (Big Data).

[20]  S. Steinhubl,et al.  Effect of a Home-Based Wearable Continuous ECG Monitoring Patch on Detection of Undiagnosed Atrial Fibrillation: The mSToPS Randomized Clinical Trial , 2018, JAMA.

[21]  Jiann-Shiun Yuan,et al.  ECG Arrhythmia Classification Using Transfer Learning from 2- Dimensional Deep CNN Features , 2018, 2018 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[22]  Qiao Li,et al.  AF classification from a short single lead ECG recording: The PhysioNet/computing in cardiology challenge 2017 , 2017, 2017 Computing in Cardiology (CinC).

[23]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[24]  G.B. Moody,et al.  The impact of the MIT-BIH Arrhythmia Database , 2001, IEEE Engineering in Medicine and Biology Magazine.

[25]  Bernd Porr,et al.  High precision ECG Database with annotated R peaks, recorded and filmed under realistic conditions , 2018 .