SimGANs: Simulator-Based Generative Adversarial Networks for ECG Synthesis to Improve Deep ECG Classification

Generating training examples for supervised tasks is a long sought after goal in AI. We study the problem of heart signal electrocardiogram (ECG) synthesis for improved heartbeat classification. ECG synthesis is challenging: the generation of training examples for such biological-physiological systems is not straightforward, due to their dynamic nature in which the various parts of the system interact in complex ways. However, an understanding of these dynamics has been developed for years in the form of mathematical process simulators. We study how to incorporate this knowledge into the generative process by leveraging a biological simulator for the task of ECG classification. Specifically, we use a system of ordinary differential equations representing heart dynamics, and incorporate this ODE system into the optimization process of a generative adversarial network to create biologically plausible ECG training examples. We perform empirical evaluation and show that heart simulation knowledge during the generation process improves ECG classification.

[1]  J. Butcher The numerical analysis of ordinary differential equations: Runge-Kutta and general linear methods , 1987 .

[2]  Chun-Cheng Lin,et al.  Heartbeat Classification Using Normalized RR Intervals and Morphological Features , 2014 .

[3]  Juan Pablo Martínez,et al.  An Automatic Patient-Adapted ECG Heartbeat Classifier Allowing Expert Assistance , 2012, IEEE Transactions on Biomedical Engineering.

[4]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[5]  Kira Radinsky,et al.  Improving ECG Classification Using Generative Adversarial Networks , 2020, AAAI.

[6]  Tomas Pfister,et al.  Learning from Simulated and Unsupervised Images through Adversarial Training , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  J. S. Sahambi,et al.  Classification of ECG arrhythmias using multi-resolution analysis and neural networks , 2003, TENCON 2003. Conference on Convergent Technologies for Asia-Pacific Region.

[8]  Patrick E. McSharry,et al.  A dynamical model for generating synthetic electrocardiogram signals , 2003, IEEE Transactions on Biomedical Engineering.

[9]  A. Kitchen,et al.  Knowledge based systems in artificial intelligence , 1985, Proceedings of the IEEE.

[10]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[11]  Yakup Kutlu,et al.  Feature extraction for ECG heartbeats using higher order statistics of WPD coefficients , 2012, Comput. Methods Programs Biomed..

[12]  Matthias Durr,et al.  Methods In Neuronal Modeling From Ions To Networks , 2016 .

[13]  Majid Sarrafzadeh,et al.  ECG Heartbeat Classification: A Deep Transferable Representation , 2018, 2018 IEEE International Conference on Healthcare Informatics (ICHI).

[14]  Philip de Chazal,et al.  Automatic classification of heartbeats using ECG morphology and heartbeat interval features , 2004, IEEE Transactions on Biomedical Engineering.

[15]  Nadine Eberhardt,et al.  Bioelectrical Signal Processing In Cardiac And Neurological Applications , 2016 .

[16]  P. Smolen,et al.  Calcium dynamics in large neuronal models , 1998 .

[17]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[18]  Daniel Jurafsky,et al.  Distant supervision for relation extraction without labeled data , 2009, ACL.

[19]  G.B. Moody,et al.  PhysioNet: a Web-based resource for the study of physiologic signals , 2001, IEEE Engineering in Medicine and Biology Magazine.

[20]  Minh N. Do,et al.  Semantic Image Inpainting with Deep Generative Models , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  G. Breithardt,et al.  Heart rate variability: standards of measurement, physiological interpretation and clinical use. Task Force of the European Society of Cardiology and the North American Society of Pacing and Electrophysiology. , 1996 .

[22]  Nicholas Jing Yuan,et al.  Collaborative Knowledge Base Embedding for Recommender Systems , 2016, KDD.

[23]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[24]  J. Banks,et al.  Discrete-Event System Simulation , 1995 .

[25]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[26]  Arnold Neumaier,et al.  Introduction to Numerical Analysis , 2001 .

[27]  Elif Derya Übeyli,et al.  ECG beat classifier designed by combined neural network model , 2005, Pattern Recognit..

[28]  Andrew Y. Ng,et al.  Cardiologist-Level Arrhythmia Detection with Convolutional Neural Networks , 2017, ArXiv.

[29]  Michael I. Jordan,et al.  Graphical Models, Exponential Families, and Variational Inference , 2008, Found. Trends Mach. Learn..

[30]  E. N.,et al.  The Calculus of Finite Differences , 1934, Nature.

[31]  W.J. Tompkins,et al.  ECG beat detection using filter banks , 1999, IEEE Transactions on Biomedical Engineering.

[32]  Naif Alajlan,et al.  Deep learning approach for active classification of electrocardiogram signals , 2016, Inf. Sci..

[33]  Pablo Laguna,et al.  Bioelectrical Signal Processing in Cardiac and Neurological Applications , 2005 .

[34]  Kira Radinsky,et al.  PGANs: Personalized Generative Adversarial Networks for ECG Synthesis to Improve Patient-Specific Deep ECG Classification , 2019, AAAI.

[35]  Evgeniy Gabrilovich,et al.  Wikipedia-based Semantic Interpretation for Natural Language Processing , 2014, J. Artif. Intell. Res..

[36]  Ashish Kapoor,et al.  Explorations and Lessons Learned in Building an Autonomous Formula SAE Car from Simulations , 2019, SIMULTECH.

[37]  Liqing Zhang,et al.  ECG Arrhythmias Recognition System Based on Independent Component Analysis Feature Extraction , 2006, TENCON 2006 - 2006 IEEE Region 10 Conference.

[38]  W. Zareba,et al.  Heart rate variability. , 2013, Handbook of clinical neurology.

[39]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[40]  Alex Graves,et al.  Playing Atari with Deep Reinforcement Learning , 2013, ArXiv.