A novel data augmentation method to enhance deep neural networks for detection of atrial fibrillation

Abstract Automated detection of atrial fibrillation (AF) from electrocardiogram (ECG) recordings remains challenging in real clinical settings. Deep neural networks (DNN) emerge as a promising tool for the task of AF detection. However, the success of DNN for AF detection is hampered by limited size and imbalanced number of samples in datasets. We propose a novel data augmentation strategy based on duplication, concatenation and resampling of ECG episodes to balance the number of samples among different categories as well as to increase the diversity of samples. The performance of the data augmentation method was examined on an AF database from Computing in Cardiology (CinC) challenge 2017. A 2-layer long short-term memory (LSTM) network was trained with the augmented dataset. Its ability of AF detection was evaluated using a 10-fold cross validation approach. And F1 score was adopted as the metrics. The AF detection results show that the proposed method was superior to two conventional data augmentation methods: window slicing and permutation. The network was also submitted to the evaluation system of the CinC challenge 2017. The F1 score obtained by the network using the proposed data augmentation method was close to the winner (0.82 vs. 0.83). In summary, the proposed data augmentation method provides an effective solution to enhance the dataset for improving the performance of DNN in ECG analysis. Such a method promotes the application of deep learning in the analysis of ECG, particularly when the dataset is small and imbalanced.

[1]  Marie-Francine Moens,et al.  A survey on the application of recurrent neural networks to statistical language modeling , 2015, Comput. Speech Lang..

[2]  Shahrokh Valaee,et al.  Image Augmentation Using Radial Transform for Training Deep Neural Networks , 2017, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  Willis J. Tompkins,et al.  A Real-Time QRS Detection Algorithm , 1985, IEEE Transactions on Biomedical Engineering.

[4]  David L. Donoho,et al.  De-noising by soft-thresholding , 1995, IEEE Trans. Inf. Theory.

[5]  Zoubin Ghahramani,et al.  A Theoretically Grounded Application of Dropout in Recurrent Neural Networks , 2015, NIPS.

[6]  E. Helfenbein,et al.  Improvements in atrial fibrillation detection for real-time monitoring. , 2009, Journal of electrocardiology.

[7]  Justin Salamon,et al.  Deep Convolutional Neural Networks and Data Augmentation for Environmental Sound Classification , 2016, IEEE Signal Processing Letters.

[8]  Paulo Carvalho,et al.  Detection of Atrial Fibrillation using model-based ECG analysis , 2008, 2008 19th International Conference on Pattern Recognition.

[9]  A. Oto,et al.  P Wave Dispersion on 12‐Lead Electrocardiography in Patients with Paroxysmal Atrial Fibrillation , 2000, Pacing and clinical electrophysiology : PACE.

[10]  Guang-Zhong Yang,et al.  Deep Learning for Health Informatics , 2017, IEEE Journal of Biomedical and Health Informatics.

[11]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[12]  Masoumeh Haghpanahi,et al.  Cardiologist-level arrhythmia detection and classification in ambulatory electrocardiograms using a deep neural network , 2019, Nature Medicine.

[13]  Jie Lian,et al.  A simple method to detect atrial fibrillation using RR intervals. , 2011, The American journal of cardiology.

[14]  Henggui Zhang,et al.  Detecting atrial fibrillation by deep convolutional neural networks , 2018, Comput. Biol. Medicine.

[15]  C.-C. Jay Kuo,et al.  ECG-based biometrics using recurrent neural networks , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[16]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[17]  Meng Wu,et al.  ENCASE: An ENsemble ClASsifiEr for ECG classification using expert features and deep neural networks , 2017, 2017 Computing in Cardiology (CinC).

[18]  P. Wolf,et al.  Atrial fibrillation as an independent risk factor for stroke: the Framingham Study. , 1991, Stroke.

[19]  Yu-Liang Hsu,et al.  Automatic sleep stage recurrent neural classifier using energy features of EEG signals , 2013, Neurocomputing.

[20]  J. Gialafos,et al.  Increased Variance of P Wave Duration on the Electrocardiogram Distinguishes Patients with Idiopathic Paroxysmal Atrial Fibrillation , 2000, Pacing and clinical electrophysiology : PACE.

[21]  U. Rajendra Acharya,et al.  Automated detection of atrial fibrillation using long short-term memory network with RR interval signals , 2018, Comput. Biol. Medicine.

[22]  Chao Huang,et al.  A Novel Method for Detection of the Transition Between Atrial Fibrillation and Sinus Rhythm , 2011, IEEE Transactions on Biomedical Engineering.

[23]  M. Jeon,et al.  Atrial fibrillation detection by heart rate variability in Poincare plot , 2009, Biomedical engineering online.

[24]  Brij N. Singh,et al.  Optimal selection of wavelet basis function applied to ECG signal denoising , 2006, Digit. Signal Process..

[25]  Danny Eytan,et al.  Atrial fibrillation classification using step-by-step machine learning , 2018 .

[26]  A. Camm,et al.  Silent Atrial Fibrillation—Another Pandora's Box , 2000, Pacing and clinical electrophysiology : PACE.

[27]  Rabab Kreidieh Ward,et al.  Deep Sentence Embedding Using Long Short-Term Memory Networks: Analysis and Application to Information Retrieval , 2015, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[28]  Jichao Zhao,et al.  Robust ECG signal classification for detection of atrial fibrillation using a novel neural network , 2017, 2017 Computing in Cardiology (CinC).

[29]  Subhransu Maji,et al.  Visualizing and Understanding Deep Texture Representations , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Rishikesan Kamaleswaran,et al.  A robust deep convolutional neural network for the classification of abnormal cardiac rhythm using single lead electrocardiograms of variable length , 2018, Physiological measurement.

[31]  D. Levy,et al.  Impact of atrial fibrillation on the risk of death: the Framingham Heart Study. , 1998, Circulation.

[32]  Silvia G Priori,et al.  2011 ACCF/AHA/HRS focused updates incorporated into the ACC/AHA/ESC 2006 guidelines for the management of patients with atrial fibrillation: a report of the American College of Cardiology Foundation/American Heart Association Task Force on practice guidelines. , 2011, Circulation.

[33]  Stefan Klein,et al.  Stochastic optimization with randomized smoothing for image registration , 2017, Medical Image Anal..

[34]  Behnaz Ghoraani,et al.  Rate-independent detection of atrial fibrillation by statistical modeling of atrial activity , 2015, Biomed. Signal Process. Control..

[35]  Paulo Félix,et al.  Arrhythmia classification from the abductive interpretation of short single-lead ECG records , 2017, 2017 Computing in Cardiology (CinC).

[36]  Aggelos K. Katsaggelos,et al.  Detection of atrial fibrillation in ECG hand-held devices using a random forest classifier , 2017, 2017 Computing in Cardiology (CinC).

[37]  Soma Bandyopadhyay,et al.  Identifying normal, AF and other abnormal ECG rhythms using a cascaded binary classifier , 2017, 2017 Computing in Cardiology (CinC).

[38]  Emma Pickwell-MacPherson,et al.  Automatic online detection of atrial fibrillation based on symbolic dynamics and Shannon entropy , 2014, BioMedical Engineering OnLine.

[39]  Michael Tschannen,et al.  Convolutional recurrent neural networks for electrocardiogram classification , 2017, 2017 Computing in Cardiology (CinC).

[40]  Dawid Smolen Atrial fibrillation detection using boosting and stacking ensemble , 2017, 2017 Computing in Cardiology (CinC).

[41]  Günter Schreier,et al.  ECG classification based on time and frequency domain features using random forests , 2017, 2017 Computing in Cardiology (CinC).

[42]  Peter C. Y. Chen,et al.  LSTM network: a deep learning approach for short-term traffic forecast , 2017 .

[43]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[44]  Sadasivan Puthusserypady,et al.  A deep learning approach for real-time detection of atrial fibrillation , 2019, Expert Syst. Appl..

[45]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[46]  J. Gardin,et al.  Prevalence of atrial fibrillation in elderly subjects (the Cardiovascular Health Study). , 1994, The American journal of cardiology.

[47]  I. Johnstone,et al.  Ideal spatial adaptation by wavelet shrinkage , 1994 .

[48]  A Laupacis,et al.  Prevalence, age distribution, and gender of patients with atrial fibrillation. Analysis and implications. , 1995, Archives of internal medicine.

[49]  Alireza Mehrnia,et al.  Automatic detection of atrial fibrillation using stationary wavelet transform and support vector machine , 2015, Comput. Biol. Medicine.

[50]  Dana Kulic,et al.  Data augmentation of wearable sensor data for parkinson’s disease monitoring using convolutional neural networks , 2017, ICMI.

[51]  Qiao Li,et al.  AF classification from a short single lead ECG recording: The PhysioNet/computing in cardiology challenge 2017 , 2017, 2017 Computing in Cardiology (CinC).

[52]  Romain Tavenard,et al.  Data Augmentation for Time Series Classification using Convolutional Neural Networks , 2016 .

[53]  Shoushui Wei,et al.  Atrial Fibrillation Beat Identification Using the Combination of Modified Frequency Slice Wavelet Transform and Convolutional Neural Networks , 2018, Journal of healthcare engineering.

[54]  Yunpeng Wang,et al.  Long short-term memory neural network for traffic speed prediction using remote microwave sensor data , 2015 .

[55]  J. McMurray,et al.  Population prevalence, incidence, and predictors of atrial fibrillation in the Renfrew/Paisley study , 2001, Heart.

[56]  Wei Zhou,et al.  A support vector machine approach for AF classification from a short single-lead ECG recording , 2018, Physiological measurement.