ECG assessment based on neural networks with pretraining

Graphical abstractDisplay Omitted HighlightsDeep networks with pretraining can be used to assess ECGs as abnormal or not.The decision support system uses ECG raw signals for classification.The decision support system outperforms classification systems clinically approved.The decision support system outperforms other standard classification methods.Our approach is promising for referring patients to a cardiology service in clinical practice. In this paper, we present a new automatic screening method to assess whether a patient from ambulatory care or emergency should be referred to a cardiology service. This method is based on deep neural networks with pretraining and takes as an input a raw ECG signal without annotation.This work is based on a prospective clinical study that took place at Hospital Clnic in Barcelona between 20112012 and recruited 1390 patients. For each patient, we recorded a 12-lead ECG and the diagnosis was conducted by the cardiology service at the same hospital. Normal, borderline normal and normal variant ECGs were labelled as normal and the rest as abnormal.Our deep neural networks with pretraining were tested through cross-validation with a cohort of 416 test patients. The performance of our model was compared against other standard classification methods such as neural networks without pretraining, Support Vector Machines, Extreme Learning Machines, k-Nearest Neighbours and a professional classification algorithm certified for medical use that annotates the raw ECG signals prior to classification.The resulting best classifier was a pretrained neural network with three hidden layers and 700 units in every layer. This network yielded an accuracy of 0.8552, a sensitivity of 0.9176 and a specificity of 0.7827. The best alternative classification method was a Support Vector Machine with a Gaussian kernel, which yielded an accuracy of 0.8476, a sensitivity of 0.9446 and a specificity of 0.7346. The professional classification algorithm yielded an accuracy of 0.8407, a sensitivity of 0.8558 and a specificity of 0.8214.Neural networks with pretraining automatically obtain a representation of the input data without resorting to any annotation and, thus, simplify the process of assessing normality of ECG signals. The results that we have obtained are slightly better than those obtained with the professional classification system and, for some network configurations, they can be considered as exchangeable.Neural networks with pretraining open up a promising line of research for the automatic assessment of ECG signals that may be used in the future in clinical practice.

[1]  Geoffrey E. Hinton,et al.  Using Deep Belief Nets to Learn Covariance Kernels for Gaussian Processes , 2007, NIPS.

[2]  K. Egiazarian,et al.  Comparative study of morphological and time-frequency ECG descriptors for heartbeat classification. , 2006, Medical engineering & physics.

[3]  Guang-Bin Huang,et al.  Trends in extreme learning machines: A review , 2015, Neural Networks.

[4]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  U. Rajendra Acharya,et al.  Application of higher order statistics for atrial arrhythmia classification , 2013, Biomed. Signal Process. Control..

[6]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[7]  M. Arthanari,et al.  Classification of ECG Signals Using Extreme Learning Machine , 2011, Comput. Inf. Sci..

[8]  Enrique Romero,et al.  Assessment of electrocardiograms with pretraining and shallow networks , 2014, Computing in Cardiology 2014.

[9]  Enzo Pasquale Scilingo,et al.  Robust multiple cardiac arrhythmia detection through bispectrum analysis , 2011, Expert Syst. Appl..

[10]  Majid Moavenian,et al.  A qualitative comparison of Artificial Neural Networks and Support Vector Machines in ECG arrhythmias classification , 2010, Expert Syst. Appl..

[11]  Jürgen Schmidhuber,et al.  Multi-column deep neural networks for image classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Mustafa Poyraz,et al.  An expert system for automated recognition of patients with obstructive sleep apnea using electrocardiogram recordings , 2011, Expert Syst. Appl..

[13]  Paolo Melillo,et al.  Remote Health Monitoring of Heart Failure With Data Mining via CART Method on HRV Features , 2011, IEEE Transactions on Biomedical Engineering.

[14]  Jocelyne Fayn,et al.  A Classification Tree Approach for Cardiac Ischemia Detection Using Spatiotemporal Information From Three Standard ECG Leads , 2011, IEEE Transactions on Biomedical Engineering.

[15]  Geoffrey E. Hinton Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.

[16]  Paul Smolensky,et al.  Information processing in dynamical systems: foundations of harmony theory , 1986 .

[17]  Yoshua Bengio,et al.  Deep Learning of Representations: Looking Forward , 2013, SLSP.

[18]  D. Patra,et al.  Integration Of Fcm , Pca And Neural Networks For Classification Of Ecg Arrhythmias , 2022 .

[19]  U. Rajendra Acharya,et al.  Automated diagnosis of Coronary Artery Disease affected patients using LDA, PCA, ICA and Discrete Wavelet Transform , 2013, Knowl. Based Syst..

[20]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[21]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[22]  Julien Fleureau,et al.  Modelling temporal evolution of cardiac electrophysiological features using Hidden Semi-Markov Models , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[23]  Gregory W. Barsness,et al.  Mayo Clinic Cardiology , 2006 .

[24]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[25]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[26]  Yoshua Bengio,et al.  Greedy Layer-Wise Training of Deep Networks , 2006, NIPS.

[27]  Chee Kheong Siew,et al.  Universal Approximation using Incremental Constructive Feedforward Networks with Random Hidden Nodes , 2006, IEEE Transactions on Neural Networks.

[28]  Moncef Gabbouj,et al.  Personalized long-term ECG classification: A systematic approach , 2011, Expert Syst. Appl..

[29]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[30]  Bernadette Dorizzi,et al.  Incremental HMM training applied to ECG signal analysis , 2008, Comput. Biol. Medicine.

[31]  J. Ruiz-Rodríguez,et al.  Innovative continuous non-invasive cuffless blood pressure monitoring based on photoplethysmography technology , 2013, Intensive Care Medicine.

[32]  Yoshua Bengio,et al.  Practical Recommendations for Gradient-Based Training of Deep Architectures , 2012, Neural Networks: Tricks of the Trade.

[33]  Marc'Aurelio Ranzato,et al.  Building high-level features using large scale unsupervised learning , 2011, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[34]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[35]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[36]  H. S. Niranjana Murthy,et al.  Comparison between ANN-Based Heart Stroke Classifiers Using Varied Folds Data Set Cross-Validation , 2015 .

[37]  Malay Mitra,et al.  Cardiac Arrhythmia Classification Using Neural Networks with Selected Features , 2013 .

[38]  Yoshua Bengio,et al.  Why Does Unsupervised Pre-training Help Deep Learning? , 2010, AISTATS.