Integrating multi-domain deep features of electrocardiogram and phonocardiogram for coronary artery disease detection

Electrocardiogram (ECG) and phonocardiogram (PCG) are both noninvasive and convenient tools that can capture abnormal heart states caused by coronary artery disease (CAD). However, it is very challenging to detect CAD relying on ECG or PCG alone due to low diagnostic sensitivity. Recently, several studies have attempted to combine ECG and PCG signals for diagnosing heart abnormalities, but only conventional manual features have been used. Considering the strong feature extraction capabilities of deep learning, this paper develops a multi-input convolutional neural network (CNN) framework that integrates time, frequency, and time-frequency domain deep features of ECG and PCG for CAD detection. Simultaneously recorded ECG and PCG signals from 195 subjects are used. The proposed framework consists of 1-D and 2-D CNN models and uses signals, spectrum images, and time-frequency images of ECG and PCG as inputs. The framework combining multi-domain deep features of two-modal signals is very effective in classifying non-CAD and CAD subjects, achieving an accuracy, sensitivity, and specificity of 96.51%, 99.37%, and 90.08%, respectively. The comparison with existing studies demonstrates that our method is very competitive in CAD detection. The proposed approach is very promising in assisting the real-world CAD diagnosis, especially under general medical conditions.

[1]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[2]  Goutam Saha,et al.  Classification of coronary artery diseased and normal subjects using multi-channel phonocardiogram signal , 2019, Biocybernetics and Biomedical Engineering.

[3]  Eamonn J. Keogh,et al.  Scaling up dynamic time warping for datamining applications , 2000, KDD '00.

[4]  Yan Wang,et al.  Dual-Input Neural Network Integrating Feature Extraction and Deep Learning for Coronary Artery Disease Detection Using Electrocardiogram and Phonocardiogram , 2019, IEEE Access.

[5]  Stan Davis,et al.  Comparison of Parametric Representations for Monosyllabic Word Recognition in Continuously Spoken Se , 1980 .

[6]  Gian Marti,et al.  Heart sound classification using deep structured features , 2016, 2016 Computing in Cardiology Conference (CinC).

[7]  Chee-Ming Ting,et al.  Short-segment Heart Sound Classification Using an Ensemble of Deep Convolutional Neural Networks , 2018, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[8]  U. Rajendra Acharya,et al.  Application of stacked convolutional and long short-term memory network for accurate identification of CAD ECG signals , 2018, Comput. Biol. Medicine.

[9]  R. Mead,et al.  Evaluation of left ventricular systolic function using synchronized analysis of heart sounds and the electrocardiogram. , 2020, Heart rhythm.

[10]  Ignacio Diaz Bobillo,et al.  A tensor approach to heart sound classification , 2016, 2016 Computing in Cardiology Conference (CinC).

[11]  U. Rajendra Acharya,et al.  Application of higher-order spectra for the characterization of Coronary artery disease using electrocardiogram signals , 2017, Biomed. Signal Process. Control..

[12]  Ye Li,et al.  Multiscaled Fusion of Deep Convolutional Neural Networks for Screening Atrial Fibrillation From Single Lead Short ECG Recordings , 2018, IEEE Journal of Biomedical and Health Informatics.

[13]  Yakoub Bazi,et al.  Convolutional Neural Networks for Electrocardiogram Classification , 2018, Journal of Medical and Biological Engineering.

[14]  Bryan R. Conroy,et al.  Ensemble of feature-based and deep learning-based classifiers for detection of abnormal heart sounds , 2016, 2016 Computing in Cardiology Conference (CinC).

[15]  Joel E. W. Koh,et al.  Entropies for automated detection of coronary artery disease using ECG signals: A review , 2018 .

[16]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  I Md. Dendi Maysanjaya,et al.  Abnormal Heart Rhythm Detection Based on Spectrogram of Heart Sound using Convolutional Neural Network , 2018, 2018 6th International Conference on Cyber and IT Service Management (CITSM).

[18]  U. Rajendra Acharya,et al.  Characterization of coronary artery disease using flexible analytic wavelet transform applied on ECG signals , 2017, Biomed. Signal Process. Control..

[19]  Benjamin D Levine,et al.  Protecting athletes from sudden cardiac death. , 2006, JAMA.

[20]  Diyi Yang,et al.  Hierarchical Attention Networks for Document Classification , 2016, NAACL.

[21]  Anthony Kaveh,et al.  Automated classification of coronary atherosclerosis using single lead ECG , 2013, 2013 IEEE Conference on Wireless Sensor (ICWISE).

[22]  Aggelos K. Katsaggelos,et al.  Heart sound anomaly and quality detection using ensemble of neural networks without segmentation , 2016, 2016 Computing in Cardiology Conference (CinC).

[23]  U. Rajendra Acharya,et al.  Automated characterization and classification of coronary artery disease and myocardial infarction by decomposition of ECG signals: A comparative study , 2017, Inf. Sci..

[24]  John L Semmlow,et al.  Utility of an advanced digital electronic stethoscope in the diagnosis of coronary artery disease compared with coronary computed tomographic angiography. , 2013, The American journal of cardiology.

[25]  William Pavlicek,et al.  Dynamics of Diastolic Sounds Caused by Partially Occluded Coronary Arteries , 2009, IEEE Transactions on Biomedical Engineering.

[26]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[28]  Tim Oates,et al.  Imaging Time-Series to Improve Classification and Imputation , 2015, IJCAI.

[29]  Khashayar Khorasani,et al.  Deep Convolutional Neural Networks and Learning ECG Features for Screening Paroxysmal Atrial Fibrillation Patients , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[30]  Giancarlo Fortino,et al.  Applying an ensemble convolutional neural network with Savitzky-Golay filter to construct a phonocardiogram prediction model , 2019, Appl. Soft Comput..

[31]  Ling Xia,et al.  Cardiodynamicsgram as a New Diagnostic Tool in Coronary Artery Disease Patients With Nondiagnostic Electrocardiograms. , 2017, The American journal of cardiology.

[32]  U. Rajendra Acharya,et al.  Automated detection of coronary artery disease using different durations of ECG segments with convolutional neural network , 2017, Knowl. Based Syst..

[33]  Lalu Mansinha,et al.  Localization of the complex spectrum: the S transform , 1996, IEEE Trans. Signal Process..

[34]  Bin Yao,et al.  ECG Arrhythmia Classification Using STFT-Based Spectrogram and Convolutional Neural Network , 2019, IEEE Access.

[35]  Egon Toft,et al.  Acoustic Features for the Identification of Coronary Artery Disease , 2015, IEEE Transactions on Biomedical Engineering.

[36]  Moncef Gabbouj,et al.  Real-Time Patient-Specific ECG Classification by 1-D Convolutional Neural Networks , 2016, IEEE Transactions on Biomedical Engineering.

[37]  Andrew Zisserman,et al.  Convolutional Two-Stream Network Fusion for Video Action Recognition , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Xiaohong Zhang,et al.  ECG authentication system design incorporating a convolutional neural network and generalized S-Transformation , 2018, Comput. Biol. Medicine.