Heart sound classification based on improved MFCC features and convolutional recurrent neural networks

Heart sound classification plays a vital role in the early detection of cardiovascular disorders, especially for small primary health care clinics. Despite that much progress has been made for heart sound classification in recent years, most of them are based on conventional segmented features and shallow structure based classifiers. These conventional acoustic representation and classification methods may be insufficient in characterizing heart sound, and generally suffer from a degraded performance due to the complicated and changeable cardiac acoustic environment. In this paper, we propose a new heart sound classification method based on improved Mel-frequency cepstrum coefficient (MFCC) features and convolutional recurrent neural networks. The Mel-frequency cepstrums are firstly calculated without dividing the heart sound signal. A new improved feature extraction scheme based on MFCC is proposed to elaborate the dynamic characteristics among consecutive heart sound signals. Finally, the MFCC-based features are fed to a deep convolutional and recurrent neural network (CRNN) for feature learning and later classification task. The proposed deep learning framework can take advantage of the encoded local characteristics extracted from the convolutional neural network (CNN) and the long-term dependencies captured by the recurrent neural network (RNN). Comprehensive studies on the performance of different network parameters and different network connection strategies are presented in this paper. Performance comparisons with state-of-the-art algorithms are given for discussions. Experiments show that, for the two-class classification problem (pathological or non-pathological), a classification accuracy of 98% has been achieved on the 2016 PhysioNet/CinC Challenge database.

[1]  Hazem Hajj,et al.  Classification of normal and abnormal heart sounds , 2017, 2017 Fourth International Conference on Advances in Biomedical Engineering (ICABME).

[2]  Hoang Trang,et al.  Proposed combination of PCA and MFCC feature extraction in speech recognition system , 2014, 2014 International Conference on Advanced Technologies for Communications (ATC 2014).

[3]  Bryan R. Conroy,et al.  Ensemble of feature-based and deep learning-based classifiers for detection of abnormal heart sounds , 2016, 2016 Computing in Cardiology Conference (CinC).

[4]  Babatunde S Emmanuel A review of signal processing techniques for heart sound analysis in clinical diagnosis , 2012, Journal of medical engineering & technology.

[5]  K. Ho,et al.  Factors influencing cardiac auscultation proficiency in physician trainees. , 2005, Singapore medical journal.

[6]  Suleyman S. Kozat,et al.  Online Training of LSTM Networks in Distributed Systems for Variable Length Data Sequences , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[7]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[8]  R. Akmeliawati,et al.  Adaptive Short Time Fourier Transform (STFT) Analysis of seismic electric signal (SES): A comparison of Hamming and rectangular window , 2012, 2012 IEEE Symposium on Industrial Electronics and Applications.

[9]  Andreas Dominik,et al.  Using deep gated RNN with a convolutional front end for end-to-end classification of heart sound , 2016, 2016 Computing in Cardiology Conference (CinC).

[10]  Simon Dixon,et al.  An End-to-End Neural Network for Polyphonic Piano Music Transcription , 2015, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[11]  Shi-Wen Deng,et al.  Towards heart sound classification without segmentation via autocorrelation feature and diffusion maps , 2016, Future Gener. Comput. Syst..

[12]  Gabriel Jimenez-Moreno,et al.  Deep Neural Networks for the Recognition and Classification of Heart Murmurs Using Neuromorphic Auditory Sensors , 2017, IEEE Transactions on Biomedical Circuits and Systems.

[13]  Qiao Li,et al.  Recent advances in heart sound analysis , 2017, Physiological measurement.

[14]  Shankar M. Krishnan,et al.  Neural network classification of homomorphic segmented heart sounds , 2007, Appl. Soft Comput..

[15]  Aggelos K. Katsaggelos,et al.  Heart sound anomaly and quality detection using ensemble of neural networks without segmentation , 2016, 2016 Computing in Cardiology Conference (CinC).

[16]  D. Mozaffarian,et al.  Executive summary: heart disease and stroke statistics--2010 update: a report from the American Heart Association. , 2010, Circulation.

[17]  Egon Toft,et al.  Acoustic Features for the Identification of Coronary Artery Disease , 2015, IEEE Transactions on Biomedical Engineering.

[18]  Kumar Sricharan,et al.  Recognizing Abnormal Heart Sounds Using Deep Learning , 2017, KHD@IJCAI.

[19]  Prospero C. Naval,et al.  Classification of heart sounds using discrete and continuous wavelet transform and random forests , 2015, 2015 3rd IAPR Asian Conference on Pattern Recognition (ACPR).

[20]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[21]  Rocío Alba-Flores,et al.  Detection and Classification of Cardiac Murmurs using Segmentation Techniques and Artificial Neural Networks , 2007, 2007 IEEE Symposium on Computational Intelligence and Data Mining.

[22]  Mark D. Huffman,et al.  Executive summary: heart disease and stroke statistics--2013 update: a report from the American Heart Association. , 2013, Circulation.

[23]  Lionel Tarassenko,et al.  Logistic Regression-HSMM-Based Heart Sound Segmentation , 2016, IEEE Transactions on Biomedical Engineering.

[24]  Yan Liu,et al.  Normal / abnormal heart sound recordings classification using convolutional neural network , 2016, 2016 Computing in Cardiology Conference (CinC).

[25]  Mark D. Huffman,et al.  Heart Disease and Stroke Statistics—2016 Update: A Report From the American Heart Association , 2016, Circulation.

[26]  Liang Zhong,et al.  A multi-modal classifier for heart sound recordings , 2016, 2016 Computing in Cardiology Conference (CinC).

[27]  Weibin Zhang,et al.  Automatic heart and lung sounds classification using convolutional neural networks , 2016, 2016 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA).

[28]  Zhongwei Jiang,et al.  Automatic moment segmentation and peak detection analysis of heart sound pattern via short-time modified Hilbert transform , 2014, Comput. Methods Programs Biomed..

[29]  Fernando Bação,et al.  Oversampling for Imbalanced Learning Based on K-Means and SMOTE , 2017, Inf. Sci..

[30]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[31]  Mohd Murtadha Mohamad,et al.  Classification of heart sound signals using autoregressive model and hidden markov model , 2017 .

[32]  Ping Wang,et al.  Phonocardiographic Signal Analysis Method Using a Modified Hidden Markov Model , 2007, Annals of Biomedical Engineering.

[33]  Qiao Li,et al.  An open access database for the evaluation of heart sound algorithms , 2016, Physiological measurement.

[34]  Yannis Stylianou,et al.  A study of time-frequency features for CNN-based automatic heart sound classification for pathology detection , 2018, Comput. Biol. Medicine.

[35]  Rajib Rana,et al.  Phonocardiographic Sensing Using Deep Learning for Abnormal Heartbeat Detection , 2018, IEEE Sensors Journal.

[36]  Jacques P. de Vos,et al.  Automated Pediatric Cardiac Auscultation , 2007, IEEE Transactions on Biomedical Engineering.

[37]  Waree Kongprawechnon,et al.  A framework for automatic heart sound analysis without segmentation , 2011, Biomedical engineering online.

[38]  Gian Marti,et al.  Heart sound classification using deep structured features , 2016, 2016 Computing in Cardiology Conference (CinC).

[39]  Kaustubh Manik Gaikwad,et al.  Removal of high frequency noise from ECG signal using digital IIR butterworth filter , 2014, 2014 IEEE Global Conference on Wireless Computing & Networking (GCWCN).