Classification of lung sounds using convolutional neural networks

In the field of medicine, with the introduction of computer systems that can collect and analyze massive amounts of data, many non-invasive diagnostic methods are being developed for a variety of conditions. In this study, our aim is to develop a non-invasive method of classifying respiratory sounds that are recorded by an electronic stethoscope and the audio recording software that uses various machine learning algorithms.In order to store respiratory sounds on a computer, we developed a cost-effective and easy-to-use electronic stethoscope that can be used with any device. Using this device, we recorded 17,930 lung sounds from 1630 subjects.We employed two types of machine learning algorithms; mel frequency cepstral coefficient (MFCC) features in a support vector machine (SVM) and spectrogram images in the convolutional neural network (CNN). Since using MFCC features with a SVM algorithm is a generally accepted classification method for audio, we utilized its results to benchmark the CNN algorithm. We prepared four data sets for each CNN and SVM algorithm to classify respiratory audio: (1) healthy versus pathological classification; (2) rale, rhonchus, and normal sound classification; (3) singular respiratory sound type classification; and (4) audio type classification with all sound types. Accuracy results of the experiments were; (1) CNN 86%, SVM 86%, (2) CNN 76%, SVM 75%, (3) CNN 80%, SVM 80%, and (4) CNN 62%, SVM 62%, respectively.As a result, we found out that spectrogram image classification with CNN algorithm works as well as the SVM algorithm, and given the large amount of data, CNN and SVM machine learning algorithms can accurately classify and pre-diagnose respiratory audio.

[1]  Sridhar Krishnan,et al.  Adventitious Sounds Identification and Extraction Using Temporal–Spectral Dominance-Based Features , 2011, IEEE Transactions on Biomedical Engineering.

[2]  Zümray Dokur,et al.  Respiratory sound classification by using an incremental supervised neural network , 2009, Pattern Analysis and Applications.

[3]  Thomas B. Moeslund,et al.  Spatio-temporal Pain Recognition in CNN-Based Super-Resolved Facial Images , 2016, VAAM/FFER@ICPR.

[4]  P Nohama,et al.  Method for automatic detection of wheezing in lung sounds. , 2009, Brazilian journal of medical and biological research = Revista brasileira de pesquisas medicas e biologicas.

[5]  Sonia Charleston-Villalobos,et al.  Assessment of multichannel lung sounds parameterization for two-class classification in interstitial lung disease patients , 2011, Comput. Biol. Medicine.

[6]  M. Bahoura,et al.  New parameters for respiratory sound classification , 2003, CCECE 2003 - Canadian Conference on Electrical and Computer Engineering. Toward a Caring and Humane Technology (Cat. No.03CH37436).

[7]  N. Malmurugan,et al.  Neural classification of lung sounds using wavelet coefficients , 2004, Comput. Biol. Medicine.

[8]  Y.P. Kahya,et al.  Analysis and classification of respiratory sounds by signal coherence method , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[9]  Ronan Collobert,et al.  Deep Learning for Efficient Discriminative Parsing , 2011, AISTATS.

[10]  Amjad Hashemi,et al.  Classification of Wheeze Sounds Using Wavelets and Neural Networks , 2022 .

[11]  Bdcn Prasadl,et al.  AN APPROACH TO DEVELOP EXPERT SYSTEMS IN MEDICAL DIAGNOSIS USING MACHINE LEARNING ALGORITHMS (A STHMA ) AND A PERFORMANCE STUDY , 2011 .

[12]  Yu Ding,et al.  Segmentation, Inference and Classification of Partially Overlapping Nanoparticles , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  E. H. Dooijes,et al.  Asthmatic airways obstruction assessment based on detailed analysis of respiratory sound spectra , 2000, IEEE Transactions on Biomedical Engineering.

[14]  Y.P. Kahya,et al.  Classifying Respiratory Sounds with Different Feature Sets , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[15]  Ali Gangal,et al.  Classification of healthy and pathologic lung sounds recorded with electronic auscultation , 2015, 2015 23nd Signal Processing and Communications Applications Conference (SIU).

[16]  E. Andrès,et al.  Analysis of Respiratory Sounds: State of the Art , 2008, Clinical medicine. Circulatory, respiratory and pulmonary medicine.

[17]  Nizamettin Aydin,et al.  Feature extraction using time-frequency/scale analysis and ensemble of feature sets for crackle detection , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[18]  J. E. Earis,et al.  Current methods used for computerized respiratory sound analysis , 2004 .

[19]  Li Deng,et al.  Three Classes of Deep Learning Architectures and Their Applications: A Tutorial Survey , 2012 .

[20]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  H. Pasterkamp,et al.  Respiratory sounds. Advances beyond the stethoscope. , 1997, American journal of respiratory and critical care medicine.

[22]  Yasemin P. Kahya,et al.  Design of a DSP-based instrument for real-time classification of pulmonary sounds , 2008, Comput. Biol. Medicine.

[23]  Y.P. Kahya,et al.  Respiratory disease diagnosis using lung sounds , 1997, Proceedings of the 19th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. 'Magnificent Milestones and Emerging Opportunities in Medical Engineering' (Cat. No.97CH36136).

[24]  Hüseyin Polat,et al.  Combining Neural Network and Genetic Algorithm for Prediction of Lung Sounds , 2005, Journal of Medical Systems.

[25]  Tan-Hsu Tan,et al.  Using K-Nearest Neighbor Classification to Diagnose Abnormal Lung Sounds , 2015, Sensors.

[26]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[27]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[28]  Mohammed Bahoura,et al.  An integrated automated system for crackles extraction and classification , 2008, Biomed. Signal Process. Control..

[29]  R. Gonzalez-Camarena,et al.  Computerized Classification of Normal and Abnormal Lung Sounds by Multivariate Linear Autoregressive Model , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[30]  A. Vyshedskiy,et al.  Automated Analysis of Crackles in Patients with Interstitial Pulmonary Fibrosis , 2010, Pulmonary medicine.

[31]  Dong Yu,et al.  Deep Learning: Methods and Applications , 2014, Found. Trends Signal Process..

[32]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[33]  R. Loudon,et al.  The lung exam. , 1987, Clinics in chest medicine.

[34]  Aintree Chest,et al.  Current methods used for computerized respiratory sound analysis , 2000 .

[35]  Paul H. King,et al.  Representation and Classification of Breath Sounds Recorded in an Intensive Care Setting Using Neural Networks , 2004, Journal of Clinical Monitoring and Computing.

[36]  Katsuya Yamauchi,et al.  Classification between normal and abnormal respiratory sounds based on maximum likelihood approach , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[37]  Evor L. Hines,et al.  Comparison of neural network predictors in the classification of tracheal-bronchial breath sounds by respiratory auscultation , 2004, Artif. Intell. Medicine.

[38]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[39]  G Burnstock,et al.  Potential therapeutic targets in the rapidly expanding field of purinergic signalling. , 2002, Clinical medicine.

[40]  Percy Nohama,et al.  Methodology for Automatic Classification of Adventitious Lung Sounds , 2009 .

[41]  Sueharu Miyahara,et al.  Discrimination between healthy subjects and patients with pulmonary emphysema by detection of abnormal respiration , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[42]  D. Scuse,et al.  A comparison of neural network models for wheeze detection , 1995, IEEE WESCANEX 95. Communications, Power, and Computing. Conference Proceedings.

[43]  Patrick O. Glauner Comparison of Training Methods for Deep Neural Networks , 2015, ArXiv.

[44]  P. Mahadevan,et al.  An overview , 2007, Journal of Biosciences.

[45]  Hyun Ah Song,et al.  Hierarchical Representation Using NMF , 2013, ICONIP.

[46]  E. H. Dooijes,et al.  Classification of Asthmatic Breath Sounds: Preliminary Results of the Classifying Capacity of Human Examiners versus Artificial Neural Networks , 1999, Comput. Biomed. Res..

[47]  Yann LeCun,et al.  Convolutional networks and applications in vision , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.