Continuous Sound Collection Using Smartphones and Machine Learning to Measure Cough.

Background Despite the efforts of research groups to develop and implement at least partial automation, cough counting remains impractical. Analysis of 24-h cough frequency is an established regulatory endpoint which, if addressed in an automated manner, has the potential to ease cough symptom evaluation over multiple 24-h periods in a patient-centric way, supporting the development of novel treatments for chronic cough, an unmet clinical need. Objectives In light of recent technological advancements, we propose a system based on the use of smartphones for objective continuous sound collection, suitable for automated cough detection and analysis. Two capabilities were identified as necessary for naturalistic cough assessment: (1) recording sound in a continuous manner (sound collection), and (2) detection of coughs from the recorded sound (cough detection). Methods This work did not involve any human subject testing or trials. For sound collection, we designed, built, and verified technical parameters of a smartphone application for sound collection. Our cough detection work describes the development of a mathematical model for sound analysis and cough identification. Performance of the model was compared to previously published results of commercially available solutions and to human raters. The compared solutions use the following methods to automatically or semi-automatically assess cough: 24-h sound recording with an ambulatory device with multiple microphones, automatic silence removal, and manual recording review for cough count. Results Sound collection: the application demonstrated the ability to continuously record sounds using the phone's internal microphone; the technical verification informed the configuration of the technical and user experience parameters. Cough detection: our cough recognition sensitivity to cough as determined by human listeners was 90 at 99.5% specificity preset and 75 at 99.9% specificity preset for a dataset created from publicly available data. Conclusions Sound collection: the application reliably collects sound data and uploads them securely to a remote server for subsequent analysis; the developed sound data collection application is a critical first step toward future incorporation in clinical trials. Cough detection: initial experiments with cough detection techniques yielded encouraging results for application to patient-collected data from future studies.

[1]  Vinayak Swarnkar,et al.  Automatic Identification of Wet and Dry Cough in Pediatric Patients with Respiratory Diseases , 2013, Annals of Biomedical Engineering.

[2]  Aren Jansen,et al.  CNN architectures for large-scale audio classification , 2016, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  A. Murata,et al.  Discrimination of productive and non-productive cough by sound analysis. , 1998, Internal medicine.

[4]  Juliana A. Knocikova,et al.  Wavelet analysis of voluntary cough sound in patients with respiratory diseases. , 2008, Journal of physiology and pharmacology : an official journal of the Polish Physiological Society.

[5]  Frank Knoefel,et al.  Feature extraction for the differentiation of dry and wet cough sounds , 2011, 2011 IEEE International Symposium on Medical Measurements and Applications.

[6]  D H Evans,et al.  The Leicester Cough Monitor: preliminary validation of an automated cough detection system in chronic cough , 2008, European Respiratory Journal.

[7]  D. Bolser Pharmacologic management of cough. , 2010, Otolaryngologic clinics of North America.

[8]  P. Dicpinigaitis Cough: an unmet clinical need , 2011, British journal of pharmacology.

[9]  Surinder S Birring,et al.  An update on measurement and monitoring of cough: what are the important study endpoints? , 2014, Journal of thoracic disease.

[10]  Samantha J Barry,et al.  The automatic recognition and counting of cough , 2006, Cough.

[11]  T. Ritz,et al.  Discrepancies between lung function and asthma control: Asthma perception and association with demographics and anxiety , 2012, Allergy and asthma proceedings.

[12]  Kevin McGuinness,et al.  P159 Validation of the VitaloJAK™ 24 Hour Ambulatory Cough Monitor , 2012, Thorax.