Private Audio-Based Cough Sensing for In-Home Pulmonary Assessment Using Mobile Devices

With the prevalence of smartphones and smartwatches during the last decade, ambulatory audio-based monitoring of lung function has become more common. A symptom that provides significant information for determining the pulmonary patients’ state is cough. This work proposes a novel algorithm to detect the cough features such as frequency, type, and intensity, in a privacy preserving manner using readily-available mobile devices for daily monitoring. The cough classification algorithm consists of three main modules. Audio events will be detected in the first layer after pre-processing of raw audio data. Then, a random forest algorithm is applied to classify the event as cough, speech, or none for each of the time frames. Lastly, a majority voting scheme is applied on the output of the second layer for each time window (which consists of multiple time frames) to determine the final label for that window. The implemented sound event detector has detection error of less than 3% in an indoor situation and cough/speech/none classification reaches 96% accuracy using random forest algorithm. The system benefits from a privacy preservation algorithm (proposed in our previous work) to make the speech unintelligible while keeping the important cough features recognizable. The privacy preservation algorithm reduces the accuracy of classification by 11% (8% for cough and speech labels) which is not significant comparing to the benefit it delivers.

[1]  Naveed A. Sheikh,et al.  Sensorimotor and linguistic information attenuate emotional word processing benefits: an eye-movement study. , 2013, Emotion.

[2]  P. Dicpinigaitis Chronic cough due to asthma: ACCP evidence-based clinical practice guidelines. , 2006, Chest.

[3]  Jilong Kuang,et al.  A method for preserving privacy during audio recordings by filtering speech , 2017, 2017 IEEE Life Sciences Conference (LSC).

[4]  Xiao Sun,et al.  SymDetector: detecting sound-related respiratory symptoms using smartphones , 2015, UbiComp.

[5]  Kofi Odame,et al.  Deep Neural Networks for Identifying Cough Sounds , 2016, IEEE Transactions on Biomedical Circuits and Systems.

[6]  Nicholas D. Lane,et al.  DeepEar: robust smartphone audio sensing in unconstrained acoustic environments using deep learning , 2015, UbiComp.

[7]  Jilong Kuang,et al.  InstantRR: Instantaneous Respiratory Rate Estimation on Context-Aware Mobile Devices , 2018, BODYNETS.

[8]  Björn W. Schuller,et al.  Recent developments in openSMILE, the munich open-source multimedia feature extractor , 2013, ACM Multimedia.

[9]  D H Evans,et al.  The Leicester Cough Monitor: preliminary validation of an automated cough detection system in chronic cough , 2008, European Respiratory Journal.

[10]  M. Miravitlles,et al.  Cough and sputum production as risk factors for poor outcomes in patients with COPD. , 2011, Respiratory medicine.

[11]  Jilong Kuang,et al.  A novel algorithm for activity state recognition using smartwatch data , 2017, 2017 IEEE Healthcare Innovations and Point of Care Technologies (HI-POCT).

[12]  R. Tehrany Speech breathing patterns in health and chronic respiratory disease , 2015 .

[13]  Yan Shi,et al.  Theory and Application of Audio-Based Assessment of Cough , 2018, J. Sensors.

[14]  Samantha J Barry,et al.  The automatic recognition and counting of cough , 2006, Cough.

[15]  J. Korpáš,et al.  Analysis of the cough sound: an overview. , 1996, Pulmonary pharmacology.

[16]  Majid Sarrafzadeh,et al.  Gait velocity estimation for a smartwatch platform using Kalman filter peak recovery , 2016, 2016 IEEE 13th International Conference on Wearable and Implantable Body Sensor Networks (BSN).

[17]  Nicolas Roche,et al.  Cough and sputum production are associated with frequent exacerbations and hospitalizations in COPD subjects. , 2009, Chest.

[18]  Vinayak Swarnkar,et al.  Neural network based algorithm for automatic identification of cough sounds , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[19]  Majid Sarrafzadeh,et al.  A dynamic data source selection system for smartwatch platform , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[20]  David H. Evans,et al.  An Automated System for 24-h Monitoring of Cough Frequency: The Leicester Cough Monitor , 2007, IEEE Transactions on Biomedical Engineering.