Towards Passive Assessment of Pulmonary Function from Natural Speech Recorded Using a Mobile Phone

Chronic obstructive pulmonary disease (COPD) and asthma are the most common respiratory diseases that impact millions of people worldwide annually. With advances in mobile computing and machine learning techniques, there has been increased interest in using mobile devices to monitor pulmonary diseases. Nevertheless, the current state-of-the-art technology requires active involvement and high-effort input from the users, impeding continuous monitoring of pulmonary conditions. In this work, two algorithms are proposed for passive assessment of pulmonary condition: one for detection of obstructive pulmonary disease and the other for estimation of the pulmonary function in terms of FEV1/FVC ratio, which is an established clinical metric. The algorithms were developed and validated using the data sets from two studies: research study (healthy=40, pathological=91) and in-clinic study (healthy=10, pathological=60). From the cross-study validation where a classifier was trained on the research data set and tested on the in-clinic data set, the detection accuracy of the pathological class was obtained as 73.7% and the F1 score was 84.5% (87.2% precision and 82.0% recall). In our regression analysis, the FEV1/FVC ratio was predicted with a mean absolute error of 8.6%. Our analysis shows promising results and this work presents a meaningful milestone towards the passive assessment of pulmonary functions from spontaneous speech collected from a mobile phone.

[1]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[2]  J. Walters,et al.  Stability of the EasyOne ultrasonic spirometer for use in general practice , 2006, Respirology.

[3]  T. H. Nguyen,et al.  Global, regional, and national deaths, prevalence, disability-adjusted life years, and years lived with disability for chronic obstructive pulmonary disease and asthma, 1990–2015: a systematic analysis for the Global Burden of Disease Study 2015 , 2017, The Lancet. Respiratory medicine.

[4]  P. Suratt,et al.  An upper airway resonator model of high-frequency inspiratory sounds in children with sleep-disordered breathing. , 2005, Journal of applied physiology.

[5]  Sylvain Arlot,et al.  A survey of cross-validation procedures for model selection , 2009, 0907.4728.

[6]  Kathleen A. Liberty,et al.  Effects of asthma on breathing during reading aloud , 2017 .

[7]  C. Mathers,et al.  Projections of Global Mortality and Burden of Disease from 2002 to 2030 , 2006, PLoS medicine.

[8]  Kenneth Sundaraj,et al.  Classification of asthma severity levels by wheeze sound analysis , 2016, 2016 IEEE Conference on Systems, Process and Control (ICSPC).

[9]  Eric C. Larson,et al.  SpiroSmart: using a microphone to measure lung function on a mobile phone , 2012, UbiComp.

[10]  T. Nurmagambetov,et al.  The Economic Burden of Asthma in the United States, 2008‐2013 , 2018, Annals of the American Thoracic Society.

[11]  M. Patadia,et al.  Asthma: symptoms and presentation. , 2014, Otolaryngologic clinics of North America.

[12]  G. D. Clifford,et al.  TeleSpiro: A low-cost mobile spirometer for resource-limited settings , 2013, 2013 IEEE Point-of-Care Healthcare Technologies (PHT).

[13]  Dima Ruinskiy,et al.  An Effective Algorithm for Automatic Detection and Exact Demarcation of Breath Sounds in Speech and Song Signals , 2007, IEEE Transactions on Audio, Speech, and Language Processing.

[14]  B. Efron Estimating the Error Rate of a Prediction Rule: Improvement on Cross-Validation , 1983 .

[15]  Yihong Qiu,et al.  Breath sounds, asthma, and the mobile phone , 2001, The Lancet.

[16]  E. Gartman,et al.  New developments in the assessment of COPD: early diagnosis is key , 2014, International journal of chronic obstructive pulmonary disease.

[17]  Mark L. Everard,et al.  Breath Sounds , 2018, Springer International Publishing.

[18]  O. V. van Schayck,et al.  Early detection of chronic obstructive pulmonary disease (COPD): the role of spirometry as a diagnostic tool in primary care. , 2003, Primary care respiratory journal : journal of the General Practice Airways Group.

[19]  Masafumi Nishimura,et al.  Detecting breathing sounds in realistic Japanese telephone conversations and its application to automatic speech recognition , 2018, Speech Commun..

[20]  E. Mohamed,et al.  Voice changes in patients with chronic obstructive pulmonary disease , 2014 .

[21]  Jilong Kuang,et al.  Assessment of Chronic Pulmonary Disease Patients Using Biomarkers from Natural Speech Recorded by Mobile Devices , 2019, 2019 IEEE 16th International Conference on Wearable and Implantable Body Sensor Networks (BSN).

[22]  Eleni J. Sakka,et al.  Mobispiro: A Novel Spirometer , 2010 .

[23]  A. M. Emam,et al.  Is insufficient pulmonary air support the cause of dysphonia in chronic obstructive pulmonary disease? , 2018, Auris, nasus, larynx.

[24]  R. Lansing,et al.  Nature and evaluation of dyspnea in speaking and swallowing. , 2011, Seminars in speech and language.

[25]  G. Norman,et al.  Detection of COPD Exacerbations and Compliance With Patient-Reported Daily Symptom Diaries Using a Smartphone-Based Information System , 2013, Chest.

[26]  S. Pollart,et al.  Overview of changes to asthma guidelines: diagnosis and screening. , 2009, American family physician.

[27]  F. Hayden,et al.  Experimental rhinovirus challenges in adults with mild asthma: response to infection in relation to IgE. , 2003, The Journal of allergy and clinical immunology.

[28]  Eric C. Larson,et al.  Accurate and privacy preserving cough sensing using a low-cost microphone , 2011, UbiComp '11.

[29]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[30]  J. Wedzicha,et al.  Global Strategy for the Diagnosis, Management, and Prevention of Chronic Obstructive Lung Disease 2017 Report: GOLD Executive Summary. , 2017, Archivos de bronconeumologia.

[31]  Aixia Guo,et al.  Gene Selection for Cancer Classification using Support Vector Machines , 2014 .

[32]  E. T. Klemmer,et al.  Measurement of Time Spent Communicating , 1972 .

[33]  Marcus A. Badgeley,et al.  The Asthma Mobile Health Study, a large-scale clinical observational study using ResearchKit , 2017, Nature Biotechnology.

[34]  E. Ford,et al.  Total and state-specific medical and absenteeism costs of COPD among adults aged ≥ 18 years in the United States for 2010 and projections through 2020. , 2015, Chest.

[35]  Ashutosh Sabharwal,et al.  mobileSpiro: accurate mobile spirometry for self-management of asthma , 2011, mHealthSys '11.

[36]  Ajith Abraham,et al.  A Review of Class Imbalance Problem , 2014 .

[37]  R. Pauwels,et al.  Global strategy for the diagnosis, management, and prevention of chronic obstructive pulmonary disease. NHLBI/WHO Global Initiative for Chronic Obstructive Lung Disease (GOLD) Workshop summary. , 2001, American journal of respiratory and critical care medicine.

[38]  Eric C. Larson,et al.  SpiroCall: Measuring Lung Function over a Phone Call , 2016, CHI.

[39]  Javier Ramírez,et al.  Efficient voice activity detection algorithms using long-term speech information , 2004, Speech Commun..