COVID-19 Disease Progression Prediction via Audio Signals: A Longitudinal Study

Recent work has shown the potential of the use of audio data in screening for COVID-19. However, very little exploration has been done of monitoring disease progression, especially recovery in COVID-19 through audio. Tracking disease progression characteristics and patterns of recovery could lead to tremendous insights and more timely treatment or treatment adjustment, as well as better resources management in health care systems. The primary objective of this study is to explore the potential of longitudinal audio dynamics for COVID-19 monitoring using sequential deep learning techniques, focusing on prediction of disease progression and, especially, recovery trend prediction. We analysed crowdsourced respiratory audio data from 212 individuals over 5 days to 385 days, alongside their self-reported COVID-19 test results. We first explore the benefits of capturing longitudinal dynamics of audio biomarkers for COVID-19 detection. The strong performance, yielding an AUC-ROC of 0.79, sensitivity of 0.75 and specificity of 0.70, supports the effectiveness of the approach compared to methods that do not leverage longitudinal dynamics. We further examine the predicted disease progression trajectory, which displays high consistency with the longitudinal test results with a correlation of 0.76 in the test cohort, and 0.86 in a subset of the test cohort with 12 participants who report disease recovery. Our findings suggest that monitoring COVID-19 progression via longitudinal audio data has enormous potential in the tracking of individuals’ disease progression and recovery.

[1]  Muhammad Nabeel,et al.  AI4COVID-19: AI enabled preliminary diagnosis for COVID-19 from cough samples via an app , 2020, Informatics in Medicine Unlocked.

[2]  Bjorn W. Schuller,et al.  Audio, Speech, Language, & Signal Processing for COVID-19: A Comprehensive Overview , 2020, ArXiv.

[3]  Clinical and epidemiological characteristics of 1420 European patients with mild-to-moderate coronavirus disease 2019 , 2020 .

[4]  Aren Jansen,et al.  CNN architectures for large-scale audio classification , 2016, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[5]  A. Yetisen,et al.  Wearable devices for the detection of COVID-19 , 2021, Nature Electronics.

[6]  Eric Song,et al.  Analytical sensitivity and efficiency comparisons of SARS-CoV-2 RT–qPCR primer–probe sets , 2020, Nature Microbiology.

[7]  Rita Singh,et al.  Interpreting glottal flow dynamics for detecting COVID-19 from voice , 2020, ArXiv.

[8]  Brian Subirana,et al.  COVID-19 Artificial Intelligence Diagnosis Using Only Cough Recordings , 2020, IEEE Open Journal of Engineering in Medicine and Biology.

[9]  Björn Schuller,et al.  AI-Based human audio processing for COVID-19: A comprehensive overview , 2021, Pattern Recognition.

[10]  Thomas R. Niesler,et al.  A Comparative Study of Features for Acoustic Cough Detection Using Deep Architectures* , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[11]  Malik Peiris,et al.  Virology, transmission, and pathogenesis of SARS-CoV-2 , 2020, BMJ.

[12]  Cecilia Mascolo,et al.  Exploring Automatic COVID-19 Diagnosis via Voice and Symptoms from Crowdsourced Data , 2021, ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[13]  Lanjuan Li,et al.  Early antiviral treatment contributes to alleviate the severity and improve the prognosis of patients with novel coronavirus disease (COVID‐19) , 2020, Journal of internal medicine.

[14]  Shiyuan Liu,et al.  CT and COVID-19: Chinese experience and recommendations concerning detection, staging and follow-up , 2020, European Radiology.

[15]  Mehrin Kiani,et al.  A Generic Deep Learning Based Cough Analysis System From Clinically Validated Samples for Point-of-Need Covid-19 Test and Severity Levels , 2021, IEEE Transactions on Services Computing.

[16]  D. Gurwitz,et al.  Effects of age and sex on recovery from COVID-19: Analysis of 5769 Israeli patients , 2020, Journal of Infection.

[17]  Alice Baird,et al.  End-to-end convolutional neural network enables COVID-19 detection from breath and cough audio: a pilot study , 2021, BMJ Innovations.

[18]  Nan Wang,et al.  Quantitative Detection and Viral Load Analysis of SARS-CoV-2 in Infected Patients , 2020, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[19]  Cecilia Mascolo,et al.  Exploring Automatic Diagnosis of COVID-19 from Crowdsourced Respiratory Sound Data , 2020, KDD.

[20]  Yongsheng Wu,et al.  Epidemiology and transmission of COVID-19 in 391 cases and 1286 of their close contacts in Shenzhen, China: a retrospective cohort study , 2020, The Lancet Infectious Diseases.

[21]  Mandeep R. Mehra,et al.  COVID-19 illness in native and immunosuppressed states: A clinical–therapeutic staging proposal , 2020, The Journal of Heart and Lung Transplantation.

[22]  Gadi Pinkas,et al.  SARS-CoV-2 Detection From Voice , 2020, IEEE Open Journal of Engineering in Medicine and Biology.

[23]  Radim Burget,et al.  The Rise of Wearable Devices during the COVID-19 Pandemic: A Systematic Review , 2021, Sensors.

[24]  Rita Singh,et al.  Detection of Covid-19 Through the Analysis of Vocal Fold Oscillations , 2020, ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[25]  Yuxin Shi,et al.  Clinical progression of patients with COVID-19 in Shanghai, China , 2020, Journal of Infection.