Individualized prediction of COVID-19 adverse outcomes with MLHO

The COVID-19 pandemic has devastated the world with health and economic wreckage. Precise estimates of adverse outcomes from COVID-19 could have led to better allocation of healthcare resources and more efficient targeted preventive measures, including insight into prioritizing how to best distribute a vaccination. We developed MLHO (pronounced as melo), an end-to-end Machine Learning framework that leverages iterative feature and algorithm selection to predict Health Outcomes. MLHO implements iterative sequential representation mining, and feature and model selection, for predicting patient-level risk of hospitalization, ICU admission, need for mechanical ventilation, and death. It bases this prediction on data from patients’ past medical records (before their COVID-19 infection). MLHO’s architecture enables a parallel and outcome-oriented model calibration, in which different statistical learning algorithms and vectors of features are simultaneously tested to improve prediction of health outcomes. Using clinical and demographic data from a large cohort of over 13,000 COVID-19-positive patients, we modeled the four adverse outcomes utilizing about 600 features representing patients’ pre-COVID health records and demographics. The mean AUC ROC for mortality prediction was 0.91, while the prediction performance ranged between 0.80 and 0.81 for the ICU, hospitalization, and ventilation. We broadly describe the clusters of features that were utilized in modeling and their relative influence for predicting each outcome. Our results demonstrated that while demographic variables (namely age) are important predictors of adverse outcomes after a COVID-19 infection, the incorporation of the past clinical records are vital for a reliable prediction model. As the COVID-19 pandemic unfolds around the world, adaptable and interpretable machine learning frameworks (like MLHO) are crucial to improve our readiness for confronting the potential future waves of COVID-19, as well as other novel infectious diseases that may emerge.

[1]  J. Friedman Greedy function approximation: A gradient boosting machine. , 2001 .

[2]  Myrna M. Khan,et al.  A retrospective cohort study: 10-year trend of disease-modifying antirheumatic drugs and biological agents use in patients with rheumatoid arthritis at Veteran Affairs Medical Centers , 2013, BMJ Open.

[3]  Ran Gilad-Bachrach,et al.  DART: Dropouts meet Multiple Additive Regression Trees , 2015, AISTATS.

[4]  Richard D Riley,et al.  Prediction models for diagnosis and prognosis of covid-19 infection: systematic review and critical appraisal , 2020 .

[5]  J. Friedman Stochastic gradient boosting , 2002 .

[6]  J. Xiang,et al.  Clinical course and risk factors for mortality of adult inpatients with COVID-19 in Wuhan, China: a retrospective cohort study , 2020, The Lancet.

[7]  Ullrich Köthe,et al.  On Oblique Random Forests , 2011, ECML/PKDD.

[8]  Shawn N. Murphy,et al.  Transitive Sequential Pattern Mining for Discrete Clinical Data , 2020, AIME.

[9]  Ruchong Chen,et al.  Cancer patients in SARS-CoV-2 infection: a nationwide analysis in China , 2020, The Lancet Oncology.

[10]  Development and External Validation of a Prognostic Multivariable Model on Admission for Hospitalized Patients with COVID-19 , 2020 .

[11]  Dennis Andersson,et al.  A retrospective cohort study , 2018 .

[12]  V. Preedy,et al.  Prospective Cohort Study , 2010 .

[13]  Xilong Deng,et al.  Prognostic Factors for COVID-19 Pneumonia Progression to Severe Symptoms Based on Earlier Clinical Features: A Retrospective Analysis , 2020, Frontiers in Medicine.

[14]  Trevor Hastie,et al.  Regularization Paths for Generalized Linear Models via Coordinate Descent. , 2010, Journal of statistical software.

[15]  G. Heinze,et al.  Prediction models for diagnosis and prognosis of covid-19: systematic review and critical appraisal , 2020, BMJ.

[16]  Stella K Kang,et al.  Clinical decision support tool and rapid point-of-care platform for determining disease severity in patients with COVID-19. , 2020, Lab on a chip.

[17]  Xian-gao Jiang,et al.  Towards an Artificial Intelligence Framework for Data-Driven Prediction of Coronavirus Clinical Severity , 2020 .

[18]  K. Bhaskaran,et al.  Factors associated with COVID-19-related death using OpenSAFELY , 2020, Nature.

[19]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[20]  Anna Stachel,et al.  Obesity in patients younger than 60 years is a risk factor for Covid-19 hospital admission , 2020, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[21]  Leora I. Horwitz,et al.  Factors associated with hospital admission and critical illness among 5279 people with coronavirus disease 2019 in New York City: prospective cohort study , 2020, BMJ.

[22]  H. Chipman,et al.  BART: Bayesian Additive Regression Trees , 2008, 0806.3286.

[23]  Partha Chakrabarti,et al.  A Machine Learning Model Reveals Older Age and Delayed Hospitalization as Predictors of Mortality in Patients with COVID-19 , 2020, medRxiv.

[24]  K. Bhaskaran,et al.  OpenSAFELY: factors associated with COVID-19 death in 17 million patients , 2020, Nature.

[25]  Claude E. Shannon,et al.  Recent Contributions to The Mathematical Theory of Communication , 2009 .

[26]  Zunyou Wu,et al.  Characteristics of and Important Lessons From the Coronavirus Disease 2019 (COVID-19) Outbreak in China: Summary of a Report of 72 314 Cases From the Chinese Center for Disease Control and Prevention. , 2020, JAMA.

[27]  Jian-feng Xie,et al.  Development and external validation of a prognostic multivariable model on admission for hospitalized patients with COVID-19 , 2020, medRxiv.

[28]  Kavishwar B. Wagholikar,et al.  Transitive Sequencing Medical Records for Mining Predictive and Interpretable Temporal Representations , 2020, Patterns.

[29]  Emily N. Ussery,et al.  Preliminary Estimates of the Prevalence of Selected Underlying Health Conditions Among Patients with Coronavirus Disease 2019 — United States, February 12–March 28, 2020 , 2020, MMWR. Morbidity and mortality weekly report.

[30]  Roberto Battiti,et al.  Using mutual information for selecting features in supervised neural net learning , 1994, IEEE Trans. Neural Networks.

[31]  H. Chipman,et al.  Bayesian Additive Regression Trees , 2006 .

[32]  Adam Kapelner,et al.  bartMachine: Machine Learning with Bayesian Additive Regression Trees , 2013, 1312.2171.

[33]  Jerome H Friedman,et al.  Multiple additive regression trees with application in epidemiology , 2003, Statistics in medicine.

[34]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[35]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[36]  Centers for Disease Control and Prevention CDC COVID-19 Response Team Severe Outcomes Among Patients with Coronavirus Disease 2019 (COVID-19) — United States, February 12–March 16, 2020 , 2020, MMWR. Morbidity and mortality weekly report.

[37]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[38]  Trevor Hastie,et al.  A Blockwise Descent Algorithm for Group-penalized Multiresponse and Multinomial Regression , 2013, 1311.6529.

[39]  V Kishore Ayyadevara,et al.  Gradient Boosting Machine , 2018 .