COVID-19 mortality risk assessment: An international multi-center study

Background: Timely identification of COVID-19 patients at high risk of mortality can significantly improve patient management and resource allocation within hospitals. This study seeks to develop and validate a data-driven personalized mortality risk calculator for hospitalized COVID-19 patients. Methods: De-identified data was obtained for 3,927 COVID-19 positive patients from six independent centers, comprising 33 different hospitals. Demographic, clinical, and laboratory variables were collected at hospital admission. The COVID-19 Mortality Risk (CMR) tool was developed using the XGBoost algorithm to predict mortality. Its discrimination performance was subsequently evaluated on three validation cohorts. Findings: The derivation cohort of 3,062 patients has an observed mortality rate of 26.84%. Increased age, decreased oxygen saturation ([≤] 93%), elevated levels of C-reactive protein ([≥] 130 mg/L), blood urea nitrogen ([≥] 18 mg/dL), and blood creatinine ([≥] 1.2 mg/dL) were identified as primary risk factors, validating clinical findings. The model obtains out-of-sample AUCs of 0.90 (95% CI, 0.87-0.94) on the derivation cohort. In the validation cohorts, the model obtains AUCs of 0.92 (95% CI, 0.88-0.95) on Seville patients, 0.87 (95% CI, 0.84-0.91) on Hellenic COVID-19 Study Group patients, and 0.81 (95% CI, 0.76-0.85) on Hartford Hospital patients. The CMR tool is available as an online application at covidanalytics.io/mortality_calculator and is currently in clinical use. Interpretation: The CMR model leverages machine learning to generate accurate mortality predictions using commonly available clinical features. This is the first risk score trained and validated on a cohort of COVID-19 patients from Europe and the United States.

[1]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[2]  Xiang Li,et al.  On the origin and continuing evolution of SARS-CoV-2 , 2020, National science review.

[3]  Mohammad Pourhomayoun,et al.  Predicting Mortality Risk in Patients with COVID-19 Using Artificial Intelligence to Help Medical Decision-Making , 2020, medRxiv.

[4]  Robert Brown,et al.  Silent hypoxia: A harbinger of clinical deterioration in patients with COVID-19 , 2020, The American Journal of Emergency Medicine.

[5]  Yuyi Wang,et al.  Unique epidemiological and clinical features of the emerging 2019 novel coronavirus pneumonia (COVID‐19) implicate special control measures , 2020, Journal of medical virology.

[6]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[7]  Fang Wu,et al.  C-Reactive Protein Level May Predict the Risk of COVID-19 Aggravation , 2020, Open forum infectious diseases.

[8]  Limin Ou,et al.  Development and Validation of a Clinical Risk Score to Predict the Occurrence of Critical Illness in Hospitalized Patients With COVID-19. , 2020, JAMA internal medicine.

[9]  Scott Lundberg,et al.  A Unified Approach to Interpreting Model Predictions , 2017, NIPS.

[10]  Qiurong Ruan,et al.  Clinical predictors of mortality due to COVID-19 based on an analysis of data of 150 patients from Wuhan, China , 2020, Intensive Care Medicine.

[11]  D. Brodie,et al.  Epidemiology, clinical course, and outcomes of critically ill adults with COVID-19 in New York City: a prospective cohort study , 2020, medRxiv.

[12]  Mario Plebani,et al.  Thrombocytopenia is associated with severe coronavirus disease 2019 (COVID-19) infections: A meta-analysis , 2020, Clinica Chimica Acta.

[13]  Takuya Akiba,et al.  Optuna: A Next-generation Hyperparameter Optimization Framework , 2019, KDD.

[14]  Tilak D. Raj Basic Metabolic Panel I , 2017 .

[15]  Jiang Xie,et al.  Association Between Hypoxemia and Mortality in Patients With COVID-19 , 2020, Mayo Clinic Proceedings.

[16]  Lei Dong,et al.  Kidney disease is associated with in-hospital death of patients with COVID-19 , 2020, Kidney International.

[17]  Hugh Chen,et al.  From local explanations to global understanding with explainable AI for trees , 2020, Nature Machine Intelligence.

[18]  W. Liang,et al.  Risk Factors of Fatal Outcome in Hospitalized Subjects With Coronavirus Disease 2019 From a Nationwide Analysis in China , 2020, Chest.

[19]  J. Xiang,et al.  Clinical course and risk factors for mortality of adult inpatients with COVID-19 in Wuhan, China: a retrospective cohort study , 2020, The Lancet.

[20]  Kyung Soo Lim,et al.  Role of procalcitonin and C‐reactive protein in differentiation of mixed bacterial infection from 2009 H1N1 viral pneumonia , 2011, Influenza and other respiratory viruses.

[21]  A. Lacoma,et al.  Correlation of inflammatory and cardiovascular biomarkers with pneumonia severity scores. , 2014, Enfermedades infecciosas y microbiologia clinica.

[22]  S. Szefler,et al.  COVID-19 and the impact of social determinants of health , 2020, The Lancet Respiratory Medicine.

[23]  Tony Kirby,et al.  Evidence mounts on the disproportionate effect of COVID-19 on ethnic minorities , 2020, The Lancet Respiratory Medicine.

[24]  L. Mombaerts,et al.  An interpretable mortality prediction model for COVID-19 patients , 2020, Nature Machine Intelligence.

[25]  P. Munroe,et al.  Artificial intelligence and machine learning to fight COVID-19 , 2020, Physiological genomics.

[26]  S. Corrao,et al.  Performance of PSI, CURB-65, and SCAP scores in predicting the outcome of patients with community-acquired and healthcare-associated pneumonia , 2011, Internal and emergency medicine.

[27]  E. Dong,et al.  An interactive web-based dashboard to track COVID-19 in real time , 2020, The Lancet Infectious Diseases.

[28]  W. Lim,et al.  Defining community acquired pneumonia severity on presentation to hospital: an international derivation and validation study , 2003, Thorax.

[29]  K. Yuen,et al.  Clinical Characteristics of Coronavirus Disease 2019 in China , 2020, The New England journal of medicine.

[30]  Russ B. Altman,et al.  Missing value estimation methods for DNA microarrays , 2001, Bioinform..