The National COVID Cohort Collaborative: Clinical Characterization and Early Severity Prediction

Background: The majority of U.S. reports of COVID-19 clinical characteristics, disease course, and treatments are from single health systems or focused on one domain. Here we report the creation of the National COVID Cohort Collaborative (N3C), a centralized, harmonized, high-granularity electronic health record repository that is the largest, most representative U.S. cohort of COVID-19 cases and controls to date. This multi-center dataset supports robust evidence-based development of predictive and diagnostic tools and informs critical care and policy. Methods and Findings: In a retrospective cohort study of 1,926,526 patients from 34 medical centers nationwide, we stratified patients using a World Health Organization COVID-19 severity scale and demographics; we then evaluated differences between groups over time using multivariable logistic regression. We established vital signs and laboratory values among COVID-19 patients with different severities, providing the foundation for predictive analytics. The cohort included 174,568 adults with severe acute respiratory syndrome associated with SARS-CoV-2 (PCR >99% or antigen <1%) as well as 1,133,848 adult patients that served as lab-negative controls. Among 32,472 hospitalized patients, mortality was 11.6% overall and decreased from 16.4% in March/April 2020 to 8.6% in September/October 2020 (p = 0.002 monthly trend). In a multivariable logistic regression model, age, male sex, liver disease, dementia, African-American and Asian race, and obesity were independently associated with higher clinical severity. To demonstrate the utility of the N3C cohort for analytics, we used machine learning to predict clinical severity and risk factors over time. Using 64 inputs available on the first hospital day, we predicted a severe clinical course (death, discharge to hospice, invasive ventilation, or extracorporeal membrane oxygenation) using random forest and XGBoost models (AUROC 0.86 and 0.87 respectively) that were stable over time. The most powerful predictors in these models are patient age and widely available vital sign and laboratory values. The established expected trajectories for many vital signs and laboratory values among patients with different clinical severities validates observations from smaller studies, and provides comprehensive insight into COVID-19 characterization in U.S. patients. Conclusions: This is the first description of an ongoing longitudinal observational study of patients seen in diverse clinical settings and geographical regions and is the largest COVID-19 cohort in the United States. Such data are the foundation for machine learning (ML) models that can be the basis for generalizable clinical decision support tools. The N3C Data Enclave is unique in providing transparent, reproducible, easily shared, versioned, and fully auditable data and analytic provenance for national-scale patient-level EHR data. The N3C is built for intensive ML analyses by academic, industry, and citizen scientists internationally. Many observational correlations can inform trial designs and care guidelines for this new disease.

[1]  Laura Taylor FedRAMP: History and Future Direction , 2014, IEEE Cloud Computing.

[2]  Kohske Takahashi,et al.  Create Elegant Data Visualisations Using the Grammar of Graphics [R package ggplot2 version 3.3.2] , 2020 .

[3]  C. Torp‐Pedersen,et al.  Association between statin use and outcomes in patients with coronavirus disease 2019 (COVID-19): a nationwide cohort study , 2020, BMJ Open.

[4]  J. Skarbinski,et al.  Obesity and Mortality Among Patients Diagnosed With COVID-19: Results From an Integrated Health Care Organization , 2020, Annals of Internal Medicine.

[5]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[6]  Brian D. Ripley,et al.  The R Project in Statistical Computing , 2001 .

[7]  Amit N. Patel,et al.  Cardiovascular Disease, Drug Therapy, and Mortality in Covid-19 , 2020, The New England journal of medicine.

[8]  Kristen M J Azar,et al.  Disparities In Outcomes Among COVID-19 Patients In A Large Health Care System In California. , 2020, Health affairs.

[9]  Mike Clarke,et al.  A minimal common outcome measure set for COVID-19 clinical research , 2020, The Lancet Infectious Diseases.

[10]  Anand Srivastava,et al.  Factors Associated With Death in Critically Ill Patients With Coronavirus Disease 2019 in the US. , 2020, JAMA internal medicine.

[11]  Jason Brunson,et al.  ggalluvial: Layered Grammar for Alluvial Plots , 2020, J. Open Source Softw..

[12]  M. Jarrett,et al.  Clinical Mortality in a Large COVID-19 Cohort: Observational Study , 2020, Journal of medical Internet research.

[13]  John D. Hunter,et al.  Matplotlib: A 2D Graphics Environment , 2007, Computing in Science & Engineering.

[14]  Hao Li,et al.  The Impact of Dementia on the Clinical Outcome of COVID-19: A Systematic Review and Meta-Analysis. , 2020, Journal of Alzheimer's disease : JAD.

[15]  Michele C. Clark,et al.  The University of Texas Medical Branch at Galveston , 1997 .

[16]  N. Tatonetti,et al.  Associations between blood type and COVID-19 infection, intubation, and death , 2020, Nature Communications.

[17]  A. Harries,et al.  Faculty Opinions recommendation of Presenting Characteristics, Comorbidities, and Outcomes Among 5700 Patients Hospitalized With COVID-19 in the New York City Area. , 2020 .

[18]  S. Vollmer,et al.  Improving Survival of Critical Care Patients With Coronavirus Disease 2019 in England: A National Cohort Study, March to June 2020* , 2020, Critical care medicine.

[19]  Christopher M. Horvat,et al.  Effect of Hydrocortisone on Mortality and Organ Support in Patients With Severe COVID-19: The REMAP-CAP COVID-19 Corticosteroid Domain Randomized Clinical Trial. , 2020, JAMA.

[20]  F. Crea,et al.  COVID-19 and the cardiovascular system: implications for risk assessment, diagnosis, and treatment options , 2020, Cardiovascular research.

[21]  Nathaniel Hupert,et al.  Clinical Characteristics of Covid-19 in New York City , 2020, The New England journal of medicine.

[22]  Jeffrey G. Klann,et al.  International electronic health record-derived COVID-19 clinical course profiles: the 4CE consortium , 2020, npj Digital Medicine.

[23]  M E Matheny,et al.  Creating a Common Data Model for Comparative Effectiveness with the Observational Medical Outcomes Partnership , 2015, Applied Clinical Informatics.

[24]  P. Machado,et al.  Rheumatic disease and COVID-19: epidemiology and outcomes , 2020, Nature Reviews Rheumatology.

[25]  X. Qi,et al.  High mortality rates for SARS-CoV-2 infection in patients with pre-existing chronic liver disease and cirrhosis: Preliminary results from an international registry , 2020, Journal of Hepatology.

[26]  Richard Platt,et al.  Launching PCORnet, a national patient-centered clinical research network , 2014, Journal of the American Medical Informatics Association : JAMIA.

[27]  S. Zeger,et al.  Patient Trajectories Among Persons Hospitalized for COVID-19 , 2020, Annals of Internal Medicine.

[28]  Xiang Chen,et al.  Clinical determinants for fatality of 44,672 patients with COVID-19 , 2020, Critical Care.

[29]  Brett K. Beaulieu-Jones,et al.  International electronic health record-derived COVID-19 clinical course profiles: the 4CE consortium , 2020, npj Digital Medicine.

[30]  Leora I. Horwitz,et al.  Trends in Covid-19 risk-adjusted mortality rates in a single health system , 2020, medRxiv.

[31]  Philip R. O. Payne,et al.  The National COVID Cohort Collaborative (N3C): Rationale, design, infrastructure, and deployment , 2020, J. Am. Medical Informatics Assoc..

[32]  Umit Topaloglu,et al.  Using a Federated Network of Real-World Data to Optimize Clinical Trials Operations. , 2018, JCO clinical cancer informatics.

[33]  K. Bhaskaran,et al.  Factors associated with COVID-19-related death using OpenSAFELY , 2020, Nature.

[34]  David J Murphy,et al.  ICU and Ventilator Mortality Among Critically Ill Adults With Coronavirus Disease 2019 , 2020, Critical care medicine.

[35]  Amit N. Patel,et al.  Retraction—Hydroxychloroquine or chloroquine with or without a macrolide for treatment of COVID-19: a multinational registry analysis , 2020, The Lancet.

[36]  M. Woodward,et al.  Obesity as a risk factor for COVID‐19 mortality in women and men in the UK biobank: Comparisons with influenza/pneumonia and coronary heart disease , 2020, Diabetes, obesity & metabolism.

[37]  S. Fletcher,et al.  Welcome to Python , 2012 .

[38]  Shyam Visweswaran,et al.  Accrual to Clinical Trials (ACT): A Clinical and Translational Science Award Consortium Network , 2018, JAMIA open.

[39]  Bing Li,et al.  Updating and validating the Charlson comorbidity index and score for risk adjustment in hospital discharge abstracts using data from 6 countries. , 2011, American journal of epidemiology.

[40]  Yu-Chuan Li,et al.  Observational Health Data Sciences and Informatics (OHDSI): Opportunities for Observational Researchers , 2015, MedInfo.

[41]  Rae Woong Park,et al.  Characterizing treatment pathways at scale using the OHDSI network , 2016, Proceedings of the National Academy of Sciences.

[42]  Chunrui Li,et al.  Risk factors for developing into critical COVID-19 patients in Wuhan, China: A multicenter, retrospective, cohort study , 2020, EClinicalMedicine.

[43]  Eun Ji Kim,et al.  Presenting Characteristics, Comorbidities, and Outcomes Among 5700 Patients Hospitalized With COVID-19 in the New York City Area. , 2020, JAMA.

[44]  Reynold Xin,et al.  SparkR: Scaling R Programs with Spark , 2016, SIGMOD Conference.

[45]  M. Eagleton,et al.  Blood type and outcomes in patients with COVID-19 , 2020, Annals of Hematology.

[46]  E. Price-Haywood,et al.  Hospitalization and Mortality among Black Patients and White Patients with Covid-19 , 2020, The New England journal of medicine.

[47]  D. Chubin A Declaration of Interests , 1986 .

[48]  C. Pipper,et al.  [''R"--project for statistical computing]. , 2008, Ugeskrift for laeger.

[49]  Jennifer L. Bell,et al.  Effect of Dexamethasone in Hospitalized Patients with COVID-19: Preliminary Report , 2020, medRxiv.