Holistic AI-Driven Quantification, Staging and Prognosis of COVID-19 Pneumonia

Improving screening, discovering therapies, developing a vaccine and performing staging and prognosis are decisive steps in addressing the COVID-19 pandemic. Staging and prognosis are especially crucial for organizational anticipation (intensive-care bed availability, patient management planning) and accelerating drug development; through rapid, reproducible and quantified response-to-treatment assessment. In this letter, we report on an artificial intelligence solution for performing automatic staging and prognosis based on imaging, clinical, comorbidities and biological data. This approach relies on automatic computed tomography (CT)-based disease quantification using deep learning, robust data-driven identification of physiologically-inspired COVID-19 holistic patient profiling, and strong, reproducible staging/outcome prediction with good generalization properties using an ensemble of consensus methods. Highly promising results on multiple independent external evaluation cohorts along with comparisons with expert human readers demonstrate the potentials of our approach. The developed solution offers perspectives for optimal patient management, given the shortage of intensive care beds and ventilators1, 2, along with means to assess patient response to treatment.

[1]  Wen Yin,et al.  Association of radiologic findings with mortality of patients infected with 2019 novel coronavirus in Wuhan, China , 2020, medRxiv.

[2]  Robert D Truog,et al.  The Toughest Triage - Allocating Ventilators in a Pandemic. , 2020, The New England journal of medicine.

[3]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[4]  K. Cao,et al.  Artificial Intelligence Distinguishes COVID-19 from Community Acquired Pneumonia on Chest CT , 2020, Radiology.

[5]  L. R. Dice.  Measures of the Amount of Ecologic Association Between Species , 1945 .

[6]  A. Wong,et al.  COVID-Net: a tailored deep convolutional neural network design for detection of COVID-19 cases from chest X-ray images , 2020, Scientific Reports.

[7]  Xutao Li,et al.  A Deep Learning Approach to Nightfire Detection based on Low-Light Satellite , 2021, Computer Science & Information Technology (CS & IT).

[8]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[9]  Dengju Li,et al.  Abnormal coagulation parameters are associated with poor prognosis in patients with novel coronavirus pneumonia , 2020, Journal of Thrombosis and Haemostasis.

[10]  G. Corrado,et al.  End-to-end lung cancer screening with three-dimensional deep learning on low-dose chest computed tomography , 2019, Nature Medicine.

[11]  Z. Fayad,et al.  Artificial intelligence–enabled rapid diagnosis of patients with COVID-19 , 2020, Nature Medicine.

[12]  Laura M. Heiser,et al.  How Machine Learning Will Transform Biomedicine , 2020, Cell.

[13]  Nikos Paragios,et al.  Deformable Registration Through Learning of Context-Specific Metric Aggregation , 2017, MLMI@MICCAI.

[14]  T. Egglin,et al.  Performance of radiologists in differentiating COVID-19 from viral pneumonia on chest CT , 2020, Radiology.

[15]  R. Lu,et al.  Detection of SARS-CoV-2 in Different Types of Clinical Specimens. , 2020, JAMA.

[16]  Indra Joshi,et al.  Emergence of New Disease: How Can Artificial Intelligence Help? , 2020, Trends in Molecular Medicine.

[17]  Jun Liu,et al.  Chest CT for Typical 2019-nCoV Pneumonia: Relationship to Negative RT-PCR Testing , 2020, Radiology.

[18]  Q. Tao,et al.  Correlation of Chest CT and RT-PCR Testing in Coronavirus Disease 2019 (COVID-19) in China: A Report of 1014 Cases , 2020, Radiology.

[19]  Edwin J R van Beek,et al.  Idiopathic Pulmonary Fibrosis: Data-driven Textural Analysis of Extent of Fibrosis at Baseline and 15-Month Follow-up. , 2017, Radiology.

[20]  Thomas J. Re,et al.  Quantification of Tomographic Patterns associated with COVID-19 from Chest CT , 2020, ArXiv.

[21]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[22]  Alexander Wong,et al.  COVID-Net: A Tailored Deep Convolutional Neural Network Design for Detection of COVID-19 Cases from Chest Radiography Images , 2020, ArXiv.

[23]  Z. Fayad,et al.  Chest CT Findings in Coronavirus Disease-19 (COVID-19): Relationship to Duration of Infection , 2020, Radiology.

[24]  J. Xiang,et al.  Clinical course and risk factors for mortality of adult inpatients with COVID-19 in Wuhan, China: a retrospective cohort study , 2020, The Lancet.

[25]  Gurjit S. Randhawa,et al.  Machine learning using intrinsic genomic signatures for rapid classification of novel pathogens: COVID-19 case study , 2020, PloS one.

[26]  Q. Tao,et al.  Serial Quantitative Chest CT Assessment of COVID-19: A Deep Learning Approach , 2020, Radiology. Cardiothoracic imaging.

[27]  Long Jiang Zhang,et al.  Coronavirus Disease 2019 (COVID-19): A Perspective from China , 2020, Radiology.

[28]  Kunwei Li,et al.  CT image visual quantitative evaluation and clinical classification of coronavirus disease (COVID-19) , 2020, European Radiology.

[29]  Heng Fan,et al.  Diabetes is a risk factor for the progression and prognosis of COVID‐19 , 2020, Diabetes/metabolism research and reviews.

[30]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Lawrence Carin,et al.  Digital technology and COVID-19 , 2020, Nature Medicine.

[32]  D. Hansell,et al.  Mortality prediction in idiopathic pulmonary fibrosis: evaluation of computer-based CT analysis with conventional severity measures , 2017, European Respiratory Journal.

[33]  Andriy Fedorov,et al.  Computational Radiomics System to Decode the Radiographic Phenotype. , 2017, Cancer research.

[34]  G. Onder,et al.  Case-Fatality Rate and Characteristics of Patients Dying in Relation to COVID-19 in Italy. , 2020, JAMA.

[35]  Norbert Stefan,et al.  Obesity and impaired metabolic health in patients with COVID-19 , 2020, Nature Reviews Endocrinology.

[36]  Rudy M. Baum,et al.  Perspective on China , 2005 .

[37]  Dennis Andersson,et al.  A retrospective cohort study , 2018 .

[38]  Theodora Psaltopoulou,et al.  Hematological findings and complications of COVID‐19 , 2020, American journal of hematology.

[39]  Mike Preuss,et al.  Planning chemical syntheses with deep neural networks and symbolic AI , 2017, Nature.

[40]  Joel Nothman,et al.  SciPy 1.0-Fundamental Algorithms for Scientific Computing in Python , 2019, ArXiv.

[41]  B. Lo,et al.  A Framework for Rationing Ventilators and Critical Care Beds During the COVID-19 Pandemic. , 2020, JAMA.

[42]  Christopher. Simons,et al.  Machine learning with Python , 2017 .

[43]  Gurjit S. Randhawa,et al.  Machine learning using intrinsic genomic signatures for rapid classification of novel pathogens: COVID-19 case study , 2020, bioRxiv.

[44]  Yicheng Fang,et al.  Sensitivity of Chest CT for COVID-19: Comparison to RT-PCR , 2020, Radiology.

[45]  N. Paragios,et al.  Artificial intelligence applications for thoracic imaging. , 2019, European journal of radiology.

[46]  N. Paragios,et al.  A radiomics approach to assess tumour-infiltrating CD8 cells and response to anti-PD-1 or anti-PD-L1 immunotherapy: an imaging biomarker, retrospective multicohort study. , 2018, The Lancet. Oncology.

[47]  G. Gao,et al.  A Novel Coronavirus from Patients with Pneumonia in China, 2019 , 2020, The New England journal of medicine.

[48]  K. Cao,et al.  Using Artificial Intelligence to Detect COVID-19 and Community-acquired Pneumonia Based on Pulmonary CT: Evaluation of the Diagnostic Accuracy , 2020 .