A fully automatic deep learning system for COVID-19 diagnostic and prognostic analysis

Coronavirus disease 2019 (COVID-19) has spread globally, and medical resources become insufficient in many regions. Fast diagnosis of COVID-19 and finding high-risk patients with worse prognosis for early prevention and medical resource optimisation is important. Here, we proposed a fully automatic deep learning system for COVID-19 diagnostic and prognostic analysis by routinely used computed tomography. We retrospectively collected 5372 patients with computed tomography images from seven cities or provinces. Firstly, 4106 patients with computed tomography images were used to pre-train the deep learning system, making it learn lung features. Following this, 1266 patients (924 with COVID-19 (471 had follow-up for >5 days) and 342 with other pneumonia) from six cities or provinces were enrolled to train and externally validate the performance of the deep learning system. In the four external validation sets, the deep learning system achieved good performance in identifying COVID-19 from other pneumonia (AUC 0.87 and 0.88, respectively) and viral pneumonia (AUC 0.86). Moreover, the deep learning system succeeded to stratify patients into high- and low-risk groups whose hospital-stay time had significant difference (p=0.013 and p=0.014, respectively). Without human assistance, the deep learning system automatically focused on abnormal areas that showed consistent characteristics with reported radiological findings. Deep learning provides a convenient tool for fast screening of COVID-19 and identifying potential high-risk patients, which may be helpful for medical resource optimisation and early prevention before patients show severe symptoms. A fully automatic deep learning system provides a convenient method for COVID-19 diagnostic and prognostic analysis, which can help COVID-19 screening and finding potential high-risk patients with worse prognosis https://bit.ly/3bRaxGw

[1]  Yuedong Yang,et al.  Deep Learning Enables Accurate Diagnosis of Novel Coronavirus (COVID-19) With CT Images , 2021, Ieee/Acm Transactions on Computational Biology and Bioinformatics.

[2]  Jianming Wang,et al.  AI-assisted CT imaging analysis for COVID-19 screening: Building and deploying a medical AI system , 2020, Applied Soft Computing.

[3]  Shuangzhi Lv,et al.  RETRACTED ARTICLE: Deep learning system to screen coronavirus disease 2019 pneumonia , 2020, Applied Intelligence.

[4]  Birajara Soares Machado,et al.  Regarding "Artificial Intelligence Distinguishes COVID-19 from Community Acquired Pneumonia on Chest CT" , 2020, Radiology.

[5]  Jie Zhou,et al.  Development and Evaluation of an AI System for COVID-19 , 2020, medRxiv.

[6]  K. Cao,et al.  Artificial Intelligence Distinguishes COVID-19 from Community Acquired Pneumonia on Chest CT , 2020, Radiology.

[7]  Wenyu Liu,et al.  Deep Learning-based Detection for COVID-19 from Chest CT using Weak Label , 2020, medRxiv.

[8]  Guo‐Jun Zhang,et al.  The clinical dynamics of 18 cases of COVID-19 outside of Wuhan, China , 2020, European Respiratory Journal.

[9]  Huaiqiang Sun,et al.  High-resolution computed tomography features of 17 cases of coronavirus disease 2019 in Sichuan province, China , 2020, European Respiratory Journal.

[10]  Q. Tao,et al.  Correlation of Chest CT and RT-PCR Testing in Coronavirus Disease 2019 (COVID-19) in China: A Report of 1014 Cases , 2020, Radiology.

[11]  Yuedong Yang,et al.  Deep Learning Enables Accurate Diagnosis of Novel Coronavirus (COVID-19) With CT Images , 2020, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[12]  S. Humphries,et al.  Imaging research in fibrotic lung disease; applying deep learning to unsolved problems. , 2020, The Lancet. Respiratory medicine.

[13]  Yunpeng Ji,et al.  Potential association between COVID-19 mortality and health-care resource availability , 2020, The Lancet Global Health.

[14]  Heshui Shi,et al.  Radiological findings from 81 patients with COVID-19 pneumonia in Wuhan, China: a descriptive study , 2020, The Lancet Infectious Diseases.

[15]  P. Khong,et al.  COVID-19 pneumonia: what has CT taught us? , 2020, The Lancet Infectious Diseases.

[16]  Ting Yu,et al.  Clinical course and outcomes of critically ill patients with SARS-CoV-2 pneumonia in Wuhan, China: a single-centered, retrospective, observational study , 2020, The Lancet Respiratory Medicine.

[17]  Kaijin Xu,et al.  A Deep Learning System to Screen Novel Coronavirus Disease 2019 Pneumonia , 2020, Engineering.

[18]  Bo Xu,et al.  A deep learning algorithm using CT images to screen for Corona virus disease (COVID-19) , 2020, European Radiology.

[19]  Jun Liu,et al.  Chest CT for Typical 2019-nCoV Pneumonia: Relationship to Negative RT-PCR Testing , 2020, Radiology.

[20]  Yan Zhao,et al.  Clinical Characteristics of 138 Hospitalized Patients With 2019 Novel Coronavirus-Infected Pneumonia in Wuhan, China. , 2020, JAMA.

[21]  Jing Zhao,et al.  Early Transmission Dynamics in Wuhan, China, of Novel Coronavirus–Infected Pneumonia , 2020, The New England journal of medicine.

[22]  Anand Shah,et al.  Unravelling machine learning: insights in respiratory medicine , 2019, European Respiratory Journal.

[23]  Zhenyu Liu,et al.  Deep learning provides a new computed tomography-based prognostic biomarker for recurrence prediction in high-grade serous ovarian cancer. , 2019, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[24]  D. Dong,et al.  Predicting EGFR mutation status in lung adenocarcinoma on computed tomography image using deep learning , 2019, European Respiratory Journal.

[25]  S. Walsh,et al.  Deep learning for classifying fibrotic lung disease on high-resolution computed tomography: a case-cohort study. , 2018, The Lancet. Respiratory medicine.

[26]  Zhenyu Liu,et al.  Central focused convolutional neural networks: Developing a data-driven model for lung nodule segmentation , 2017, Medical Image Anal..

[27]  Serge J. Belongie,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Christian Szegedy,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[30]  Valery Naranjo,et al.  Comparing algorithms for automated vessel segmentation in computed tomography scans of the lung: the VESSEL12 study , 2014, Medical Image Anal..

[31]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[32]  M. Aslan,et al.  Correlation of chest CT and RT-PCR testing in coronavirus disease 2019 (COVID-19) in Turkey , 2021, Annals of Clinical and Analytical Medicine.

[33]  Ramprasaath R. Selvaraju,et al.  Grad-CAM: Why did you say that? Visual Explanations from Deep Networks via Gradient-based Localization , 2016 .