Detection and Severity Classification of COVID-19 in CT Images Using Deep Learning

Detecting COVID-19 at an early stage is essential to reduce the mortality risk of the patients. In this study, a cascaded system is proposed to segment the lung, detect, localize, and quantify COVID-19 infections from computed tomography images. An extensive set of experiments were performed using Encoder–Decoder Convolutional Neural Networks (ED-CNNs), UNet, and Feature Pyramid Network (FPN), with different backbone (encoder) structures using the variants of DenseNet and ResNet. The conducted experiments for lung region segmentation showed a Dice Similarity Coefficient (DSC) of 97.19% and Intersection over Union (IoU) of 95.10% using U-Net model with the DenseNet 161 encoder. Furthermore, the proposed system achieved an elegant performance for COVID-19 infection segmentation with a DSC of 94.13% and IoU of 91.85% using the FPN with DenseNet201 encoder. The proposed system can reliably localize infections of various shapes and sizes, especially small infection regions, which are rarely considered in recent studies. Moreover, the proposed system achieved high COVID-19 detection performance with 99.64% sensitivity and 98.72% specificity. Finally, the system was able to discriminate between different severity levels of COVID-19 infection over a dataset of 1110 subjects with sensitivity values of 98.3%, 71.2%, 77.8%, and 100% for mild, moderate, severe, and critical, respectively.

[1]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Dan Yang,et al.  Deep Regression via Multi-Channel Multi-Modal Learning for Pneumonia Screening , 2020, IEEE Access.

[3]  Z. Fayad,et al.  Artificial intelligence–enabled rapid diagnosis of patients with COVID-19 , 2020, Nature Medicine.

[4]  S. Balakrishnan,et al.  Coronavirus Disease 2019 (COVID-19): A Systematic Review of Imaging Findings in 919 Patients. , 2020, AJR. American journal of roentgenology.

[5]  Andriy I. Bandos,et al.  Automated quantification of COVID-19 severity and progression using chest CT images , 2020, European Radiology.

[6]  W. Liang,et al.  Clinically Applicable AI System for Accurate Diagnosis, Quantitative Measurements, and Prognosis of COVID-19 Pneumonia Using Computed Tomography , 2020, Cell.

[7]  Mohammad Rahimzadeh,et al.  A Fully Automated Deep Learning-based Network For Detecting COVID-19 from a New And Large Lung CT Scan Dataset , 2021, Biomedical Signal Processing and Control.

[8]  George Papandreou,et al.  Rethinking Atrous Convolution for Semantic Image Segmentation , 2017, ArXiv.

[9]  Guang Yang,et al.  Automatic Brain Tumor Detection and Segmentation Using U-Net Based Fully Convolutional Networks , 2017, MIUA.

[10]  Ling Shao,et al.  Inf-Net: Automatic COVID-19 Lung Infection Segmentation From CT Images , 2020, IEEE Transactions on Medical Imaging.

[11]  Heshui Shi,et al.  Radiological findings from 81 patients with COVID-19 pneumonia in Wuhan, China: a descriptive study , 2020, The Lancet Infectious Diseases.

[12]  Yaozong Gao,et al.  Dual-Sampling Attention Network for Diagnosis of COVID-19 From Community Acquired Pneumonia , 2020, IEEE Transactions on Medical Imaging.

[13]  Lihua Li,et al.  A Rapid, Accurate and Machine-Agnostic Segmentation and Quantification Method for CT-Based COVID-19 Diagnosis , 2020, IEEE Transactions on Medical Imaging.

[14]  Nikhil Ketkar,et al.  Deep Learning with Python , 2017 .

[15]  Li Chen,et al.  COVID-19 CT Lung and Infection Segmentation Dataset , 2020 .

[16]  Q. Tao,et al.  Correlation of Chest CT and RT-PCR Testing in Coronavirus Disease 2019 (COVID-19) in China: A Report of 1014 Cases , 2020, Radiology.

[17]  Kaijin Xu,et al.  A Deep Learning System to Screen Novel Coronavirus Disease 2019 Pneumonia , 2020, Engineering.

[18]  Jianjiang Feng,et al.  Development and evaluation of an artificial intelligence system for COVID-19 diagnosis , 2020, Nature Communications.

[19]  Pramath Kakodkar,et al.  A Comprehensive Literature Review on the Clinical Presentation, and Management of the Pandemic Coronavirus Disease 2019 (COVID-19) , 2020, Cureus.

[20]  H. Kauczor,et al.  The Role of Chest Imaging in Patient Management During the COVID-19 Pandemic , 2020, Chest.

[21]  Victor M Corman,et al.  Detection of 2019 novel coronavirus (2019-nCoV) by real-time RT-PCR , 2020, Euro surveillance : bulletin Europeen sur les maladies transmissibles = European communicable disease bulletin.

[22]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[23]  Yicheng Fang,et al.  Sensitivity of Chest CT for COVID-19: Comparison to RT-PCR , 2020, Radiology.

[24]  Wenyu Liu,et al.  A Weakly-Supervised Framework for COVID-19 Classification and Lesion Localization From Chest CT , 2020, IEEE Transactions on Medical Imaging.

[25]  Mona G. Flores,et al.  Artificial intelligence for the detection of COVID-19 pneumonia on chest CT using multinational datasets , 2020, Nature Communications.

[26]  Dijia Wu,et al.  Diagnosis of Coronavirus Disease 2019 (COVID-19) With Structured Latent Multi-View Representation Learning , 2020, IEEE Transactions on Medical Imaging.

[27]  Hongbing Lu,et al.  Prior-Attention Residual Learning for More Discriminative COVID-19 Screening in CT Images , 2020, IEEE Transactions on Medical Imaging.

[28]  Dorin Comaniciu,et al.  Automated Quantification of CT Patterns Associated with COVID-19 from Chest CT , 2020, Radiology. Artificial intelligence.

[29]  Q. Tao,et al.  Serial Quantitative Chest CT Assessment of COVID-19: A Deep Learning Approach , 2020, Radiology. Cardiothoracic imaging.

[30]  Serkan Kiranyaz,et al.  Coronavirus: Comparing COVID-19, SARS and MERS in the eyes of AI , 2020, ArXiv.

[31]  Zhiyong Xu,et al.  A Noise-Robust Framework for Automatic Segmentation of COVID-19 Pneumonia Lesions From CT Images , 2020, IEEE Transactions on Medical Imaging.

[32]  G. Corrado,et al.  End-to-end lung cancer screening with three-dimensional deep learning on low-dose chest computed tomography , 2019, Nature Medicine.

[33]  Anvar Kurmukov,et al.  CT-based COVID-19 Triage: Deep Multitask Learning Improves Joint Identification and Severity Quantification , 2020, ArXiv.

[34]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[36]  N. Yu,et al.  Quantitative computed tomography analysis for stratifying the severity of Coronavirus Disease 2019 , 2020, Journal of Pharmaceutical Analysis.

[37]  Li Shen,et al.  Deep Learning to Improve Breast Cancer Detection on Screening Mammography , 2017, Scientific Reports.

[38]  Yan Bai,et al.  A fully automatic deep learning system for COVID-19 diagnostic and prognostic analysis , 2020, European Respiratory Journal.

[39]  H. Kauczor,et al.  The Role of Chest Imaging in Patient Management during the COVID-19 Pandemic: A Multinational Consensus Statement from the Fleischner Society , 2020, Radiology.

[40]  S. P. Morozov,et al.  MosMedData: Chest CT Scans with COVID-19 Related Findings , 2020, medRxiv.

[41]  Hui Shen,et al.  Dual-branch combination network (DCN): Towards accurate diagnosis and lesion segmentation of COVID-19 using CT images , 2020, Medical Image Analysis.

[42]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[43]  Lina Yao,et al.  Residual Attention U-Net for Automated Multi-Class Segmentation of COVID-19 Chest CT Images , 2020, ArXiv.

[44]  P. Craw,et al.  Isothermal nucleic acid amplification technologies for point-of-care diagnostics: a critical review. , 2012, Lab on a chip.