Classification and Region Analysis of COVID-19 Infection using Lung CT Images and Deep Convolutional Neural Networks

COVID-19 is a global health problem. Consequently, early detection and analysis of the infection patterns are crucial for controlling infection spread as well as devising a treatment plan. This work proposes a two-stage deep Convolutional Neural Networks (CNNs) based framework for delineation of COVID-19 infected regions in Lung CT images. In the first stage, initially, COVID-19 specific CT image features are enhanced using a two-level discrete wavelet transformation. These enhanced CT images are then classified using the proposed custom-made deep CoV-CTNet. In the second stage, the CT images classified as infectious images are provided to the segmentation models for the identification and analysis of COVID-19 infectious regions. In this regard, we propose a novel semantic segmentation model CoV-RASeg, which systematically uses average and max pooling operations in the encoder and decoder blocks. This systematic utilization of max and average pooling operations helps the proposed CoV-RASeg in simultaneously learning both the boundaries and region homogeneity. Moreover, the idea of attention is incorporated to deal with mildly infected regions. The proposed two-stage framework is evaluated on a standard Lung CT image dataset, and its performance is compared with the existing deep CNN models. The performance of the proposed CoV-CTNet is evaluated using Mathew Correlation Coefficient (MCC) measure (0.98) and that of proposed CoV-RASeg using Dice Similarity (DS) score (0.95). The promising results on an unseen test set suggest that the proposed framework has the potential to help the radiologists in the identification and analysis of COVID-19 infected regions.

[1]  A. Spinelli,et al.  COVID-19 pandemic: perspectives on an unfolding crisis , 2020, The British journal of surgery.

[2]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[3]  Muhammad Haroon Yousaf,et al.  PASSENGER DETECTION AND COUNTING FOR PUBLIC TRANSPORT SYSTEM , 2020 .

[4]  Y. Hu,et al.  Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China , 2020, The Lancet.

[5]  N. Sri Madhava Raja,et al.  Harmony-Search and Otsu based System for Coronavirus Disease (COVID-19) Detection using Lung CT Scan Images , 2020, ArXiv.

[6]  Nicola Conci,et al.  Computer vision based room interior design , 2015, International Conference on Machine Vision.

[7]  Irfan Ul Haq,et al.  Transfer Learning and Meta Classification Based Deep Churn Prediction System for Telecom Industry , 2019, ArXiv.

[8]  Bo Xu,et al.  A deep learning algorithm using CT images to screen for Corona virus disease (COVID-19) , 2020, European Radiology.

[9]  Ben Glocker,et al.  Attention Gated Networks: Learning to Leverage Salient Regions in Medical Images , 2018, Medical Image Anal..

[10]  Alexander Wong,et al.  COVID-Net: a tailored deep convolutional neural network design for detection of COVID-19 cases from chest X-ray images , 2020, Scientific reports.

[11]  Ling Shao,et al.  Transfer Learning for Visual Categorization: A Survey , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[12]  Marcin Iwanowski Image Contrast Enhancement Based on Laplacian-of-Gaussian Filter Combined with Morphological Reconstruction , 2019, CORES.

[13]  Dinggang Shen,et al.  Review of Artificial Intelligence Techniques in Imaging Data Acquisition, Segmentation, and Diagnosis for COVID-19 , 2020, IEEE Reviews in Biomedical Engineering.

[14]  Xiangyu Zhang,et al.  ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[15]  Heshui Shi,et al.  Radiological findings from 81 patients with COVID-19 pneumonia in Wuhan, China: a descriptive study , 2020, The Lancet Infectious Diseases.

[16]  Richard K. G. Do,et al.  Convolutional neural networks: an overview and application in radiology , 2018, Insights into Imaging.

[17]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  S. Balakrishnan,et al.  Coronavirus Disease 2019 (COVID-19): A Systematic Review of Imaging Findings in 919 Patients. , 2020, AJR. American journal of roentgenology.

[19]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Zhiqiang He,et al.  Towards Efficient COVID-19 CT Annotation: A Benchmark for Lung and Infection Segmentation , 2020, ArXiv.

[21]  Estimating clinical severity of COVID-19 from the transmission dynamics in Wuhan, China , 2020, Nature Medicine.

[22]  Farnoosh Naderkhani,et al.  COVID-CAPS: A capsule network-based framework for identification of COVID-19 cases from X-ray images , 2020, Pattern Recognition Letters.

[23]  Q. Tao,et al.  Correlation of Chest CT and RT-PCR Testing in Coronavirus Disease 2019 (COVID-19) in China: A Report of 1014 Cases , 2020, Radiology.

[24]  Yicheng Fang,et al.  Sensitivity of Chest CT for COVID-19: Comparison to RT-PCR , 2020, Radiology.

[25]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  L. Brown,et al.  Interval Estimation for a Binomial Proportion , 2001 .

[27]  Eui Jin Hwang,et al.  Development and Validation of a Deep Learning–based Automatic Detection Algorithm for Active Pulmonary Tuberculosis on Chest Radiographs , 2018, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[28]  Vinod Kumar,et al.  Internet of image things-discrete wavelet transform and Gabor wavelet transform based image enhancement resolution technique for IoT satellite applications , 2019, Cognitive Systems Research.

[29]  Pulkit Kumar,et al.  U-Segnet: Fully Convolutional Neural Network Based Automated Brain Tissue Segmentation Tool , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[30]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[31]  Asifullah Khan,et al.  Adaptive transfer learning in deep neural networks: Wind power prediction using knowledge transfer from region to region and between different task domains , 2018, Comput. Intell..

[32]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Z. Fayad,et al.  Artificial intelligence–enabled rapid diagnosis of patients with COVID-19 , 2020, Nature Medicine.

[34]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Hayit Greenspan,et al.  Rapid AI Development Cycle for the Coronavirus (COVID-19) Pandemic: Initial Results for Automated Detection & Patient Monitoring using Deep Learning CT Image Analysis , 2020, ArXiv.

[36]  Jos B. T. M. Roerdink,et al.  The Watershed Transform: Definitions, Algorithms and Parallelization Strategies , 2000, Fundam. Informaticae.

[37]  D. Dong,et al.  The Role of Imaging in the Detection and Management of COVID-19: A Review , 2020, IEEE Reviews in Biomedical Engineering.

[38]  Christoph Meinel,et al.  Deep Learning for Medical Image Analysis , 2018, Journal of Pathology Informatics.

[39]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Arya P Unni Satellite Image Enhancement Using 2D Level DWT , 2014 .

[41]  Sang Min Lee,et al.  Deep learning-based detection system for multiclass lesions on chest radiographs: comparison with observer readings , 2019, European Radiology.

[42]  Mehryar Mohri,et al.  Confidence Intervals for the Area Under the ROC Curve , 2004, NIPS.

[43]  Ping Chen,et al.  Evolution of the novel coronavirus from the ongoing Wuhan outbreak and modeling of its spike protein for risk of human transmission , 2020, Science China Life Sciences.

[44]  José García Rodríguez,et al.  A survey on deep learning techniques for image and video semantic segmentation , 2018, Appl. Soft Comput..

[45]  Yaozong Gao,et al.  Lung Infection Quantification of COVID-19 in CT Images with Deep Learning , 2020, ArXiv.

[46]  Lei Liu,et al.  Evaluating the accuracy of different respiratory specimens in the laboratory diagnosis and monitoring the viral shedding of 2019-nCoV infections , 2020, medRxiv.

[47]  Asifullah Khan,et al.  A survey of the recent architectures of deep convolutional neural networks , 2019, Artificial Intelligence Review.

[48]  Ali Narin,et al.  Automatic detection of coronavirus disease (COVID-19) using X-ray images and deep convolutional neural networks , 2020, Pattern Analysis and Applications.

[49]  Xiaogang Wang,et al.  Residual Attention Network for Image Classification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[50]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[51]  Bingliang Zeng,et al.  Diagnosis of the Coronavirus disease (COVID-19): rRT-PCR or CT? , 2020, European Journal of Radiology.

[52]  Asifullah Khan,et al.  Transfer learning based deep CNN for segmentation and detection of mitoses in breast cancer histopathological images. , 2019, Microscopy.