COVID-CT-Mask-Net: Prediction of COVID-19 from CT Scans Using Regional Features

We present COVID-CT-Mask-Net model that predicts COVID-19 from CT scans. The model works in two stages: first, it detects the instances of ground glass opacity and consolidation in CT scans, then predicts the condition from the ranked bounding box detections. To develop the solution for the three-class problem (COVID, common pneumonia and control), we used the COVIDx-CT dataset derived from the dataset of CT scans collected by China National Center for Bioinformation. We use about $5\%$ of the training split of COVIDx-CT to train the model, and without any complicated data normalization, balancing and regularization, and training only a small fraction of the model9s parameters, we achieve a $\mathbf{90.80\%}$ COVID sensitivity, $\mathbf{91.62\%}$ common pneumonia sensitivity and $\mathbf{92.10\%}$ normal sensitivity, and an overall accuracy of $\textbf{91.66\%}$ on the test data (21182 images), bringing the ratio of test/train data to \textbf{7.06}, which implies a very high capacity of the model to generalize to new data. We also establish an important result, that ranked regional predictions (bounding boxes with scores) in Mask R-CNN can be used to make accurate predictions of the image class. The full source code, models and pretrained weights are available on \url{https://github.com/AlexTS1980/COVID-CT-Mask-Net}. %One of the challenges of training a machine learning model to detect the presence of COVID-related areas in CT scans is the scarcity of segmented data. We present the COVID-CT-Mask-Net, a COVID19 detection model based on instance segmentation of COVID-related areas in CT scans. The model is first trained to segment instances of two types of COVID correlates: ground-glass opacity and consolidation. Then, this model is augmented with three classification modules to predict COVID from the regional features in CT scans. Our model achieves the state-of-the-art accuracy in predicting COVID in patients, it is conceptually simpler, requires a smaller dataset for training compared to other machine learning models, and does not require tricks to balance the data.

[1]  Ming-Ming Cheng,et al.  JCS: An Explainable COVID-19 Diagnosis System by Joint Classification and Segmentation , 2020, IEEE Transactions on Image Processing.

[2]  P. Xie,et al.  COVID-CT-Dataset: A CT Scan Dataset about COVID-19 , 2020, ArXiv.

[3]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[5]  Jun Liu,et al.  CT Scans of Patients with 2019 Novel Coronavirus (COVID-19) Pneumonia , 2020, Theranostics.

[6]  Junwei Su,et al.  Deep learning system to screen coronavirus disease 2019 pneumonia , 2020 .

[7]  Alexander Wong,et al.  COVID-Net: a tailored deep convolutional neural network design for detection of COVID-19 cases from chest X-ray images , 2020, Scientific reports.

[8]  Jun Liu,et al.  Relation Between Chest CT Findings and Clinical Conditions of Coronavirus Disease (COVID-19) Pneumonia: A Multicenter Study. , 2020, AJR. American journal of roentgenology.

[9]  Yifan Yang,et al.  Experiments of Federated Learning for COVID-19 Chest X-ray Images , 2020, Advances in Artificial Intelligence and Security.

[10]  Muhammad Aleem,et al.  Comparative performance analysis of the ResNet backbones of Mask RCNN to segment the signs of COVID-19 in chest CT scans , 2020, ArXiv.

[11]  K. Cao,et al.  Using Artificial Intelligence to Detect COVID-19 and Community-acquired Pneumonia Based on Pulmonary CT: Evaluation of the Diagnostic Accuracy , 2020 .

[12]  Kaiming He,et al.  Mask R-CNN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[13]  W. Liang,et al.  Clinically Applicable AI System for Accurate Diagnosis, Quantitative Measurements, and Prognosis of COVID-19 Pneumonia Using Computed Tomography , 2020, Cell.

[14]  P. Wong,et al.  Automatic distinction between COVID-19 and common pneumonia using multi-scale convolutional neural network on chest CT scans , 2020, Chaos, Solitons & Fractals.

[15]  Dinggang Shen,et al.  Review of Artificial Intelligence Techniques in Imaging Data Acquisition, Segmentation, and Diagnosis for COVID-19 , 2020, IEEE Reviews in Biomedical Engineering.