Efficient and Visualizable Convolutional Neural Networks for COVID-19 Classification Using Chest CT

The novel 2019 coronavirus disease (COVID-19) has infected over 65 million people worldwide as of December 4, 2020, pushing the world to the brink of social and economic collapse. With cases rising rapidly, deep learning has emerged as a promising diagnosis technique. However, identifying the most accurate models to characterize COVID-19 patients is challenging because comparing results obtained with different types of data and acquisition processes is non-trivial. In this paper, we evaluated and compared 40 different convolutional neural network architectures for COVID-19 diagnosis, serving as the first to consider the EfficientNet family for COVID-19 diagnosis. EfficientNet-B5 is identified as the best model with an accuracy of 0.9931±0.0021, F1 score of 0.9931±0.0020, sensitivity of 0.9952±0.0020, and specificity of 0.9912±0.0048. Intermediate activation maps and Gradient-weighted Class Activation Mappings offer humaninterpretable evidence of the model’s perception of ground-class opacities and consolidations, hinting towards a promising use-case of artificial intelligence-assisted radiology tools.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[3]  D. Dong,et al.  The Role of Imaging in the Detection and Management of COVID-19: A Review , 2020, IEEE Reviews in Biomedical Engineering.

[4]  Zümrüt Müftüoğlu,et al.  Differential Privacy Practice on Diagnosis of COVID-19 Radiology Imaging Using EfficientNet , 2020, 2020 International Conference on INnovations in Intelligent SysTems and Applications (INISTA).

[5]  Quoc V. Le,et al.  EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks , 2019, ICML.

[6]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[8]  Plamen Angelov,et al.  SARS-CoV-2 CT-scan dataset:A large dataset of real patients CT scans for SARS-CoV-2 identification , 2020 .

[9]  U. Rajendra Acharya,et al.  Automated detection of COVID-19 cases using deep neural networks with X-ray images , 2020, Computers in Biology and Medicine.

[10]  B. Song,et al.  Chest CT manifestations of new coronavirus disease 2019 (COVID-19): a pictorial review , 2020, European Radiology.

[11]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[12]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Hyunsook Hong,et al.  Diagnostic Performance of CT and Reverse Transcriptase-Polymerase Chain Reaction for Coronavirus Disease 2019: A Meta-Analysis , 2020, Radiology.

[14]  Reda Alhajj,et al.  A Review on Deep Learning Techniques for the Diagnosis of Novel Coronavirus (COVID-19) , 2020, IEEE Access.

[15]  Haibo Xu,et al.  AI-assisted CT imaging analysis for COVID-19 screening: Building and deploying a medical AI system in four weeks , 2020, medRxiv.

[16]  X. He,et al.  Sample-Efficient Deep Learning for COVID-19 Diagnosis Based on CT Scans , 2020, medRxiv.

[17]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[19]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[20]  U. Rajendra Acharya,et al.  Application of deep learning technique to manage COVID-19 in routine clinical practice using CT images: Results of 10 convolutional neural networks , 2020, Computers in Biology and Medicine.

[21]  Xiaowei Xu,et al.  A Deep Learning System to Screen Novel Coronavirus Disease 2019 Pneumonia , 2020, Engineering.

[22]  Gaurav Gupta,et al.  Review on machine and deep learning models for the detection and prediction of Coronavirus , 2020, Materials Today: Proceedings.

[23]  S. Haseli,et al.  ai-corona: Radiologist-assistant deep learning framework for COVID-19 diagnosis in chest CT scans , 2020, medRxiv.

[24]  Jie Tian,et al.  Deep learning-based multi-view fusion model for screening 2019 novel coronavirus pneumonia: A multicentre study , 2020, European Journal of Radiology.

[25]  Isabel de la Torre Díez,et al.  Automated medical diagnosis of COVID-19 through EfficientNet convolutional neural network , 2020, Applied Soft Computing.

[26]  Yicheng Fang,et al.  Sensitivity of Chest CT for COVID-19: Comparison to RT-PCR , 2020, Radiology.

[27]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Sonali Agarwal,et al.  COVID-19 Epidemic Analysis using Machine Learning and Deep Learning Algorithms , 2020, medRxiv.

[29]  Silvio Savarese,et al.  Generalized Intersection Over Union: A Metric and a Loss for Bounding Box Regression , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Samuel Lalmuanawma,et al.  Applications of machine learning and artificial intelligence for Covid-19 (SARS-CoV-2) pandemic: A review , 2020, Chaos, Solitons & Fractals.

[31]  Muhammad Ashad Kabir,et al.  ECOVNet: a highly effective ensemble based deep learning model for detecting COVID-19 , 2020, PeerJ Comput. Sci..

[32]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  Jianjiang Feng,et al.  Development and evaluation of an artificial intelligence system for COVID-19 diagnosis , 2020, Nature Communications.