Efficient and visualizable convolutional neural networks for COVID-19 classification using Chest CT

With COVID-19 cases rising rapidly, deep learning has emerged as a promising diagnosis technique. However, identifying the most accurate models to characterize COVID-19 patients is challenging because comparing results obtained with different types of data and acquisition processes is non-trivial. In this paper we designed, evaluated, and compared the performance of 20 convolutional neutral networks in classifying patients as COVID-19 positive, healthy, or suffering from other pulmonary lung infections based on Chest CT scans, serving as the first to consider the EfficientNet family for COVID-19 diagnosis and employ intermediate activation maps for visualizing model performance. All models are trained and evaluated in Python using 4173 Chest CT images from the dataset entitled “A COVID multiclass dataset of CT scans,” with 2168, 758, and 1247 images of patients that are COVID-19 positive, healthy, or suffering from other pulmonary infections, respectively. EfficientNet-B5 was identified as the best model with an F1 score of 0.9769±0.0046, accuracy of 0.9759±0.0048, sensitivity of 0.9788±0.0055, specificity of 0.9730±0.0057, and precision of 0.9751± 0.0051. On an alternate 2-class dataset, EfficientNetB5 obtained an accuracy of 0.9845±0.0109, F1 score of 0.9599±0.0251, sensitivity of 0.9682±0.0099, specificity of 0.9883±0.0150, and precision of 0.9526 ± 0.0523. Intermediate activation maps and Gradient-weighted Class Activation Mappings offered human-interpretable evidence of the model’s perception of ground-class opacities and consolidations, hinting towards a promising use-case of artificial intelligence-assisted radiology tools. With a prediction speed of under 0.1 seconds on GPUs and 0.5 seconds on CPUs, our proposed model offers a rapid, scalable, and accurate diagnostic for COVID-19.

[1]  Samuel Lalmuanawma,et al.  Applications of machine learning and artificial intelligence for Covid-19 (SARS-CoV-2) pandemic: A review , 2020, Chaos, Solitons & Fractals.

[2]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[3]  Md. Muhtadir Rahman,et al.  ECOVNet: a highly effective ensemble based deep learning model for detecting COVID-19 , 2021, PeerJ Comput. Sci..

[4]  R. B. Pachori,et al.  FBSED based automatic diagnosis of COVID-19 using X-ray and CT images , 2021, Computers in Biology and Medicine.

[5]  Jianming Wang,et al.  AI-assisted CT imaging analysis for COVID-19 screening: Building and deploying a medical AI system , 2020, Applied Soft Computing.

[6]  D. Dong,et al.  The Role of Imaging in the Detection and Management of COVID-19: A Review , 2020, IEEE Reviews in Biomedical Engineering.

[7]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Jinzhu Yang,et al.  Classification of COVID-19 Chest CT Images Based on Ensemble Deep Learning , 2021, Journal of healthcare engineering.

[9]  Jie Tian,et al.  Deep learning-based multi-view fusion model for screening 2019 novel coronavirus pneumonia: A multicentre study , 2020, European Journal of Radiology.

[10]  X. He,et al.  Sample-Efficient Deep Learning for COVID-19 Diagnosis Based on CT Scans , 2020, medRxiv.

[11]  Maher Alrahhal,et al.  COVID-19 Diagnostic System Using Medical Image Classification and Retrieval: A Novel Method for Image Analysis , 2021, Comput. J..

[12]  Haruna Chiroma,et al.  CovFrameNet: An Enhanced Deep Learning Framework for COVID-19 Detection , 2021, IEEE Access.

[13]  Ming-Ming Cheng,et al.  JCS: An Explainable COVID-19 Diagnosis System by Joint Classification and Segmentation , 2020, IEEE Transactions on Image Processing.

[14]  M. Kolekar,et al.  Deep learning empowered COVID-19 diagnosis using chest CT scan images for collaborative edge-cloud computing platform , 2021, Multim. Tools Appl..

[15]  P. Alam ‘L’ , 2021, Composites Engineering: An A–Z Guide.

[16]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[17]  Isabel de la Torre Díez,et al.  Automated medical diagnosis of COVID-19 through EfficientNet convolutional neural network , 2020, Applied Soft Computing.

[18]  U. Rajendra Acharya,et al.  Automated detection of COVID-19 cases using deep neural networks with X-ray images , 2020, Computers in Biology and Medicine.

[19]  Silvio Savarese,et al.  Generalized Intersection Over Union: A Metric and a Loss for Bounding Box Regression , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Rishabh Ranjan,et al.  Multi-Scale Residual Network for Covid-19 Diagnosis Using Ct-Scans , 2021, ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[21]  Zümrüt Müftüoğlu,et al.  Differential Privacy Practice on Diagnosis of COVID-19 Radiology Imaging Using EfficientNet , 2020, 2020 International Conference on INnovations in Intelligent SysTems and Applications (INISTA).

[22]  Sonali Agarwal,et al.  COVID-19 Epidemic Analysis using Machine Learning and Deep Learning Algorithms , 2020, medRxiv.

[23]  Abdelmalik Taleb-Ahmed,et al.  CNR-IEMN: A Deep Learning Based Approach to Recognise Covid-19 from CT-Scan , 2021, ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[24]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[25]  B. Song,et al.  Chest CT manifestations of new coronavirus disease 2019 (COVID-19): a pictorial review , 2020, European Radiology.

[26]  Raymond Y Huang,et al.  AI Augmentation of Radiologist Performance in Distinguishing COVID-19 from Pneumonia of Other Etiology on Chest CT , 2020, Radiology.

[27]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[29]  A. Fawzy,et al.  Efficient Classification Approach Based on COVID-19 CT Images Analysis with Deep Features , 2021, 2021 International Conference on Computing, Communication, and Intelligent Systems (ICCCIS).

[30]  Hyunsook Hong,et al.  Diagnostic Performance of CT and Reverse Transcriptase-Polymerase Chain Reaction for Coronavirus Disease 2019: A Meta-Analysis , 2020, Radiology.

[31]  Bo Chen,et al.  MnasNet: Platform-Aware Neural Architecture Search for Mobile , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  S. Haseli,et al.  ai-corona: Radiologist-assistant deep learning framework for COVID-19 diagnosis in chest CT scans , 2020, medRxiv.

[33]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[34]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Yicheng Fang,et al.  Sensitivity of Chest CT for COVID-19: Comparison to RT-PCR , 2020, Radiology.

[36]  Raymond Y Huang,et al.  Artificial Intelligence Augmentation of Radiologist Performance in Distinguishing COVID-19 from Pneumonia of Other Origin at Chest CT , 2021, Radiology.

[37]  Jianjiang Feng,et al.  Development and evaluation of an artificial intelligence system for COVID-19 diagnosis , 2020, Nature Communications.

[38]  G. Fitzgerald,et al.  'I. , 2019, Australian journal of primary health.

[39]  Gaurav Gupta,et al.  Review on machine and deep learning models for the detection and prediction of Coronavirus , 2020, Materials Today: Proceedings.

[40]  I. Myderrizi,et al.  Implementation of CNN based COVID-19 classification model from CT images , 2021, 2021 IEEE 19th World Symposium on Applied Machine Intelligence and Informatics (SAMI).

[41]  Haibo Xu,et al.  AI-assisted CT imaging analysis for COVID-19 screening: Building and deploying a medical AI system in four weeks , 2020, medRxiv.

[42]  Abnormality detection and intelligent severity assessment of human chest computed tomography scans using deep learning: a case study on SARS-COV-2 assessment , 2021, Journal of ambient intelligence and humanized computing.

[43]  Plamen Angelov,et al.  SARS-CoV-2 CT-scan dataset:A large dataset of real patients CT scans for SARS-CoV-2 identification , 2020 .

[44]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[45]  U. Rajendra Acharya,et al.  Application of deep learning technique to manage COVID-19 in routine clinical practice using CT images: Results of 10 convolutional neural networks , 2020, Computers in Biology and Medicine.

[46]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[47]  Quoc V. Le,et al.  EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks , 2019, ICML.

[48]  Charmaine Butt,et al.  Deep learning system to screen coronavirus disease 2019 pneumonia , 2020, Applied Intelligence.