Ensemble-CVDNet: A Deep Learning based End-to-End Classification Framework for COVID-19 Detection using Ensembles of Networks

The new type of coronavirus disease (COVID-19), which started in Wuhan, China in December 2019, continues to spread rapidly affecting the whole world. It is essential to have a highly sensitive diagnostic screening tool to detect the disease as early as possible. Currently, chest CT imaging is preferred as the primary screening tool for evaluating the COVID-19 pneumonia by radiological imaging. However, CT imaging requires larger radiation doses, longer exposure time, higher cost, and may suffer from patient movements. X-Ray imaging is a fast, cheap, more patient-friendly and available in almost every healthcare facility. Therefore, we have focused on X-Ray images and developed an end-to-end deep learning model, i.e. Ensemble-CVDNet, to distinguish COVID-19 pneumonia from non-COVID pneumonia and healthy cases in this work. The proposed model is based on a combination of three lightweight pre-trained models SqueezeNet, ShuffleNet, and EfficientNet-B0 at different depths, and combines feature maps in different abstraction levels. In the proposed end to-end model, networks are used as feature extractors in parallel after fine-tuning, and some additional layers are used at the top of them. The proposed model is evaluated in the COVID-19 Radiography Database, a public data set consisting of 219 COVID-19, 1341 Healthy, and 1345 Viral Pneumonia chest X-Ray images. Experimental results show that our lightweight Ensemble-CVDNet model provides 98.30% accuracy, 97.78% sensitivity, and 97.61% F1 score using only 5.62M parameters. Moreover, it takes about 10ms to process and predict an X-Ray image using the proposed method using a mid level GPU. We believe that the method proposed in this study can be a helpful diagnostic screening tool for radiologists in the early diagnosis of the disease.

[1]  World Health Organization,et al.  Transmission of SARS-CoV-2: implications for infection prevention precautions , 2020 .

[2]  M. Güllü,et al.  Deep Feature Extraction Based Fine-Tuning , 2020, 2020 28th Signal Processing and Communications Applications Conference (SIU).

[3]  Kemal Polat,et al.  A Novel Medical Diagnosis model for COVID-19 infection detection based on Deep Features and Bayesian Optimization , 2020, Applied Soft Computing.

[4]  Vinay Namboodiri,et al.  CovidAID: COVID-19 Detection Using Chest X-Ray , 2020, ArXiv.

[5]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[6]  Chao Yang,et al.  A Survey on Deep Transfer Learning , 2018, ICANN.

[7]  Jan Sölter,et al.  On the Composition and Limitations of Publicly Available COVID-19 X-Ray Imaging Datasets , 2020, ArXiv.

[8]  W. Huda,et al.  Effective doses in radiology and diagnostic nuclear medicine: a catalog. , 2008, Radiology.

[9]  Devy M. Emperador,et al.  Signs and symptoms to determine if a patient presenting in primary care or hospital outpatient settings has COVID‐19 disease , 2020, The Cochrane database of systematic reviews.

[10]  Seçkin Karasu,et al.  Recognition of COVID-19 disease from X-ray images by hybrid model consisting of 2D curvelet transform, chaotic salp swarm algorithm and deep learning technique , 2020, Chaos, Solitons & Fractals.

[11]  Quoc V. Le,et al.  EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks , 2019, ICML.

[12]  Cher Heng Tan,et al.  Clinical utility of chest radiography for severe COVID-19. , 2020, Quantitative imaging in medicine and surgery.

[13]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[14]  Mohammed Meknassi,et al.  CVDNet: A novel deep learning architecture for detection of coronavirus (Covid-19) from chest x-ray images , 2020, Chaos, Solitons & Fractals.

[15]  Long Jiang Zhang,et al.  Coronavirus Disease 2019 (COVID-19): A Perspective from China , 2020, Radiology.

[16]  Daniel S. Kermany,et al.  Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning , 2018, Cell.

[17]  Antonella Santone,et al.  Explainable Deep Learning for Pulmonary Disease and Coronavirus COVID-19 Detection from X-rays , 2020, Computer Methods and Programs in Biomedicine.

[18]  Shihua Zhao,et al.  The role of imaging in 2019 novel coronavirus pneumonia (COVID-19) , 2020, European Radiology.

[19]  U. Rajendra Acharya,et al.  Automated detection of COVID-19 cases using deep neural networks with X-ray images , 2020, Computers in Biology and Medicine.

[20]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[21]  Abdulkadir Şengür,et al.  Deep learning approaches for COVID-19 detection based on chest X-ray images , 2020, Expert Systems with Applications.

[22]  Ram Bilas Pachori,et al.  Application of deep learning techniques for detection of COVID-19 cases using chest X-ray images: A comprehensive study , 2020, Biomedical Signal Processing and Control.

[23]  Heidi Ledford,et al.  The UK has approved a COVID vaccine — here’s what scientists now want to know , 2020, Nature.

[24]  C. E. WHO Coronavirus Disease (COVID-19) Dashboard , 2020 .

[25]  K. Cuschieri,et al.  Sensitivity of RT-PCR testing of upper respiratory tract samples for SARS-CoV-2 in hospitalised patients: a retrospective cohort study , 2020, medRxiv.

[26]  Mamun Bin Ibne Reaz,et al.  Can AI Help in Screening Viral and COVID-19 Pneumonia? , 2020, IEEE Access.

[27]  Forrest N. Iandola,et al.  SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size , 2016, ArXiv.

[28]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[29]  Bo Chen,et al.  Detection of COVID-19: A review of the current literature and future perspectives , 2020, Biosensors and Bioelectronics.

[30]  R. Frutos,et al.  Mass culling of minks to protect the COVID-19 vaccines: is it rational? , 2020, New Microbes and New Infections.

[31]  R. Karthik,et al.  Learning distinctive filters for COVID-19 detection from chest X-ray using shuffled residual CNN , 2020, Applied Soft Computing.

[32]  Milan Sonka,et al.  Deep-COVID: Predicting COVID-19 from chest X-ray images using deep transfer learning , 2020, Medical Image Analysis.

[33]  Alexander Wong,et al.  COVID-Net: a tailored deep convolutional neural network design for detection of COVID-19 cases from chest X-ray images , 2020, Scientific reports.

[34]  Xiangyu Zhang,et al.  ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[35]  Abdul Hafeez,et al.  COVID-ResNet: A Deep Learning Framework for Screening of COVID19 from Radiographs , 2020, ArXiv.

[36]  Mohamed Medhat Gaber,et al.  Classification of COVID-19 in chest X-ray images using DeTraC deep convolutional neural network , 2020, Appl. Intell..

[37]  Mohamed Medhat Gaber,et al.  Classification of COVID-19 in chest X-ray images using DeTraC deep convolutional neural network , 2020, Applied Intelligence.

[38]  Mohammad Zoynul Abedin,et al.  Early Detection of Coronavirus Cases Using Chest X-ray Images Employing Machine Learning and Deep Learning Approaches , 2020, medRxiv.

[39]  B. Gu,et al.  Laboratory diagnosis of coronavirus disease-2019 (COVID-19) , 2020, Clinica Chimica Acta.