Evaluation of Convolutional Neural Networks for COVID-19 Classification on Chest X-Rays

Early identification of patients with COVID-19 is essential to enable adequate treatment and to reduce the burden on the health system. The gold standard for COVID-19 detection is the use of RT-PCR tests. However, due to the high demand for tests, these can take days or even weeks in some regions of Brazil. Thus, an alternative for detecting COVID-19 is the analysis of Digital Chest X-rays (XR). Changes due to COVID-19 can be detected in XR, even in asymptomatic patients. In this context, models based on deep learning have great potential to be used as support systems for diagnosis or as screening tools. In this paper, we propose the evaluation of convolutional neural networks to identify pneumonia due to COVID-19 in XR. The proposed methodology consists of a preprocessing step of the XR, data augmentation, and classification by the convolutional architectures DenseNet121, InceptionResNetV2, InceptionV3, MovileNetV2, ResNet50, and VGG16 pre-trained with the ImageNet dataset. The obtained results demonstrate that the VGG16 architecture obtained superior performance in the classification of XR for the evaluation metrics using the methodology proposed in this article. The obtained results for our methodology demonstrate that the VGG16 architecture presented a superior performance in the classification of XR, with an Accuracy of 85.11%, Sensitivity of 85.25%, Specificity of 85.16%, F1-score of 85.03%, and an AUC of 0.9758.

[1]  Asif Iqbal Khan,et al.  CoroNet: A deep neural network for detection and diagnosis of COVID-19 from chest x-ray images , 2020, Computer Methods and Programs in Biomedicine.

[2]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[3]  M. Kuo,et al.  Frequency and Distribution of Chest Radiographic Findings in COVID-19 Positive Patients , 2019, Radiology.

[4]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Samir Bhatt,et al.  Evolution and epidemic spread of SARS-CoV-2 in Brazil , 2020, Science.

[6]  P. Khong,et al.  COVID-19 pneumonia: what has CT taught us? , 2020, The Lancet Infectious Diseases.

[7]  N. Bashir,et al.  COVID-19 infection: Origin, transmission, and characteristics of human coronaviruses , 2020, Journal of Advanced Research.

[8]  Geraint Rees,et al.  Clinically applicable deep learning for diagnosis and referral in retinal disease , 2018, Nature Medicine.

[9]  Ezz El-Din Hemdan,et al.  COVIDX-Net: A Framework of Deep Learning Classifiers to Diagnose COVID-19 in X-Ray Images , 2020, ArXiv.

[10]  Centers for Disease Control and Prevention CDC COVID-19 Response Team Severe Outcomes Among Patients with Coronavirus Disease 2019 (COVID-19) — United States, February 12–March 16, 2020 , 2020, MMWR. Morbidity and mortality weekly report.

[11]  Luke Taylor Covid-19: Is Manaus the final nail in the coffin for natural herd immunity? , 2021, BMJ.

[12]  Kai Zhao,et al.  A pneumonia outbreak associated with a new coronavirus of probable bat origin , 2020, Nature.

[13]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[14]  P. Lakhani,et al.  Deep Learning at Chest Radiography: Automated Classification of Pulmonary Tuberculosis by Using Convolutional Neural Networks. , 2017, Radiology.

[15]  H. David,et al.  Epidemiologia, políticas públicas e pandemia de Covid-19: o que esperar no Brasil? [Epidemiology, public policies and Covid-19 pandemics in Brazil: what can we expect?] [Epidemiologia, políticas públicas y la pandémia de Covid-19 en Brasil: que podemos esperar?] , 2020 .

[16]  S. Scarlata,et al.  COVID‐19 diagnosis and management: a comprehensive review , 2020, Journal of internal medicine.

[17]  Q. Tao,et al.  Correlation of Chest CT and RT-PCR Testing in Coronavirus Disease 2019 (COVID-19) in China: A Report of 1014 Cases , 2020, Radiology.

[18]  Jonathan E. Schmitz,et al.  Laboratory Diagnosis of COVID-19: Current Issues and Challenges , 2020, Journal of Clinical Microbiology.

[19]  Roberto Maroldi,et al.  COVID-19 outbreak in Italy: experimental chest X-ray scoring system for quantifying and monitoring disease progression , 2020, La radiologia medica.

[20]  Joseph Paul Cohen,et al.  COVID-19 Image Data Collection: Prospective Predictions Are the Future , 2020, ArXiv.

[21]  Mohamed Medhat Gaber,et al.  Classification of COVID-19 in chest X-ray images using DeTraC deep convolutional neural network , 2020, Appl. Intell..

[22]  E. Dong,et al.  An interactive web-based dashboard to track COVID-19 in real time , 2020, The Lancet Infectious Diseases.

[23]  Paul S. Heckbert,et al.  Graphics gems IV , 1994 .

[24]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[25]  Carla Diniz Lopes Becker,et al.  A Deep Learning Approach for Pulmonary Lesion Identification in Chest Radiographs , 2020, BRACIS.

[26]  Antonella Santone,et al.  Explainable Deep Learning for Pulmonary Disease and Coronavirus COVID-19 Detection from X-rays , 2020, Computer Methods and Programs in Biomedicine.

[27]  Pekka Matilainen,et al.  Evaluation of the confusion matrix method in the validation of an automated system for measuring feeding behaviour of cattle , 2018, Behavioural Processes.

[28]  Anthony E. A. Jatobá,et al.  CNN Hyperparameter Optimization for Pulmonary Nodule Classification , 2020 .

[29]  E. Holmes,et al.  The proximal origin of SARS-CoV-2 , 2020, Nature Medicine.

[30]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  U. Rajendra Acharya,et al.  Automated detection of COVID-19 cases using deep neural networks with X-ray images , 2020, Computers in Biology and Medicine.

[32]  F. Marson COVID-19 – 6 million cases worldwide and an overview of the diagnosis in Brazil: a tragedy to be announced☆☆☆ , 2020, Diagnostic Microbiology and Infectious Disease.

[33]  Tiago Zonta,et al.  Segmentation of Masses on Mammograms Using Data Augmentation and Deep Learning , 2020, Journal of Digital Imaging.

[34]  Jun Liu,et al.  Chest CT for Typical 2019-nCoV Pneumonia: Relationship to Negative RT-PCR Testing , 2020, Radiology.

[35]  Unais Sait,et al.  Curated Dataset for COVID-19 Posterior-Anterior Chest Radiography Images (X-Rays). , 2020 .

[36]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).