Transfer Learning to Detect COVID-19 Automatically from X-Ray Images Using Convolutional Neural Networks

The novel coronavirus disease 2019 (COVID-19) is a contagious disease that has caused thousands of deaths and infected millions worldwide. Thus, various technologies that allow for the fast detection of COVID-19 infections with high accuracy can offer healthcare professionals much-needed help. This study is aimed at evaluating the effectiveness of the state-of-the-art pretrained Convolutional Neural Networks (CNNs) on the automatic diagnosis of COVID-19 from chest X-rays (CXRs). The dataset used in the experiments consists of 1200 CXR images from individuals with COVID-19, 1345 CXR images from individuals with viral pneumonia, and 1341 CXR images from healthy individuals. In this paper, the effectiveness of artificial intelligence (AI) in the rapid and precise identification of COVID-19 from CXR images has been explored based on different pretrained deep learning algorithms and fine-tuned to maximise detection accuracy to identify the best algorithms. The results showed that deep learning with X-ray imaging is useful in collecting critical biological markers associated with COVID-19 infections. VGG16 and MobileNet obtained the highest accuracy of 98.28%. However, VGG16 outperformed all other models in COVID-19 detection with an accuracy, F1 score, precision, specificity, and sensitivity of 98.72%, 97.59%, 96.43%, 98.70%, and 98.78%, respectively. The outstanding performance of these pretrained models can significantly improve the speed and accuracy of COVID-19 diagnosis. However, a larger dataset of COVID-19 X-ray images is required for a more accurate and reliable identification of COVID-19 infections when using deep transfer learning. This would be extremely beneficial in this pandemic when the disease burden and the need for preventive measures are in conflict with the currently available resources.

[1]  Daniel S. Kermany,et al.  Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning , 2018, Cell.

[2]  B. Pan,et al.  Understanding of COVID‐19 based on current evidence , 2020, Journal of medical virology.

[3]  N. Müller,et al.  Fleischner Society: glossary of terms for thoracic imaging. , 2008, Radiology.

[4]  David M. W. Powers,et al.  Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation , 2011, ArXiv.

[5]  Kayhan Zrar Ghafoor,et al.  Diagnosing COVID-19 pneumonia from x-ray and CT images using deep learning and transfer learning algorithms , 2020, Defense + Commercial Sensing.

[6]  Evaluation of deep learning-based approaches for COVID-19 classification based on chest X-ray images , 2021, Signal, image and video processing.

[7]  Prabira Kumar Sethy,et al.  Detection of Coronavirus Disease (COVID-19) Based on Deep Features , 2020 .

[8]  Ioannis D. Apostolopoulos,et al.  Covid-19: automatic detection from X-ray images utilizing transfer learning with convolutional neural networks , 2020, Physical and Engineering Sciences in Medicine.

[9]  Aditya Khamparia,et al.  A Novel Transfer Learning Based Approach for Pneumonia Detection in Chest X-ray Images , 2020, Applied Sciences.

[10]  Oscar Castillo,et al.  Early diagnosis of COVID-19-affected patients based on X-ray and computed tomography images using deep learning algorithm , 2020, Soft computing.

[11]  J. Civit-Masot,et al.  Deep Learning System for COVID-19 Diagnosis Aid Using X-ray Pulmonary Images , 2020 .

[12]  Ali Narin,et al.  Automatic detection of coronavirus disease (COVID-19) using X-ray images and deep convolutional neural networks , 2020, Pattern Analysis and Applications.

[13]  Mark Finkelstein,et al.  Clinical and Chest Radiography Features Determine Patient Outcomes in Young and Middle-aged Adults with COVID-19 , 2020, Radiology.

[14]  Douglas M. Hawkins,et al.  The Problem of Overfitting , 2004, J. Chem. Inf. Model..

[15]  Walaa Gouda,et al.  Chest X-ray findings monitoring COVID-19 disease course and severity , 2020, Egyptian Journal of Radiology and Nuclear Medicine.

[16]  Lequan Yu,et al.  Deep Mining External Imperfect Data for Chest X-Ray Disease Screening , 2020, IEEE Transactions on Medical Imaging.

[17]  Talha Burak Alakus,et al.  Convolutional capsnet: A novel artificial neural network approach to detect COVID-19 disease from X-ray images using capsule networks , 2020, Chaos, Solitons & Fractals.

[18]  Saleh Albahli,et al.  A Deep Neural Network to Distinguish COVID-19 from other Chest Diseases using X-ray Images. , 2020, Current medical imaging.

[19]  Inam ul Haq,et al.  Chest X-rays findings in COVID 19 patients at a University Teaching Hospital - A descriptive study , 2020, Pakistan journal of medical sciences.

[20]  Alexander Wong,et al.  COVID-Net: a tailored deep convolutional neural network design for detection of COVID-19 cases from chest X-ray images , 2020, Scientific reports.

[21]  Andrew Y. Ng,et al.  CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learning , 2017, ArXiv.

[22]  Abdul Hafeez,et al.  COVID-ResNet: A Deep Learning Framework for Screening of COVID19 from Radiographs , 2020, ArXiv.

[23]  Ezz El-Din Hemdan,et al.  COVIDX-Net: A Framework of Deep Learning Classifiers to Diagnose COVID-19 in X-Ray Images , 2020, ArXiv.

[24]  Amit Kumar Jaiswal,et al.  Identifying pneumonia in chest X-rays: A deep learning approach , 2019, Measurement.

[25]  U. Rajendra Acharya,et al.  Automated detection of COVID-19 cases using deep neural networks with X-ray images , 2020, Computers in Biology and Medicine.

[26]  Morteza Heidari,et al.  COVID-Classifier: An automated machine learning model to assist in the diagnosis of COVID-19 infection in chest x-ray images , 2020, medRxiv.

[27]  Mamun Bin Ibne Reaz,et al.  Can AI Help in Screening Viral and COVID-19 Pneumonia? , 2020, IEEE Access.

[28]  Mohamed Abd Elaziz,et al.  New machine learning method for image-based diagnosis of COVID-19 , 2020, PloS one.

[29]  Heshui Shi,et al.  Radiological findings from 81 patients with COVID-19 pneumonia in Wuhan, China: a descriptive study , 2020, The Lancet Infectious Diseases.

[30]  Z. Fayad,et al.  CT Imaging Features of 2019 Novel Coronavirus (2019-nCoV) , 2020, Radiology.

[31]  Asif Iqbal Khan,et al.  CoroNet: A deep neural network for detection and diagnosis of COVID-19 from chest x-ray images , 2020, Computer Methods and Programs in Biomedicine.

[32]  Sameer Antani,et al.  Visualization and Interpretation of Convolutional Neural Network Predictions in Detecting Pneumonia in Pediatric Chest Radiographs , 2018, Applied sciences.

[33]  Roberto Maroldi,et al.  COVID-19 outbreak in Italy: experimental chest X-ray scoring system for quantifying and monitoring disease progression , 2020, La radiologia medica.

[34]  Nitish Srivastava,et al.  Improving neural networks by preventing co-adaptation of feature detectors , 2012, ArXiv.

[35]  Sonali Agarwal,et al.  Automated diagnosis of COVID-19 with limited posteroanterior chest X-ray images using fine-tuned deep neural networks , 2020, Applied Intelligence.

[36]  Youness Chawki,et al.  Using X-ray images and deep learning for automated detection of coronavirus disease , 2020, Journal of biomolecular structure & dynamics.