A Review on Deep Learning Techniques for the Diagnosis of Novel Coronavirus (COVID-19)

Novel coronavirus (COVID-19) outbreak, has raised a calamitous situation all over the world and has become one of the most acute and severe ailments in the past hundred years. The prevalence rate of COVID-19 is rapidly rising every day throughout the globe. Although no vaccines for this pandemic have been discovered yet, deep learning techniques proved themselves to be a powerful tool in the arsenal used by clinicians for the automatic diagnosis of COVID-19. This paper aims to overview the recently developed systems based on deep learning techniques using different medical imaging modalities like Computer Tomography (CT) and X-ray. This review specifically discusses the systems developed for COVID-19 diagnosis using deep learning techniques and provides insights on well-known data sets used to train these networks. It also highlights the data partitioning techniques and various performance measures developed by researchers in this field. A taxonomy is drawn to categorize the recent works for proper insight. Finally, we conclude by addressing the challenges associated with the use of deep learning methods for COVID-19 detection and probable future trends in this research area. The aim of this paper is to facilitate experts (medical or otherwise) and technicians in understanding the ways deep learning techniques are used in this regard and how they can be potentially further utilized to combat the outbreak of COVID-19.

[1]  Yuan Gao,et al.  Weakly Supervised Deep Learning for COVID-19 Infection Detection and Classification From CT Images , 2020, IEEE Access.

[2]  S. Haseli,et al.  ai-corona: Radiologist-assistant deep learning framework for COVID-19 diagnosis in chest CT scans , 2020, medRxiv.

[3]  Wenyu Liu,et al.  A Weakly-Supervised Framework for COVID-19 Classification and Lesion Localization From Chest CT , 2020, IEEE Transactions on Medical Imaging.

[4]  Jianjiang Feng,et al.  Development and evaluation of an artificial intelligence system for COVID-19 diagnosis , 2020, Nature Communications.

[5]  Abdul Hafeez,et al.  COVID-ResNet: A Deep Learning Framework for Screening of COVID19 from Radiographs , 2020, ArXiv.

[6]  Ronald M. Summers,et al.  ChestX-ray: Hospital-Scale Chest X-ray Database and Benchmarks on Weakly Supervised Classification and Localization of Common Thorax Diseases , 2019, Deep Learning and Convolutional Neural Networks for Medical Imaging and Clinical Informatics.

[7]  J. Crowcroft,et al.  Leveraging Data Science to Combat COVID-19: A Comprehensive Review , 2020, IEEE Transactions on Artificial Intelligence.

[8]  E. Goldberg,et al.  15 Smartphone Apps for Older Adults to Use While in Isolation During the COVID-19 Pandemic , 2020, The western journal of emergency medicine.

[9]  Predictive Data Mining Models for Novel Coronavirus (COVID-19) Infected Patients’ Recovery , 2020, SN Comput. Sci..

[10]  Deniz Korkmaz,et al.  COVIDiagnosis-Net: Deep Bayes-SqueezeNet based diagnosis of the coronavirus disease 2019 (COVID-19) from X-ray images , 2020, Medical Hypotheses.

[11]  Sameer K. Antani,et al.  Iteratively Pruned Deep Learning Ensembles for COVID-19 Detection in Chest X-Rays , 2020, IEEE Access.

[12]  Haipeng Shen,et al.  Artificial intelligence in healthcare: past, present and future , 2017, Stroke and Vascular Neurology.

[13]  Becky McCall,et al.  COVID-19 and artificial intelligence: protecting health-care workers and curbing the spread , 2020, The Lancet Digital Health.

[14]  Md. Rashedul Islam,et al.  Development of Smart Healthcare Monitoring System in IoT Environment , 2020, SN Computer Science.

[15]  Ruben Morales-Menendez,et al.  Application of deep learning for fast detection of COVID-19 in X-Rays using nCOVnet , 2020, Chaos, Solitons & Fractals.

[16]  Dalia Ezzat,et al.  GSA-DenseNet121-COVID-19: a Hybrid Deep Learning Architecture for the Diagnosis of COVID-19 Disease based on Gravitational Search Optimization Algorithm , 2020, ArXiv.

[17]  ShanmugaSundari N,et al.  Automatic COVID-19 Lung Infection Segmentation from CT Images , 2021, SSRN Electronic Journal.

[18]  K. Cao,et al.  Artificial Intelligence Distinguishes COVID-19 from Community Acquired Pneumonia on Chest CT , 2020, Radiology.

[19]  G. Heinze,et al.  Prediction models for diagnosis and prognosis of covid-19: systematic review and critical appraisal , 2020, BMJ.

[20]  Loris Nanni,et al.  A critic evaluation of methods for COVID-19 automatic detection from X-ray images , 2020, Information Fusion.

[21]  A. E. Hassanien,et al.  Diagnosis and Prediction Model for COVID19 Patients Response to Treatment based on Convolutional Neural Networks and Whale Optimization Algorithm Using CT Images , 2020, medRxiv.

[22]  Hatem Khater,et al.  A Novel Approach of CT Images Feature Analysis and Prediction to Screen for Corona Virus Disease (COVID-19) , 2020, International Journal of Scientific & Engineering Research.

[23]  A. Wong,et al.  COVID-Net: a tailored deep convolutional neural network design for detection of COVID-19 cases from chest X-ray images , 2020, Scientific Reports.

[24]  Mohammad Rahimzadeh,et al.  A modified deep convolutional neural network for detecting COVID-19 and pneumonia from chest X-ray images based on the concatenation of Xception and ResNet50V2 , 2020, Informatics in Medicine Unlocked.

[25]  Richard D Riley,et al.  Prediction models for diagnosis and prognosis of covid-19: systematic review and critical appraisal , 2020, BMJ.

[26]  Raju Vaishya,et al.  COVID-19 and applications of smartphone technology in the current pandemic , 2020, Diabetes & Metabolic Syndrome: Clinical Research & Reviews.

[27]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[28]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  P. Shah,et al.  Prevention is Better than Cure: An Application of Big Data and Geospatial Technology in Mitigating Pandemic , 2020, Transactions of the Indian National Academy of Engineering.

[30]  B. Song,et al.  Chest CT manifestations of new coronavirus disease 2019 (COVID-19): a pictorial review , 2020, European Radiology.

[31]  R. Suman,et al.  Internet of things (IoT) applications to fight against COVID-19 pandemic , 2020, Diabetes & Metabolic Syndrome: Clinical Research & Reviews.

[32]  Chirag Agarwal,et al.  CoroNet: A Deep Network Architecture for Semi-Supervised Task-Based Identification of COVID-19 from Chest X-ray Images , 2020, medRxiv.

[33]  D. Cucinotta,et al.  WHO Declares COVID-19 a Pandemic , 2020, Acta bio-medica : Atenei Parmensis.

[34]  Ankita Srivastava,et al.  A review of modern technologies for tackling COVID-19 pandemic , 2020, Diabetes & Metabolic Syndrome: Clinical Research & Reviews.

[35]  Haibo Xu,et al.  AI-assisted CT imaging analysis for COVID-19 screening: Building and deploying a medical AI system in four weeks , 2020, medRxiv.

[36]  Daniel S. Kermany,et al.  Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning , 2018, Cell.

[37]  Fatemeh Homayounieh,et al.  CovidCTNet: An Open-Source Deep Learning Approach to Identify Covid-19 Using CT Image , 2020, ArXiv.

[38]  Asif Iqbal Khan,et al.  CoroNet: A deep neural network for detection and diagnosis of COVID-19 from chest x-ray images , 2020, Computer Methods and Programs in Biomedicine.

[39]  C. Mohanty,et al.  Application of cognitive Internet of Medical Things for COVID-19 pandemic , 2020, Diabetes & Metabolic Syndrome: Clinical Research & Reviews.

[40]  Bo Xu,et al.  A deep learning algorithm using CT images to screen for Corona virus disease (COVID-19) , 2020, European Radiology.

[41]  Pierre G. B. Moutounet-Cartan.  Deep Convolutional Neural Networks to Diagnose COVID-19 and other Pneumonia Diseases from Posteroanterior Chest X-Rays , 2020, ArXiv.

[42]  Janmenjoy Nayak,et al.  Role of intelligent computing in COVID-19 prognosis: A state-of-the-art review , 2020, Chaos, Solitons & Fractals.

[43]  Andre Esteva,et al.  A guide to deep learning in healthcare , 2019, Nature Medicine.

[44]  Tayyip Ozcan.  A Deep Learning Framework for Coronavirus Disease (COVID-19) Detection in X-Ray Images , 2020 .

[45]  Sonali Agarwal,et al.  Automated diagnosis of COVID-19 with limited posteroanterior chest X-ray images using fine-tuned deep neural networks , 2020, Applied Intelligence.

[46]  A. Amyar,et al.  Multi-task Deep Learning Based CT Imaging Analysis For COVID-19: Classification and Segmentation , 2020, medRxiv.

[47]  Z. Fayad,et al.  Artificial intelligence–enabled rapid diagnosis of patients with COVID-19 , 2020, Nature Medicine.

[48]  Eduardo José da S. Luz,et al.  Towards an effective and efficient deep learning model for COVID-19 patterns detection in X-ray images , 2020, Research on Biomedical Engineering.

[49]  Dinggang Shen,et al.  Review of Artificial Intelligence Techniques in Imaging Data Acquisition, Segmentation, and Diagnosis for COVID-19 , 2020, IEEE Reviews in Biomedical Engineering.

[50]  Syed Muhammad Anwar,et al.  Medical Image Analysis using Convolutional Neural Networks: A Review , 2017, Journal of Medical Systems.

[51]  Deepak Gupta,et al.  CovidGAN: Data Augmentation Using Auxiliary Classifier GAN for Improved Covid-19 Detection , 2020, IEEE Access.

[52]  Yi He,et al.  Preparation of novel high copper ions removal membranes by embedding organosilane‐functionalized multi‐walled carbon nanotube , 2016 .

[53]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[54]  Eleftherios Trivizakis,et al.  Interpretable artificial intelligence framework for COVID-19 screening on chest X-rays , 2020, Experimental and therapeutic medicine.

[55]  Florentin Smarandache,et al.  Trends in deep convolutional neural Networks architectures: a review , 2019, 2019 International Conference of Computer Science and Renewable Energies (ICCSRE).

[56]  Yuedong Yang,et al.  Deep Learning Enables Accurate Diagnosis of Novel Coronavirus (COVID-19) With CT Images , 2020, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[57]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[58]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[59]  Y. Hu,et al.  Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China , 2020, The Lancet.

[60]  Mohamed Medhat Gaber,et al.  Classification of COVID-19 in chest X-ray images using DeTraC deep convolutional neural network , 2020, Applied Intelligence.

[61]  M. Z. Islam,et al.  A combined deep CNN-LSTM network for the detection of novel coronavirus (COVID-19) using X-ray images , 2020, Informatics in Medicine Unlocked.

[62]  Florentin Smarandache,et al.  Within the Lack of Chest COVID-19 X-ray Dataset: A Novel Detection Model Based on GAN and Deep Transfer Learning , 2020, Symmetry.

[63]  Youness Chawki,et al.  Using X-ray images and deep learning for automated detection of coronavirus disease , 2020, Journal of biomolecular structure & dynamics.

[64]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[65]  M. Schibler,et al.  Clinical features of covid-19 , 2020, BMJ.

[66]  Jun Liu,et al.  Chest CT for Typical 2019-nCoV Pneumonia: Relationship to Negative RT-PCR Testing , 2020, Radiology.

[67]  Milan Sonka,et al.  Deep-COVID: Predicting COVID-19 from chest X-ray images using deep transfer learning , 2020, Medical Image Analysis.

[68]  Kaushik Roy,et al.  Shallow Convolutional Neural Network for COVID-19 Outbreak Screening Using Chest X-rays , 2020, Cogn. Comput..

[69]  Su Ruan,et al.  Multi-task deep learning based CT imaging analysis for COVID-19 pneumonia: Classification and segmentation , 2020, Computers in Biology and Medicine.

[70]  Manoranjan Paul,et al.  COVID-19 Control by Computer Vision Approaches: A Survey , 2020, IEEE Access.

[71]  Q. Tao,et al.  Correlation of Chest CT and RT-PCR Testing in Coronavirus Disease 2019 (COVID-19) in China: A Report of 1014 Cases , 2020, Radiology.

[72]  Wenyu Liu,et al.  Deep Learning-based Detection for COVID-19 from Chest CT using Weak Label , 2020, medRxiv.

[73]  Antoine Geissbühler,et al.  Building a reference multimedia database for interstitial lung diseases , 2012, Comput. Medical Imaging Graph..

[74]  Ioannis D. Apostolopoulos,et al.  Covid-19: automatic detection from X-ray images utilizing transfer learning with convolutional neural networks , 2020, Physical and Engineering Sciences in Medicine.

[75]  N. Adami,et al.  End-to-end learning for semiquantitative rating of COVID-19 severity on Chest X-rays , 2020, ArXiv.

[76]  P. Xie,et al.  COVID-CT-Dataset: A CT Scan Dataset about COVID-19 , 2020, ArXiv.

[77]  Manoranjan Paul,et al.  Computer Vision for COVID-19 Control: A Survey , 2020, ArXiv.

[78]  Richard C. Pais,et al.  The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): a completed reference database of lung nodules on CT scans. , 2011, Medical physics.

[79]  Clement J. McDonald,et al.  Lung Segmentation in Chest Radiographs Using Anatomical Atlases With Nonrigid Registration , 2014, IEEE Transactions on Medical Imaging.

[80]  Thomas Blaschke,et al.  The rise of deep learning in drug discovery. , 2018, Drug discovery today.

[81]  H. Kauczor,et al.  The Role of Chest Imaging in Patient Management during the COVID-19 Pandemic: A Multinational Consensus Statement from the Fleischner Society , 2020, Radiology.

[82]  Yifan Yu,et al.  CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparison , 2019, AAAI.

[83]  Michael Wainberg,et al.  Deep learning in biomedicine , 2018, Nature Biotechnology.

[84]  Chris Yakopcic,et al.  A State-of-the-Art Survey on Deep Learning Theory and Architectures , 2019, Electronics.

[85]  Charmaine Butt,et al.  Deep learning system to screen coronavirus disease 2019 pneumonia , 2020, Applied Intelligence.

[86]  Forrest N. Iandola,et al.  SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size , 2016, ArXiv.

[87]  Q. Tao,et al.  Serial Quantitative Chest CT Assessment of COVID-19: A Deep Learning Approach , 2020, Radiology. Cardiothoracic imaging.

[88]  Hyunsook Hong,et al.  Diagnostic Performance of CT and Reverse Transcriptase-Polymerase Chain Reaction for Coronavirus Disease 2019: A Meta-Analysis , 2020, Radiology.

[89]  E. Holmes,et al.  A new coronavirus associated with human respiratory disease in China , 2020, Nature.

[90]  Farnoosh Naderkhani,et al.  COVID-CAPS: A capsule network-based framework for identification of COVID-19 cases from X-ray images , 2020, Pattern Recognition Letters.

[91]  M. Javaid,et al.  Artificial Intelligence (AI) applications for COVID-19 pandemic , 2020, Diabetes & Metabolic Syndrome: Clinical Research & Reviews.

[92]  Prabira Kumar Sethy,et al.  Detection of Coronavirus Disease (COVID-19) Based on Deep Features , 2020 .

[93]  A. Abbas,et al.  4S-DT: Self-Supervised Super Sample Decomposition for Transfer Learning With Application to COVID-19 Detection , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[94]  Jwan K. Alwan,et al.  Role of biological Data Mining and Machine Learning Techniques in Detecting and Diagnosing the Novel Coronavirus (COVID-19): A Systematic Review , 2020, Journal of Medical Systems.

[95]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[96]  Traian Rebedea,et al.  A self-supervised neural-analytic method to predict the evolution of COVID-19 in Romania , 2020, ArXiv.

[97]  Zhaoning Zhang,et al.  Fd-Mobilenet: Improved Mobilenet with a Fast Downsampling Strategy , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[98]  K. Yeom,et al.  End-to-end automatic differentiation of the coronavirus disease 2019 (COVID-19) from viral pneumonia based on chest CT , 2020, European Journal of Nuclear Medicine and Molecular Imaging.

[99]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[100]  Vijayan K. Asari,et al.  COVID_MTNet: COVID-19 Detection with Multi-Task Deep Learning Approaches , 2020, ArXiv.

[101]  J. Kanne,et al.  Chest CT Findings in 2019 Novel Coronavirus (2019-nCoV) Infections from Wuhan, China: Key Points for the Radiologist , 2020, Radiology.

[102]  Ahmed Hosny,et al.  Artificial intelligence in radiology , 2018, Nature Reviews Cancer.

[103]  Lawrence Carin,et al.  Digital technology and COVID-19 , 2020, Nature Medicine.

[104]  S. U. K. Bukhari,et al.  The diagnostic evaluation of Convolutional Neural Network (CNN) for the assessment of chest X-ray of patients infected with COVID-19 , 2020, medRxiv.

[105]  X. He,et al.  Sample-Efficient Deep Learning for COVID-19 Diagnosis Based on CT Scans , 2020, medRxiv.

[106]  Clement J. McDonald,et al.  Automatic Tuberculosis Screening Using Chest Radiographs , 2014, IEEE Transactions on Medical Imaging.

[107]  M. Javaid,et al.  Significant Applications of Big Data in COVID-19 Pandemic , 2020, Indian Journal of Orthopaedics.

[108]  Yuanjie Zheng,et al.  Robust Screening of COVID-19 from Chest X-ray via Discriminative Cost-Sensitive Learning , 2020, ArXiv.

[109]  U. Rajendra Acharya,et al.  Application of deep learning technique to manage COVID-19 in routine clinical practice using CT images: Results of 10 convolutional neural networks , 2020, Computers in Biology and Medicine.

[110]  Raymond Y Huang,et al.  AI Augmentation of Radiologist Performance in Distinguishing COVID-19 from Pneumonia of Other Etiology on Chest CT , 2020, Radiology.

[111]  Jun Chen,et al.  Deep learning-based model for detecting 2019 novel coronavirus pneumonia on high-resolution computed tomography , 2020, Scientific Reports.

[112]  Y. Yang,et al.  Assisting scalable diagnosis automatically via CT images in the combat against COVID-19 , 2020, Scientific Reports.

[113]  Michael J. Horry,et al.  X-Ray Image based COVID-19 Detection using Pre-trained Deep Learning Models , 2020 .

[114]  Yandre M. G. Costa,et al.  COVID-19 identification in chest X-ray images on flat and hierarchical classification scenarios , 2020, Computer Methods and Programs in Biomedicine.

[115]  Ali Narin,et al.  Automatic detection of coronavirus disease (COVID-19) using X-ray images and deep convolutional neural networks , 2020, Pattern Analysis and Applications.

[116]  B. K. Panigrahi,et al.  Transfer learning–based ensemble support vector machine model for automated COVID-19 detection using lung computerized tomography scan data , 2020, Medical & Biological Engineering & Computing.

[117]  Christoph Meinel,et al.  Deep Learning for Medical Image Analysis , 2018, Journal of Pathology Informatics.

[118]  Karen Drukker,et al.  LUNGx Challenge for computerized lung nodule classification , 2016, Journal of medical imaging.

[119]  Ezz El-Din Hemdan,et al.  COVIDX-Net: A Framework of Deep Learning Classifiers to Diagnose COVID-19 in X-Ray Images , 2020, ArXiv.

[120]  Lian-lian Wu,et al.  Deep learning-based model for detecting 2019 novel coronavirus pneumonia on high-resolution computed tomography: a prospective study , 2020, medRxiv.

[121]  Joseph Paul Cohen,et al.  COVID-19 Image Data Collection , 2020, ArXiv.

[122]  Md. Rashedul Islam,et al.  Developing IoT Based Smart Health Monitoring Systems: A Review , 2019, Rev. d'Intelligence Artif..

[123]  M. Cifci.  Deep Learning Model for Diagnosis of Corona Virus Disease from CT Images , 2020 .

[124]  Vaishali,et al.  Classification of COVID-19 patients from chest CT images using multi-objective differential evolution–based convolutional neural networks , 2020, European Journal of Clinical Microbiology & Infectious Diseases.

[125]  D. Dong,et al.  The Role of Imaging in the Detection and Management of COVID-19: A Review , 2020, IEEE Reviews in Biomedical Engineering.

[126]  Michael H. Goldbaum,et al.  Labeled Optical Coherence Tomography (OCT) and Chest X-Ray Images for Classification , 2018 .

[127]  Ling Shao,et al.  Inf-Net: Automatic COVID-19 Lung Infection Segmentation From CT Images , 2020, IEEE Transactions on Medical Imaging.

[128]  Lixin Zheng,et al.  Combining Convolutional Neural Network With Recursive Neural Network for Blood Cell Image Classification , 2018, IEEE Access.

[129]  Jie Tian,et al.  Deep learning-based multi-view fusion model for screening 2019 novel coronavirus pneumonia: A multicentre study , 2020, European Journal of Radiology.

[130]  Transfer learning–based ensemble support vector machine model for automated COVID-19 detection using lung computerized tomography scan data , 2021, Medical Biol. Eng. Comput..

[131]  S. Rajaraman,et al.  Weakly Labeled Data Augmentation for Deep Learning: A Study on COVID-19 Detection in Chest X-Rays , 2020, Diagnostics.

[132]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[133]  U. Rajendra Acharya,et al.  Automated detection of COVID-19 cases using deep neural networks with X-ray images , 2020, Computers in Biology and Medicine.

[134]  Rabha W. Ibrahim,et al.  Classification of Covid-19 Coronavirus, Pneumonia and Healthy Lungs in CT Scans Using Q-Deformed Entropy and Deep Learning Features , 2020, Entropy.

[135]  Xiaohu Li,et al.  COVID-19 Infection Presenting with CT Halo Sign , 2020, Radiology. Cardiothoracic imaging.

[136]  Jie Zhou,et al.  Development and Evaluation of an AI System for COVID-19 , 2020, medRxiv.

[137]  K. Cao,et al.  Using Artificial Intelligence to Detect COVID-19 and Community-acquired Pneumonia Based on Pulmonary CT: Evaluation of the Diagnostic Accuracy , 2020 .

[138]  Jong Chul Ye,et al.  Deep Learning COVID-19 Features on CXR Using Limited Training Data Sets , 2020, IEEE Transactions on Medical Imaging.