Classification of COVID-19 pneumonia from chest CT images based on reconstructed super-resolution images and VGG neural network

The COVID-19 coronavirus has spread rapidly around the world and has caused global panic. Chest CT images play a major role in confirming positive COVID-19 patients. The computer aided diagnosis of COVID-19 from CT images based on artificial intelligence have been developed and deployed in some hospitals. But environmental influences and the movement of lung will affect the image quality, causing the lung parenchyma and pneumonia area unclear in CT images. Therefore, the performance of COVID-19’s artificial intelligence diagnostic algorithm is reduced. If chest CT images are reconstructed, the accuracy and performance of the aided diagnostic algorithm may be improved. In this paper, a new aided diagnostic algorithm for COVID-19 based on super-resolution reconstructed images and convolutional neural network is presented. Firstly, the SRGAN neural network is used to reconstruct super-resolution images from original chest CT images. Then COVID-19 images and Non-COVID-19 images are classified from super-resolution chest CT images by VGG16 neural network. Finally, the performance of this method is verified by the pubic COVID-CT dataset and compared with other aided diagnosis methods of COVID-19. The experimental results show that improving the data quality through SRGAN neural network can greatly improve the final classification accuracy when the data quality is low. This proves that this method can obtain high accuracy, sensitivity and specificity in the examined test image datasets and has similar performance to other state-of-the-art deep learning aided algorithms.

[1]  Mirabela Rusu,et al.  An Application of Generative Adversarial Networks for Super Resolution Medical Imaging , 2018, 2018 17th IEEE International Conference on Machine Learning and Applications (ICMLA).

[2]  Victor S. Lempitsky,et al.  Neural Codes for Image Retrieval , 2014, ECCV.

[3]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[4]  Lian-lian Wu,et al.  Deep learning-based model for detecting 2019 novel coronavirus pneumonia on high-resolution computed tomography: a prospective study , 2020, medRxiv.

[5]  Chunhua Shen,et al.  COVID-19 Screening on Chest X-ray Images Using Deep Learning based Anomaly Detection , 2020, ArXiv.

[6]  Jun Chen,et al.  Deep learning-based model for detecting 2019 novel coronavirus pneumonia on high-resolution computed tomography , 2020, Scientific Reports.

[7]  Amy Berrington de González,et al.  Risk of cancer from diagnostic X-rays: estimates for the UK and 14 other countries , 2004, The Lancet.

[8]  B. Zikmund‐Fisher,et al.  Vaccine Hesitancy and Rejection of a Vaccine for the Novel Coronavirus in the United States , 2021, Frontiers in Immunology.

[9]  K. Cao,et al.  Artificial Intelligence Distinguishes COVID-19 from Community Acquired Pneumonia on Chest CT , 2020, Radiology.

[10]  Mirto Musci,et al.  Deep Recurrent Neural Networks for Edge Monitoring of Personal Risk and Warning Situations , 2019, Sci. Program..

[11]  Junchao Li,et al.  Super Resolution Image Reconstruction of Textile Based on SRGAN , 2019, 2019 IEEE International Conference on Smart Internet of Things (SmartIoT).

[12]  Alexander Wong,et al.  COVID-Net: A Tailored Deep Convolutional Neural Network Design for Detection of COVID-19 Cases from Chest Radiography Images , 2020, ArXiv.

[13]  Ge Wang,et al.  Machine learning will transform radiology significantly within the next 5 years. , 2017, Medical physics.

[14]  D. Cummings,et al.  Novel coronavirus 2019-nCoV: early estimation of epidemiological parameters and epidemic predictions , 2020, medRxiv.

[15]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[16]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  D. Brenner,et al.  Computed tomography--an increasing source of radiation exposure. , 2007, The New England journal of medicine.

[18]  S. Lindstrom,et al.  First Case of 2019 Novel Coronavirus in the United States , 2020, The New England journal of medicine.

[19]  Hayit Greenspan,et al.  Rapid AI Development Cycle for the Coronavirus (COVID-19) Pandemic: Initial Results for Automated Detection & Patient Monitoring using Deep Learning CT Image Analysis , 2020, ArXiv.

[20]  P. Xie,et al.  COVID-CT-Dataset: A CT Scan Dataset about COVID-19 , 2020, ArXiv.

[21]  Christian Ledig,et al.  Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Yaozong Gao,et al.  Large-scale screening to distinguish between COVID-19 and community-acquired pneumonia using infection size-aware classification , 2021, Physics in medicine and biology.

[23]  Feng Zhou,et al.  Automatic Target Recognition for Synthetic Aperture Radar Images Based on Super-Resolution Generative Adversarial Network and Deep Convolutional Neural Network , 2019, Remote. Sens..

[24]  Wenyu Liu,et al.  Deep Learning-based Detection for COVID-19 from Chest CT using Weak Label , 2020, medRxiv.

[25]  Jianming Wang,et al.  AI-assisted CT imaging analysis for COVID-19 screening: Building and deploying a medical AI system , 2020, Applied Soft Computing.

[26]  Ali Narin,et al.  Automatic detection of coronavirus disease (COVID-19) using X-ray images and deep convolutional neural networks , 2020, Pattern Analysis and Applications.

[27]  Ioannis D. Apostolopoulos,et al.  Extracting Possibly Representative COVID-19 Biomarkers from X-ray Images with Deep Learning Approach and Image Data Related to Pulmonary Diseases , 2020, Journal of Medical and Biological Engineering.

[28]  Ezz El-Din Hemdan,et al.  COVIDX-Net: A Framework of Deep Learning Classifiers to Diagnose COVID-19 in X-Ray Images , 2020, ArXiv.

[29]  P. Horby,et al.  A novel coronavirus outbreak of global health concern , 2020, The Lancet.

[30]  Kaijin Xu,et al.  A Deep Learning System to Screen Novel Coronavirus Disease 2019 Pneumonia , 2020, Engineering.

[31]  Jeffrey A. Fessler,et al.  Image Reconstruction is a New Frontier of Machine Learning , 2018, IEEE Transactions on Medical Imaging.

[32]  Dinggang Shen,et al.  Severity Assessment of Coronavirus Disease 2019 (COVID-19) Using Quantitative Features from Chest CT Images , 2020, ArXiv.

[33]  G. Leung,et al.  Nowcasting and forecasting the potential domestic and international spread of the 2019-nCoV outbreak originating in Wuhan, China: a modelling study , 2020, The Lancet.

[34]  M. Kuo,et al.  Frequency and Distribution of Chest Radiographic Findings in COVID-19 Positive Patients , 2019, Radiology.

[35]  Haibo Xu,et al.  AI-assisted CT imaging analysis for COVID-19 screening: Building and deploying a medical AI system in four weeks , 2020, medRxiv.

[36]  Kayhan Zrar Ghafoor,et al.  Diagnosing COVID-19 pneumonia from x-ray and CT images using deep learning and transfer learning algorithms , 2020, Defense + Commercial Sensing.

[37]  Ali Idri,et al.  Automated Methods for Detection and Classification Pneumonia based on X-Ray Images Using Deep Learning , 2020, Studies in Big Data.

[38]  B. Song,et al.  Chest CT manifestations of new coronavirus disease 2019 (COVID-19): a pictorial review , 2020, European Radiology.

[39]  Alexander Wong,et al.  COVID-Net: a tailored deep convolutional neural network design for detection of COVID-19 cases from chest X-ray images , 2020, Scientific reports.

[40]  A. Chandler,et al.  Effect of duration of scan acquisition on CT perfusion parameter values in primary and metastatic tumors in the lung. , 2013, European journal of radiology.

[41]  Hayit Greenspan,et al.  Chest pathology detection using deep learning with non-medical training , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[42]  Jing Zhao,et al.  Early Transmission Dynamics in Wuhan, China, of Novel Coronavirus–Infected Pneumonia , 2020, The New England journal of medicine.

[43]  M. Koopmans,et al.  A Novel Coronavirus Emerging in China - Key Questions for Impact Assessment. , 2020, The New England journal of medicine.

[44]  David Stutz,et al.  Neural Codes for Image Retrieval , 2015 .

[45]  Jie Zhou,et al.  Development and Evaluation of an AI System for COVID-19 , 2020, medRxiv.

[46]  U. Rajendra Acharya,et al.  Deep convolutional neural network for the automated detection and diagnosis of seizure using EEG signals , 2017, Comput. Biol. Medicine.

[47]  K. Cao,et al.  Using Artificial Intelligence to Detect COVID-19 and Community-acquired Pneumonia Based on Pulmonary CT: Evaluation of the Diagnostic Accuracy , 2020 .

[48]  Hoo-Chang Hoo-Chang Shin Shin,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, Ieee Transactions on Medical Imaging.

[49]  Mohamed Medhat Gaber,et al.  Classification of COVID-19 in chest X-ray images using DeTraC deep convolutional neural network , 2020, Applied Intelligence.

[50]  Yuedong Yang,et al.  Deep Learning Enables Accurate Diagnosis of Novel Coronavirus (COVID-19) With CT Images , 2020, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[51]  Mamun Bin Ibne Reaz,et al.  Can AI Help in Screening Viral and COVID-19 Pneumonia? , 2020, IEEE Access.

[52]  Wenjun Ma,et al.  Transmission dynamics of 2019 novel coronavirus (2019-nCoV) , 2020, bioRxiv.

[53]  Lei Zhang,et al.  Fine-Tuning Convolutional Neural Networks for Biomedical Image Analysis: Actively and Incrementally , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[54]  Dinggang Shen,et al.  Review of Artificial Intelligence Techniques in Imaging Data Acquisition, Segmentation, and Diagnosis for COVID-19 , 2020, IEEE Reviews in Biomedical Engineering.

[55]  Bo Xu,et al.  A deep learning algorithm using CT images to screen for Corona virus disease (COVID-19) , 2020, European Radiology.

[56]  Ning Gu,et al.  A novel calibration method incorporating nonlinear optimization and ball‐bearing markers for cone‐beam CT with a parameterized trajectory , 2018, Medical physics.

[57]  Alexandra Luccioni,et al.  Mapping the Landscape of Artificial Intelligence Applications against COVID-19 , 2020, J. Artif. Intell. Res..