CGNet: A graph-knowledge embedded convolutional neural network for detection of pneumonia

Pneumonia is a global disease that causes high children mortality. The situation has even been worsening by the outbreak of the new coronavirus named COVID-19, which has killed more than 983,907 so far. People infected by the virus would show symptoms like fever and coughing as well as pneumonia as the infection progresses. Timely detection is a public consensus achieved that would benefit possible treatments and therefore contain the spread of COVID-19. X-ray, an expedient imaging technique, has been widely used for the detection of pneumonia caused by COVID-19 and some other virus. To facilitate the process of diagnosis of pneumonia, we developed a deep learning framework for a binary classification task that classifies chest X-ray images into normal and pneumonia based on our proposed CGNet. In our CGNet, there are three components including feature extraction, graph-based feature reconstruction and classification. We first use the transfer learning technique to train the state-of-the-art convolutional neural networks (CNNs) for binary classification while the trained CNNs are used to produce features for the following two components. Then, by deploying graph-based feature reconstruction, we, therefore, combine features through the graph to reconstruct features. Finally, a shallow neural network named GNet, a one layer graph neural network, which takes the combined features as the input, classifies chest X-ray images into normal and pneumonia. Our model achieved the best accuracy at 0.9872, sensitivity at 1 and specificity at 0.9795 on a public pneumonia dataset that includes 5,856 chest X-ray images. To evaluate the performance of our proposed method on detection of pneumonia caused by COVID-19, we also tested the proposed method on a public COVID-19 CT dataset, where we achieved the highest performance at the accuracy of 0.99, specificity at 1 and sensitivity at 0.98, respectively.

[1]  S. Alavian,et al.  Nucleic Acid-Based Approaches for Detection of Viral Hepatitis , 2014, Jundishapur journal of microbiology.

[2]  Hongyu Wang,et al.  ChestNet: A Deep Neural Network for Classification of Thoracic Diseases on Chest Radiography , 2018, ArXiv.

[3]  George Loizou,et al.  Computer vision and pattern recognition , 2007, Int. J. Comput. Math..

[4]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[6]  Nimai Chand Das Adhikari Infection Severity Detection of CoVID19 from X-Rays and CT Scans Using Artificial Intelligence , 2020 .

[7]  Xindong Wu,et al.  Object Detection With Deep Learning: A Review , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Zheng Zhang,et al.  Generalized Incomplete Multiview Clustering With Flexible Locality Structure Diffusion , 2020, IEEE Transactions on Cybernetics.

[9]  Mamun Bin Ibne Reaz,et al.  Can AI Help in Screening Viral and COVID-19 Pneumonia? , 2020, IEEE Access.

[10]  Mohamed Medhat Gaber,et al.  Classification of COVID-19 in chest X-ray images using DeTraC deep convolutional neural network , 2020, Applied Intelligence.

[11]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Ling Shao,et al.  Binary Multi-View Clustering , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Ho-Young Jung,et al.  Rank‐weighted reconstruction feature for a robust deep neural network‐based acoustic model , 2019 .

[14]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Olac Fuentes,et al.  Object detection using image reconstruction with PCA , 2009, Image Vis. Comput..

[16]  Daniel S. Kermany,et al.  Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning , 2018, Cell.

[17]  X. He,et al.  Sample-Efficient Deep Learning for COVID-19 Diagnosis Based on CT Scans , 2020, medRxiv.

[18]  Sudanthi N. R. Wijewickrema,et al.  A Deep Transfer Learning Framework for Pneumonia Detection from Chest X-ray Images , 2020, VISIGRAPP.

[19]  Andrew Y. Ng,et al.  CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learning , 2017, ArXiv.

[20]  Ming-Ming Cheng,et al.  JCS: An Explainable COVID-19 Diagnosis System by Joint Classification and Segmentation , 2020, IEEE Transactions on Image Processing.

[21]  Dilbag Singh,et al.  Classification of the COVID-19 infected patients using DenseNet201 based deep transfer learning , 2020, Journal of biomolecular structure & dynamics.

[22]  P. Xie,et al.  COVID-CT-Dataset: A CT Scan Dataset about COVID-19 , 2020, ArXiv.

[23]  Zi Huang,et al.  Scalable Supervised Asymmetric Hashing With Semantic and Latent Factor Embedding , 2019, IEEE Transactions on Image Processing.

[24]  IEEE conference on computer vision and pattern recognition , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[25]  Bo Xu,et al.  A deep learning algorithm using CT images to screen for Corona virus disease (COVID-19) , 2020, European Radiology.

[26]  Ioannis D. Apostolopoulos,et al.  Covid-19: automatic detection from X-ray images utilizing transfer learning with convolutional neural networks , 2020, Physical and Engineering Sciences in Medicine.

[27]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[28]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[29]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Yicheng Fang,et al.  Sensitivity of Chest CT for COVID-19: Comparison to RT-PCR , 2020, Radiology.

[31]  Ling Shao,et al.  Discriminative Fisher Embedding Dictionary Learning Algorithm for Object Recognition , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[32]  N. K. Bose,et al.  Neural Network Fundamentals with Graphs, Algorithms and Applications , 1995 .

[33]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[34]  Hyun Jung Koo,et al.  Radiographic and CT Features of Viral Pneumonia. , 2018, Radiographics : a review publication of the Radiological Society of North America, Inc.

[35]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Zi Huang,et al.  Inductive Structure Consistent Hashing via Flexible Semantic Calibration , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[37]  Chuanming Li,et al.  The Clinical and Chest CT Features Associated With Severe and Critical COVID-19 Pneumonia , 2020, Investigative radiology.

[38]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[39]  S. U. K. Bukhari,et al.  The diagnostic evaluation of Convolutional Neural Network (CNN) for the assessment of chest X-ray of patients infected with COVID-19 , 2020, medRxiv.

[40]  Forrest N. Iandola,et al.  SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size , 2016, ArXiv.

[41]  Lixin Zheng,et al.  A transfer learning method with deep residual network for pediatric pneumonia diagnosis , 2020, Comput. Methods Programs Biomed..

[42]  Y. Chen,et al.  PIN92 PEDIATRIC BACTERIAL PNEUMONIA CLASSIFICATION THROUGH CHEST X-RAYS USING TRANSFER LEARNING , 2019, Value in Health.

[43]  Nour Eldeen M. Khalifa,et al.  A deep transfer learning model with classical data augmentation and CGAN to detect COVID-19 from chest CT radiography digital images , 2020, Neural computing & applications.

[44]  Heng Tao Shen,et al.  Heterogeneous data fusion for predicting mild cognitive impairment conversion , 2021, Inf. Fusion.

[45]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.