COVID19XrayNet: A Two-Step Transfer Learning Model for the COVID-19 Detecting Problem Based on a Limited Number of Chest X-Ray Images

The novel coronavirus severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) has caused a major pandemic outbreak recently. Various diagnostic technologies have been under active development. The novel coronavirus disease (COVID-19) may induce pulmonary failures, and chest X-ray imaging becomes one of the major confirmed diagnostic technologies. The very limited number of publicly available samples has rendered the training of the deep neural networks unstable and inaccurate. This study proposed a two-step transfer learning pipeline and a deep residual network framework COVID19XrayNet for the COVID-19 detection problem based on chest X-ray images. COVID19XrayNet firstly tunes the transferred model on a large dataset of chest X-ray images, which is further tuned using a small dataset of annotated chest X-ray images. The final model achieved 0.9108 accuracy. The experimental data also suggested that the model may be improved with more training samples being released. Graphic abstract COVID19XrayNet, a two-step transfer learning framework designed for biomedical images.

[1]  Daniel S. Kermany,et al.  Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning , 2018, Cell.

[2]  Malik Peiris,et al.  Molecular Diagnosis of a Novel Coronavirus (2019-nCoV) Causing an Outbreak of Pneumonia , 2020, Clinical chemistry.

[3]  M. McHugh.  Interrater reliability: the kappa statistic , 2012, Biochemia medica.

[4]  Di Wu,et al.  pyHIVE, a health-related image visualization and engineering system using Python , 2018, BMC Bioinformatics.

[5]  Yuchun Fang,et al.  Improving LBP features for gender classification , 2008, 2008 International Conference on Wavelet Analysis and Pattern Recognition.

[6]  Dingchang Zheng,et al.  Evaluation of convolutional neural network for recognizing uterine contractions with electrohysterogram , 2019, Comput. Biol. Medicine.

[7]  Steven Horng,et al.  MIMIC-CXR, a de-identified publicly available database of chest radiographs with free-text reports , 2019, Scientific Data.

[8]  T. Velavan,et al.  The COVID‐19 epidemic , 2020, Tropical medicine & international health : TM & IH.

[9]  Yifan Yu,et al.  CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparison , 2019, AAAI.

[10]  Ah Chung Tsoi,et al.  Face recognition: a convolutional neural-network approach , 1997, IEEE Trans. Neural Networks.

[11]  Heechan Yang,et al.  Guided Soft Attention Network for Classification of Breast Cancer Histopathology Images , 2020, IEEE Transactions on Medical Imaging.

[12]  Yann LeCun,et al.  Convolutional networks and applications in vision , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[13]  Joseph Paul Cohen,et al.  COVID-19 Image Data Collection , 2020, ArXiv.

[14]  Eugenio Culurciello,et al.  ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation , 2016, ArXiv.

[15]  Guixia Kang,et al.  Breast Cancer Classification Based on Fully-Connected Layer First Convolutional Neural Networks , 2018, IEEE Access.

[16]  Jun Liu,et al.  Chest CT for Typical 2019-nCoV Pneumonia: Relationship to Negative RT-PCR Testing , 2020, Radiology.

[17]  F. Zhou,et al.  BioDog, biomarker detection for improving identification power of breast cancer histologic grade in methylomics. , 2019, Epigenomics.

[18]  Stefan Winkler,et al.  Deep Learning for Emotion Recognition on Small Datasets using Transfer Learning , 2015, ICMI.

[19]  Yanbing Ding,et al.  The epidemiology, diagnosis and treatment of COVID-19 , 2020, International Journal of Antimicrobial Agents.

[20]  Jialiang Li,et al.  TriZ-a rotation-tolerant image feature and its application in endoscope-based disease diagnosis , 2018, Comput. Biol. Medicine.

[21]  D. Murdoch,et al.  Clinical course and mortality risk of severe COVID-19 , 2020, The Lancet.

[22]  Ronald M. Summers,et al.  ChestX-ray: Hospital-Scale Chest X-ray Database and Benchmarks on Weakly Supervised Classification and Localization of Common Thorax Diseases , 2019, Deep Learning and Convolutional Neural Networks for Medical Imaging and Clinical Informatics.

[23]  Shaoqiang Li,et al.  Development and clinical application of a rapid IgM‐IgG combined antibody test for SARS‐CoV‐2 infection diagnosis , 2020, Journal of medical virology.

[24]  G. Onder,et al.  Case-Fatality Rate and Characteristics of Patients Dying in Relation to COVID-19 in Italy. , 2020, JAMA.

[25]  Luís A. Alexandre,et al.  DropAll: Generalization of Two Convolutional Neural Network Regularization Methods , 2014, ICIAR.

[26]  Kai Zhao,et al.  A pneumonia outbreak associated with a new coronavirus of probable bat origin , 2020, Nature.

[27]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Xiu-Shen Wei,et al.  PyRetri: A PyTorch-based Library for Unsupervised Image Retrieval by Deep Convolutional Neural Networks , 2020, ACM Multimedia.

[29]  Xudong Jiang,et al.  Human Detection by Quadratic Classification on Subspace of Extended Histogram of Gradients , 2014, IEEE Transactions on Image Processing.