Triage of potential COVID-19 patients from chest X-ray images using hierarchical convolutional networks

The current COVID-19 pandemic has motivated the researchers to use artificial intelligence techniques for a potential alternative to reverse transcription-polymerase chain reaction due to the limited scale of testing. The chest X-ray (CXR) is one of the alternatives to achieve fast diagnosis, but the unavailability of large-scale annotated data makes the clinical implementation of machine learning-based COVID detection difficult. Another issue is the usage of ImageNet pre-trained networks which does not extract reliable feature representations from medical images. In this paper, we propose the use of hierarchical convolutional network (HCN) architecture to naturally augment the data along with diversified features. The HCN uses the first convolution layer from COVIDNet followed by the convolutional layers from well-known pre-trained networks to extract the features. The use of the convolution layer from COVIDNet ensures the extraction of representations relevant to the CXR modality. We also propose the use of ECOC for encoding multiclass problems to binary classification for improving the recognition performance. Experimental results show that HCN architecture is capable of achieving better results in comparison with the existing studies. The proposed method can accurately triage potential COVID-19 patients through CXR images for sharing the testing load and increasing the testing capacity.

[1]  Mohammad S. Obaidat,et al.  DLRS: Deep Learning-Based Recommender System for Smart Healthcare Ecosystem , 2019, ICC 2019 - 2019 IEEE International Conference on Communications (ICC).

[2]  Andrew Zisserman,et al.  Convolutional Two-Stream Network Fusion for Video Action Recognition , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Sheldon P Stone,et al.  Community-acquired pneumonia , 1998, The Lancet.

[5]  Rohit Bajaj,et al.  Pneumothorax Segmentation: Deep Learning Image Segmentation to predict Pneumothorax , 2019, ArXiv.

[6]  Seok-Lyong Lee,et al.  Hybrid and hierarchical fusion networks: a deep cross-modal learning architecture for action recognition , 2019, Neural Computing and Applications.

[7]  Chuan Qin,et al.  From SARS to MERS, Thrusting Coronaviruses into the Spotlight , 2019, Viruses.

[8]  Ronald M. Summers,et al.  ChestX-ray: Hospital-Scale Chest X-ray Database and Benchmarks on Weakly Supervised Classification and Localization of Common Thorax Diseases , 2019, Deep Learning and Convolutional Neural Networks for Medical Imaging and Clinical Informatics.

[9]  S. Rozelle,et al.  Epidemiology, causes, clinical manifestation and diagnosis, prevention and control of coronavirus disease (COVID-19) during the early outbreak period: a scoping review , 2020, Infectious Diseases of Poverty.

[10]  Q. Tao,et al.  Correlation of Chest CT and RT-PCR Testing in Coronavirus Disease 2019 (COVID-19) in China: A Report of 1014 Cases , 2020, Radiology.

[11]  Syeda Sundus Zehra,et al.  Comparative Analysis of Bio-Inspired Algorithms for Underwater Wireless Sensor Networks , 2020 .

[12]  Sushmita Mitra,et al.  Deep Learning for Screening COVID-19 using Chest X-Ray Images , 2020, 2020 IEEE Symposium Series on Computational Intelligence (SSCI).

[13]  Lawrence O. Hall,et al.  Finding Covid-19 from Chest X-rays using Deep Learning on a Small Dataset , 2020, ArXiv.

[14]  Jun Liu,et al.  Chest CT for Typical 2019-nCoV Pneumonia: Relationship to Negative RT-PCR Testing , 2020, Radiology.

[15]  Jon Kleinberg,et al.  Transfusion: Understanding Transfer Learning for Medical Imaging , 2019, NeurIPS.

[16]  Jong Chul Ye,et al.  Deep Learning COVID-19 Features on CXR Using Limited Training Data Sets , 2020, IEEE Transactions on Medical Imaging.

[17]  Chulhong Kim,et al.  Multi-Channel Transfer Learning of Chest X-ray Images for Screening of COVID-19 , 2020, Electronics.

[18]  Mohammad S. Obaidat,et al.  SeDaTiVe: SDN-Enabled Deep Learning Architecture for Network Traffic Control in Vehicular Cyber-Physical Systems , 2018, IEEE Network.

[19]  Mohamed Medhat Gaber,et al.  Classification of COVID-19 in chest X-ray images using DeTraC deep convolutional neural network , 2020, Appl. Intell..

[20]  Veronika Cheplygina,et al.  Cats or CAT scans: transfer learning from natural or medical image source datasets? , 2018, Current Opinion in Biomedical Engineering.

[21]  Lawrence O. Hall,et al.  Finding COVID-19 from Chest X-rays using Deep Learning on a Small Dataset , 2020 .

[22]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Lull Gf,et al.  THE AMERICAN MEDICAL ASSOCIATION. , 1947, Science.

[24]  The DeepRadiology Team Pneumonia Detection in Chest Radiographs , 2018, ArXiv.

[25]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Kaushik Roy,et al.  Shallow Convolutional Neural Network for COVID-19 Outbreak Screening Using Chest X-rays , 2020, Cogn. Comput..

[27]  Yandre M. G. Costa,et al.  COVID-19 identification in chest X-ray images on flat and hierarchical classification scenarios , 2020, Computer Methods and Programs in Biomedicine.

[28]  D. Al-karawi,et al.  AI based Chest X-Ray (CXR) Scan Texture Analysis Algorithm for Digital Test of COVID-19 Patients , 2020, medRxiv.

[29]  R. Kumar,et al.  Accurate Prediction of COVID-19 using Chest X-Ray Images through Deep Feature Learning model with SMOTE and Machine Learning Classifiers , 2020, medRxiv.

[30]  Yi Li,et al.  Viral Pneumonia Screening on Chest X-ray Images Using Confidence-Aware Anomaly Detection , 2020 .

[31]  Amritpal Singh,et al.  Blockchain-enabled secure communication for drone delivery: a case study in COVID-like scenarios , 2020, DroneCom@MOBICOM.

[32]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[33]  Samy S. Abu-Naser,et al.  COVID-19 Detection using Artificial Intelligence , 2020 .

[34]  S. Lerner,et al.  Community-acquired pneumonia , 1998, The Lancet.

[35]  Yicheng Fang,et al.  Sensitivity of Chest CT for COVID-19: Comparison to RT-PCR , 2020, Radiology.

[36]  Daphne Koller,et al.  Discriminative learning of relaxed hierarchy for large-scale visual recognition , 2011, 2011 International Conference on Computer Vision.

[37]  U. Rajendra Acharya,et al.  Automated detection of COVID-19 cases using deep neural networks with X-ray images , 2020, Computers in Biology and Medicine.

[38]  R. Brunham,et al.  Severe acute respiratory syndrome (SARS): a year in review. , 2005, Annual review of medicine.

[39]  Joseph Paul Cohen,et al.  COVID-19 Image Data Collection , 2020, ArXiv.

[40]  Mohammad Rahimzadeh,et al.  A New Modified Deep Convolutional Neural Network for Detecting COVID-19 from X-ray Images , 2020, ArXiv.

[41]  Abolfazl Attar,et al.  A modified deep convolutional neural network for detecting COVID-19 and pneumonia from chest X-ray images based on the concatenation of Xception and ResNet50V2 , 2020, Informatics in Medicine Unlocked.

[42]  Dima Damen,et al.  Recognizing linked events: Searching the space of feasible explanations , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[43]  KhowajaSunder Ali,et al.  Hierarchical classification method based on selective learning of slacked hierarchy for activity recognition systems , 2017 .

[44]  Ali Kashif Bashir,et al.  AI-Powered Blockchain - A Decentralized Secure Multiparty Computation Protocol for IoV , 2020, IEEE INFOCOM 2020 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[45]  Ioannis D. Apostolopoulos,et al.  Covid-19: automatic detection from X-ray images utilizing transfer learning with convolutional neural networks , 2020, Physical and Engineering Sciences in Medicine.

[46]  Forrest N. Iandola,et al.  SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size , 2016, ArXiv.

[47]  Chunhua Shen,et al.  COVID-19 Screening on Chest X-ray Images Using Deep Learning based Anomaly Detection , 2020, ArXiv.

[48]  Bernardo Nugroho Yahya,et al.  Hierarchical classification method based on selective learning of slacked hierarchy for activity recognition systems , 2017, Expert Syst. Appl..

[49]  S. Balakrishnan,et al.  Coronavirus Disease 2019 (COVID-19): A Systematic Review of Imaging Findings in 919 Patients. , 2020, AJR. American journal of roentgenology.

[50]  Abdul Hafeez,et al.  COVID-ResNet: A Deep Learning Framework for Screening of COVID19 from Radiographs , 2020, ArXiv.

[51]  Ezz El-Din Hemdan,et al.  COVIDX-Net: A Framework of Deep Learning Classifiers to Diagnose COVID-19 in X-Ray Images , 2020, ArXiv.

[52]  M. Kuo,et al.  Frequency and Distribution of Chest Radiographic Findings in COVID-19 Positive Patients , 2019, Radiology.

[53]  Debdoot Sheet,et al.  Jointly Learning Convolutional Representations to Compress Radiological Images and Classify Thoracic Diseases in the Compressed Domain , 2018, ICVGIP.

[54]  Joseph Paul Cohen,et al.  COVID-19 Image Data Collection: Prospective Predictions Are the Future , 2020, ArXiv.

[55]  Alexander Wong,et al.  COVID-Net: a tailored deep convolutional neural network design for detection of COVID-19 cases from chest X-ray images , 2020, Scientific reports.

[56]  Andrew Y. Ng,et al.  CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learning , 2017, ArXiv.

[57]  C. L. Chowdhary,et al.  Deep learning and medical image processing for coronavirus (COVID-19) pandemic: A survey , 2020, Sustainable Cities and Society.