Triage of potential COVID-19 patients from chest X-ray images using hierarchical convolutional networks

The current COVID-19 pandemic has motivated the researchers to use artificial intelligence techniques for a potential alternative to reverse transcription-polymerase chain reaction due to the limited scale of testing. The chest X-ray (CXR) is one of the alternatives to achieve fast diagnosis, but the unavailability of large-scale annotated data makes the clinical implementation of machine learning-based COVID detection difficult. Another issue is the usage of ImageNet pre-trained networks which does not extract reliable feature representations from medical images. In this paper, we propose the use of hierarchical convolutional network (HCN) architecture to naturally augment the data along with diversified features. The HCN uses the first convolution layer from COVIDNet followed by the convolutional layers from well-known pre-trained networks to extract the features. The use of the convolution layer from COVIDNet ensures the extraction of representations relevant to the CXR modality. We also propose the use of ECOC for encoding multiclass problems to binary classification for improving the recognition performance. Experimental results show that HCN architecture is capable of achieving better results in comparison with the existing studies. The proposed method can accurately triage potential COVID-19 patients through CXR images for sharing the testing load and increasing the testing capacity.

[1]  Lull Gf,et al.  THE AMERICAN MEDICAL ASSOCIATION. , 1947, Science.

[2]  S. Lerner,et al.  Community-acquired pneumonia , 1998, The Lancet.

[3]  Sheldon P Stone,et al.  Community-acquired pneumonia , 1998, The Lancet.

[4]  R. Brunham,et al.  Severe acute respiratory syndrome (SARS): a year in review. , 2005, Annual review of medicine.

[5]  Dima Damen,et al.  Recognizing linked events: Searching the space of feasible explanations , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Daphne Koller,et al.  Discriminative learning of relaxed hierarchy for large-scale visual recognition , 2011, 2011 International Conference on Computer Vision.

[7]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[8]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Forrest N. Iandola,et al.  SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size , 2016, ArXiv.

[11]  Andrew Zisserman,et al.  Convolutional Two-Stream Network Fusion for Video Action Recognition , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Ronald M. Summers,et al.  ChestX-ray: Hospital-Scale Chest X-ray Database and Benchmarks on Weakly Supervised Classification and Localization of Common Thorax Diseases , 2019, Deep Learning and Convolutional Neural Networks for Medical Imaging and Clinical Informatics.

[13]  Ramprasaath R. Selvaraju,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[14]  Andrew Y. Ng,et al.  CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learning , 2017, ArXiv.

[15]  Bernardo Nugroho Yahya,et al.  Hierarchical classification method based on selective learning of slacked hierarchy for activity recognition systems , 2017, Expert Syst. Appl..

[16]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  The DeepRadiology Team Pneumonia Detection in Chest Radiographs , 2018, ArXiv.

[18]  Debdoot Sheet,et al.  Jointly Learning Convolutional Representations to Compress Radiological Images and Classify Thoracic Diseases in the Compressed Domain , 2018, ICVGIP.

[19]  Mohammad S. Obaidat,et al.  SeDaTiVe: SDN-Enabled Deep Learning Architecture for Network Traffic Control in Vehicular Cyber-Physical Systems , 2018, IEEE Network.

[20]  Mohammad S. Obaidat,et al.  DLRS: Deep Learning-Based Recommender System for Smart Healthcare Ecosystem , 2019, ICC 2019 - 2019 IEEE International Conference on Communications (ICC).

[21]  Chuan Qin,et al.  From SARS to MERS, Thrusting Coronaviruses into the Spotlight , 2019, Viruses.

[22]  Veronika Cheplygina,et al.  Cats or CAT scans: transfer learning from natural or medical image source datasets? , 2018, Current Opinion in Biomedical Engineering.

[23]  Seok-Lyong Lee,et al.  Hybrid and hierarchical fusion networks: a deep cross-modal learning architecture for action recognition , 2019, Neural Computing and Applications.

[24]  Rohit Bajaj,et al.  Pneumothorax Segmentation: Deep Learning Image Segmentation to predict Pneumothorax , 2019, ArXiv.

[25]  M. Kuo,et al.  Frequency and Distribution of Chest Radiographic Findings in COVID-19 Positive Patients , 2019, Radiology.

[26]  Jon Kleinberg,et al.  Transfusion: Understanding Transfer Learning for Medical Imaging , 2019, NeurIPS.

[27]  Abdul Hafeez,et al.  COVID-ResNet: A Deep Learning Framework for Screening of COVID19 from Radiographs , 2020, ArXiv.

[28]  Chulhong Kim,et al.  Multi-Channel Transfer Learning of Chest X-ray Images for Screening of COVID-19 , 2020, Electronics.

[29]  Lawrence O. Hall,et al.  Finding Covid-19 from Chest X-rays using Deep Learning on a Small Dataset , 2020, ArXiv.

[30]  A. Wong,et al.  COVID-Net: a tailored deep convolutional neural network design for detection of COVID-19 cases from chest X-ray images , 2020, Scientific Reports.

[31]  Mohammad Rahimzadeh,et al.  A modified deep convolutional neural network for detecting COVID-19 and pneumonia from chest X-ray images based on the concatenation of Xception and ResNet50V2 , 2020, Informatics in Medicine Unlocked.

[32]  S. Balakrishnan,et al.  Coronavirus Disease 2019 (COVID-19): A Systematic Review of Imaging Findings in 919 Patients. , 2020, AJR. American journal of roentgenology.

[33]  Lawrence O. Hall,et al.  Finding COVID-19 from Chest X-rays using Deep Learning on a Small Dataset , 2020 .

[34]  S. Rozelle,et al.  Epidemiology, causes, clinical manifestation and diagnosis, prevention and control of coronavirus disease (COVID-19) during the early outbreak period: a scoping review , 2020, Infectious Diseases of Poverty.

[35]  Yi Li,et al.  Viral Pneumonia Screening on Chest X-ray Images Using Confidence-Aware Anomaly Detection , 2020 .

[36]  R. Kumar,et al.  Accurate Prediction of COVID-19 using Chest X-Ray Images through Deep Feature Learning model with SMOTE and Machine Learning Classifiers , 2020, medRxiv.

[37]  Mohammad Rahimzadeh,et al.  A New Modified Deep Convolutional Neural Network for Detecting COVID-19 from X-ray Images , 2020, ArXiv.

[38]  Sushmita Mitra,et al.  Deep Learning for Screening COVID-19 using Chest X-Ray Images , 2020, 2020 IEEE Symposium Series on Computational Intelligence (SSCI).

[39]  Jun Liu,et al.  Chest CT for Typical 2019-nCoV Pneumonia: Relationship to Negative RT-PCR Testing , 2020, Radiology.

[40]  Kaushik Roy,et al.  Shallow Convolutional Neural Network for COVID-19 Outbreak Screening Using Chest X-rays , 2020, Cogn. Comput..

[41]  Q. Tao,et al.  Correlation of Chest CT and RT-PCR Testing in Coronavirus Disease 2019 (COVID-19) in China: A Report of 1014 Cases , 2020, Radiology.

[42]  Ioannis D. Apostolopoulos,et al.  Covid-19: automatic detection from X-ray images utilizing transfer learning with convolutional neural networks , 2020, Physical and Engineering Sciences in Medicine.

[43]  Joseph Paul Cohen,et al.  COVID-19 Image Data Collection: Prospective Predictions Are the Future , 2020, The Journal of Machine Learning for Biomedical Imaging.

[44]  Samy S. Abu-Naser,et al.  COVID-19 Detection using Artificial Intelligence , 2020 .

[45]  Yandre M. G. Costa,et al.  COVID-19 identification in chest X-ray images on flat and hierarchical classification scenarios , 2020, Computer Methods and Programs in Biomedicine.

[46]  Ezz El-Din Hemdan,et al.  COVIDX-Net: A Framework of Deep Learning Classifiers to Diagnose COVID-19 in X-Ray Images , 2020, ArXiv.

[47]  Chunhua Shen,et al.  COVID-19 Screening on Chest X-ray Images Using Deep Learning based Anomaly Detection , 2020, ArXiv.

[48]  Joseph Paul Cohen,et al.  COVID-19 Image Data Collection , 2020, ArXiv.

[49]  Amritpal Singh,et al.  Blockchain-enabled secure communication for drone delivery: a case study in COVID-like scenarios , 2020, DroneCom@MOBICOM.

[50]  Ali Kashif Bashir,et al.  AI-Powered Blockchain - A Decentralized Secure Multiparty Computation Protocol for IoV , 2020, IEEE INFOCOM 2020 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[51]  D. Al-karawi,et al.  AI based Chest X-Ray (CXR) Scan Texture Analysis Algorithm for Digital Test of COVID-19 Patients , 2020, medRxiv.

[52]  U. Rajendra Acharya,et al.  Automated detection of COVID-19 cases using deep neural networks with X-ray images , 2020, Computers in Biology and Medicine.

[53]  C. L. Chowdhary,et al.  Deep learning and medical image processing for coronavirus (COVID-19) pandemic: A survey , 2020, Sustainable Cities and Society.

[54]  Yicheng Fang,et al.  Sensitivity of Chest CT for COVID-19: Comparison to RT-PCR , 2020, Radiology.

[55]  Jong Chul Ye,et al.  Deep Learning COVID-19 Features on CXR Using Limited Training Data Sets , 2020, IEEE Transactions on Medical Imaging.

[56]  Syeda Sundus Zehra,et al.  Comparative Analysis of Bio-Inspired Algorithms for Underwater Wireless Sensor Networks , 2020 .

[57]  Mohamed Medhat Gaber,et al.  Classification of COVID-19 in chest X-ray images using DeTraC deep convolutional neural network , 2020, Appl. Intell..

[58]  M. Aslan,et al.  Correlation of chest CT and RT-PCR testing in coronavirus disease 2019 (COVID-19) in Turkey , 2021, Annals of Clinical and Analytical Medicine.