Fusion High-Resolution Network for Diagnosing ChestX-ray Images

The application of deep convolutional neural networks (CNN) in the field of medical image processing has attracted extensive attention and demonstrated remarkable progress. An increasing number of deep learning methods have been devoted to classifying ChestX-ray (CXR) images, and most of the existing deep learning methods are based on classic pretrained models, trained by global ChestX-ray images. In this paper, we are interested in diagnosing ChestX-ray images using our proposed Fusion High-Resolution Network (FHRNet). The FHRNet concatenates the global average pooling layers of the global and local feature extractors—it consists of three branch convolutional neural networks and is fine-tuned for thorax disease classification. Compared with the results of other available methods, our experimental results showed that the proposed model yields a better disease classification performance for the ChestX-ray 14 dataset, according to the receiver operating characteristic curve and area-under-the-curve score. An ablation study further confirmed the effectiveness of the global and local branch networks in improving the classification accuracy of thorax diseases.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[3]  Bo Zhou,et al.  A Weakly Supervised Adaptive DenseNet for Classifying Thoracic Diseases and Identifying Abnormalities , 2018, ArXiv.

[4]  June-Goo Lee,et al.  Deep Learning in Medical Imaging: General Overview , 2017, Korean journal of radiology.

[5]  Habib Rostami,et al.  Deep learning, reusable and problem-based architectures for detection of consolidation on chest X-ray images , 2019, Comput. Methods Programs Biomed..

[6]  Syed Muhammad Anwar,et al.  Deep Learning in Medical Image Analysis , 2017 .

[7]  A. Ng,et al.  Deep learning for chest radiograph diagnosis: A retrospective comparison of the CheXNeXt algorithm to practicing radiologists , 2018, PLoS medicine.

[8]  Yufei Huang,et al.  Feature Selection of Deep Learning Models for EEG-Based RSVP Target Detection , 2019, IEICE Trans. Inf. Syst..

[9]  Ronald M. Summers,et al.  Learning to Read Chest X-Rays: Recurrent Neural Cascade Model for Automated Image Annotation , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Hongyu Wang,et al.  ChestNet: A Deep Neural Network for Classification of Thoracic Diseases on Chest Radiography , 2018, ArXiv.

[11]  Yingli Tian,et al.  Self-Supervised Visual Feature Learning With Deep Neural Networks: A Survey , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Hao Yang,et al.  Intelligent crack extraction and analysis for tunnel structures with terrestrial laser scanning measurement , 2019, Advances in Mechanical Engineering.

[13]  Marie-Francine Moens,et al.  Justifying Diagnosis Decisions by Deep Neural Networks , 2019, J. Biomed. Informatics.

[14]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Liangpei Zhang,et al.  A Deep-Local-Global Feature Fusion Framework for High Spatial Resolution Imagery Scene Classification , 2018, Remote. Sens..

[16]  Hongzhi Wang,et al.  Automated Detection and Type Classification of Central Venous Catheters in Chest X-Rays , 2019, MICCAI.

[17]  Ingo Neumann,et al.  An automatic and intelligent optimal surface modeling method for composite tunnel structures , 2019, Composite Structures.

[18]  Wei Chen,et al.  High-Resolution Image Inpainting Based on Multi-Scale Neural Network , 2019, Electronics.

[19]  Zhijian Song,et al.  Computer-aided detection in chest radiography based on artificial intelligence: a survey , 2018, BioMedical Engineering OnLine.

[20]  Peter L. Munk,et al.  Computer Vision Syndrome: Darkness under the Shadow of Light , 2019, Canadian Association of Radiologists journal = Journal l'Association canadienne des radiologistes.

[21]  Nima Tajbakhsh,et al.  Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning? , 2016, IEEE Transactions on Medical Imaging.

[22]  Yi Yang,et al.  Diagnose like a Radiologist: Attention Guided Convolutional Neural Network for Thorax Disease Classification , 2018, ArXiv.

[23]  Yuan Luo,et al.  Deep Generative Classifiers for Thoracic Disease Diagnosis with Chest X-ray Images , 2018, 2018 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[24]  J. Gohagan,et al.  The Prostate, Lung, Colorectal and Ovarian (PLCO) Cancer Screening Trial of the National Cancer Institute: history, organization, and status. , 2000, Controlled clinical trials.

[25]  Jianbo Liu,et al.  High-Resolution Remote Sensing Imagery Classification of Imbalanced Data Using Multistage Sampling Method and Deep Neural Networks , 2019, Remote. Sens..

[26]  Hao Yang,et al.  Multi-sensor technology for B-spline modelling and deformation analysis of composite structures , 2019, Composite Structures.

[27]  Nathan Cross,et al.  Deep Learning for Pneumothorax Detection and Localization in Chest Radiographs , 2019, ArXiv.

[28]  Nassir Navab,et al.  Adaptive image-feature learning for disease classification using inductive graph networks , 2019, MICCAI.

[29]  Panayiotis E. Pintelas,et al.  An Ensemble SSL Algorithm for Efficient Chest X-Ray Image Classification , 2018, J. Imaging.

[30]  Dong Liu,et al.  Deep High-Resolution Representation Learning for Human Pose Estimation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Joseph Paul Cohen,et al.  Do Lateral Views Help Automated Chest X-ray Predictions? , 2019, ArXiv.

[32]  Yan Shen,et al.  Dynamic Routing on Deep Neural Network for Thoracic Disease Classification and Sensitive Area Localization , 2018, MLMI@MICCAI.

[33]  Li Yao,et al.  Learning to diagnose from scratch by exploiting dependencies among labels , 2017, ArXiv.

[34]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Paul Babyn,et al.  Generative Adversarial Network in Medical Imaging: A Review , 2018, Medical Image Anal..

[36]  Yuxing Tang,et al.  Attention-Guided Curriculum Learning for Weakly Supervised Classification and Localization of Thoracic Diseases on Chest Radiographs , 2018, MLMI@MICCAI.

[37]  Ronald M. Summers,et al.  ChestX-ray: Hospital-Scale Chest X-ray Database and Benchmarks on Weakly Supervised Classification and Localization of Common Thorax Diseases , 2019, Deep Learning and Convolutional Neural Networks for Medical Imaging and Clinical Informatics.

[38]  Hao Yang,et al.  The generation and validation of a CUF-based FEA model with laser-based experiments , 2019 .

[39]  Muktabh Mayank Srivastava,et al.  Boosted Cascaded Convnets for Multilabel Classification of Thoracic Diseases in Chest Radiographs , 2017, ICIAR.

[40]  Dorin Comaniciu,et al.  Learning to recognize Abnormalities in Chest X-Rays with Location-Aware Dense Networks , 2018, CIARP.

[41]  Andrew Y. Ng,et al.  CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learning , 2017, ArXiv.

[42]  Vassili Kovalev,et al.  Examining the Capability of GANs to Replace Real Biomedical Images in Classification Models Training , 2019, Communications in Computer and Information Science.

[43]  Liping Di,et al.  Deriving High Spatiotemporal Remote Sensing Images Using Deep Convolutional Network , 2018, Remote. Sens..

[44]  Yuxing Tang,et al.  XLSor: A Robust and Accurate Lung Segmentor on Chest X-Rays Using Criss-Cross Attention and Customized Radiorealistic Abnormalities Generation , 2018, MIDL.

[45]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[46]  Cheng-Jian Lin,et al.  Evolutionary-Fuzzy-Integral-Based Convolutional Neural Networks for Facial Image Classification , 2019, Electronics.

[47]  Hao Wu,et al.  CXNet-m1: Anomaly Detection on Chest X-Rays With Image-Based Deep Learning , 2019, IEEE Access.

[48]  Nicolas Papadakis,et al.  GraphX$^{NET}-$ Chest X-Ray Classification Under Extreme Minimal Supervision , 2019, 1907.10085.

[49]  Dorin Comaniciu,et al.  Multi-task Learning for Chest X-ray Abnormality Classification on Noisy Labels , 2019, ArXiv.

[50]  Lei Wang,et al.  SDFN: Segmentation-based Deep Fusion Network for Thoracic Disease Classification in Chest X-ray Images , 2018, Comput. Medical Imaging Graph..

[51]  Inkyung Jung,et al.  Deep Learning Algorithms with Demographic Information Help to Detect Tuberculosis in Chest Radiographs in Annual Workers’ Health Examination Data , 2019, International journal of environmental research and public health.