Automatic Detection of Pneumonia in Chest X-Ray Images Using Cooperative Convolutional Neural Networks

Chest X-ray images are currently the best available visual media for diagnosing pneumonia, which plays a crucial role in clinical care. Medical images diagnosing can be error-prone for inexperienced radiologists, while tedious and time-consuming for experienced radiologists. To address these issues, we study automatically detect pneumonia in Chest X-ray images. However, this task exists several challenges. First, abnormal regions of pneumonia are difficult to identify due to the noise interference from other tissue and lesions. Second, the features of lung regions are usually essential information for diagnosis. With the pneumonia disease happens in lung areas, only training CNNs using global image may be affected by the irrelevant noisy regions. Third, the appearance of pneumonia in X-ray images is often vague, can overlap with other diagnoses. To cope with these challenges, we first introduce a lung segmentation network, which segments the lung from the original images. Then, develop a feature extraction model, which incorporates global and local features for pneumonia classification. Finally, build a cooperative learning framework, which merges bounding boxes (localization of pneumonia) from two cooperative models. We demonstrate the effectiveness of our proposed methods on the Kaggles RSNA Pneumonia Detection Challenge dataset and reaches excellent performance with the level of the top 1% in this competition.

[1]  Khalid Ashraf,et al.  Abnormality Detection and Localization in Chest X-Rays using Deep Convolutional Neural Networks , 2017, ArXiv.

[2]  E. Arias,et al.  Deaths: Final Data for 2015. , 2017, National vital statistics reports : from the Centers for Disease Control and Prevention, National Center for Health Statistics, National Vital Statistics System.

[3]  Ronald M. Summers,et al.  ChestX-ray: Hospital-Scale Chest X-ray Database and Benchmarks on Weakly Supervised Classification and Localization of Common Thorax Diseases , 2019, Deep Learning and Convolutional Neural Networks for Medical Imaging and Clinical Informatics.

[4]  P. Huang,et al.  Added Value of Computer-aided CT Image Features for Early Lung Cancer Diagnosis with Small Pulmonary Nodules: A Matched Case-Control Study. , 2018, Radiology.

[5]  P. Lakhani,et al.  Deep Learning at Chest Radiography: Automated Classification of Pulmonary Tuberculosis by Using Convolutional Neural Networks. , 2017, Radiology.

[6]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[7]  Ronald M. Summers,et al.  Improving Computer-Aided Detection Using Convolutional Neural Networks and Random View Aggregation , 2015, IEEE Transactions on Medical Imaging.

[8]  Song Han,et al.  Learning both Weights and Connections for Efficient Neural Network , 2015, NIPS.

[9]  Liangcai Gao,et al.  APNet: Semantic Segmentation for Pelvic MR Image , 2018, PRCV.

[10]  Samir S. Shah,et al.  Variability in the interpretation of chest radiographs for the diagnosis of pneumonia in children. , 2012, Journal of hospital medicine.

[11]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Abhinav Gupta,et al.  Training Region-Based Object Detectors with Online Hard Example Mining , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Kaiming He,et al.  Focal Loss for Dense Object Detection , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[14]  Kaiming He,et al.  Mask R-CNN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[15]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Alexander Rakhlin,et al.  Deep Convolutional Neural Networks for Breast Cancer Histology Image Analysis , 2018, bioRxiv.

[18]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  R. Hopstaken,et al.  Inter-observer variation in the interpretation of chest radiographs for pneumonia in community-acquired lower respiratory tract infections. , 2004, Clinical radiology.

[20]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[21]  R. Niska,et al.  National Hospital Ambulatory Medical Care Survey: 2006 emergency department summary. , 2008, National health statistics reports.

[22]  Ronald M. Summers,et al.  TieNet: Text-Image Embedding Network for Common Thorax Disease Classification and Reporting in Chest X-Rays , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[23]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.