Deep Learning for Detection and Localization of Thoracic Diseases Using Chest X-Ray Imagery

Classification of diseases from biomedical images is a fast growing emerging field of research. In this regard, chest X-Rays (CXR) are one of the most widely used medical images to diagnose common heart and lung diseases where previous works have explored the usage of various pre-trained deep learning models to perform the classification. However, these models are very deep, thus use large number of parameters. Moreover, it is still not possible to find readily available access to a practicing radiologist for proper diagnosis from an X-Ray image of chest. Hence, this fact motivated us to conduct this research with the aim to classify CXR images in an automated manner with smaller number of parameters during training for 14 different categories of thoracic diseases and produce heatmap for the corresponding image in order to show the location of abnormality. For the purpose of classification, transfer learning is used with the pre-trained network of Resnet18, while the heatmaps are generated using pooling along the channel dimension and then computing the average of class-wise features. The proposed model contains less parameters to train and provides better performance than the other models present in the literature. The trained model is then validated both quantitatively and visually by producing localized images in the form of heatmaps of the CXR images. Moreover, the dataset and code of this work are provided online (http://www.nitttrkol.ac.in/indrajit/projects/deeplearning-chestxray/).

[1]  L Pourcelot,et al.  Sonographic approach to diagnosing pulmonary consolidation , 1992, Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine.

[2]  Travis E. Oliphant,et al.  Python for Scientific Computing , 2007, Computing in Science & Engineering.

[3]  Ronald M. Summers,et al.  ChestX-ray: Hospital-Scale Chest X-ray Database and Benchmarks on Weakly Supervised Classification and Localization of Common Thorax Diseases , 2019, Deep Learning and Convolutional Neural Networks for Medical Imaging and Clinical Informatics.

[4]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[5]  Yael Refaely,et al.  Hernia of the lung. , 2002, The Annals of thoracic surgery.

[6]  M. Fine,et al.  A prediction rule to identify low-risk patients with community-acquired pneumonia. , 1997, The New England journal of medicine.

[7]  W. C. Ball,et al.  Pleural effusions: the diagnostic separation of transudates and exudates. , 1972, Annals of internal medicine.

[8]  P. Yang,et al.  “Fluid color” sign: a useful indicator for discrimination between pleural thickening and pleural effusion. , 1995, Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine.

[9]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[10]  H. Collard,et al.  Acute exacerbations of idiopathic pulmonary fibrosis. , 2007, American journal of respiratory and critical care medicine.

[11]  W H REEDER,et al.  Pulmonary infiltration with eosinophilia (PIE syndrome). , 1952, Annals of internal medicine.

[12]  Dorin Comaniciu,et al.  Learning to recognize Abnormalities in Chest X-Rays with Location-Aware Dense Networks , 2018, CIARP.

[13]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[15]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[16]  Y. Zhang,et al.  Cardiomegaly is a common arrhythmogenic substrate in adult sudden cardiac deaths, and is associated with obesity , 2012, Pathology.

[17]  D. Ost,et al.  Solitary Pulmonary Nodule , 2005 .

[18]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  E D Robin,et al.  Pulmonary edema. 2. , 1973, The New England journal of medicine.

[20]  S. Eriksson,et al.  PULMONARY EMPHYSEMA AND ALPHA1-ANTITRYPSIN DEFICIENCY. , 2009, Acta medica Scandinavica.

[21]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[22]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[23]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).