A comprehensive survey on chest diseases analysis: technique, challenges and future research directions

Learning with chest diseases and their classification, segmentation, localization, annotation, and abnormality detection are challenging and exciting research objectives. Over the past few years, different researchers have come with various learning techniques for improving performance in chest image analysis. However, the scarcity of labeled datasets and less computational processing power was a reason for the negligible performance improvement. Nevertheless, with the advancement in Deep Learning (DL) techniques, researchers succeeded in achieving state-of-the-art results and created a new research paradigm. Among the different DL techniques, Convolutional Neural Network comes with a revolution for identifying abnormality in chest images. This survey aims to highlight the importance of deep learning techniques in chest disease diagnosis. In this paper, our primary objective is to broadly analyze different DL techniques and recognize some of the important research challenges that mostly affect deep neural networks for investigating various chest diseases. Specifically, we focus on several chest diseases, symptoms, preliminary treatments, and state-of-the-art detection techniques. We also introduce several chest image analysis tools, techniques, and datasets for analyzing chest diseases. Further, we have presented several open research challenges and future research directions in the field of chest image analysis.

[1]  Forrest N. Iandola,et al.  SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size , 2016, ArXiv.

[2]  Chunhua Shen,et al.  COVID-19 Screening on Chest X-ray Images Using Deep Learning based Anomaly Detection , 2020, ArXiv.

[3]  Konstantinos Kamnitsas,et al.  Anatomically Constrained Neural Networks (ACNNs): Application to Cardiac Image Enhancement and Segmentation , 2017, IEEE Transactions on Medical Imaging.

[4]  Bin Li,et al.  A Cross-Domain Metal Trace Restoring Network for Reducing X-Ray CT Metal Artifacts , 2020, IEEE Transactions on Medical Imaging.

[5]  Brett Byram,et al.  Deep Neural Networks for Ultrasound Beamforming , 2018, IEEE Transactions on Medical Imaging.

[6]  Gregory R. Koch,et al.  Siamese Neural Networks for One-Shot Image Recognition , 2015 .

[7]  Clement J. McDonald,et al.  Preparing a collection of radiology examinations for distribution and retrieval , 2015, J. Am. Medical Informatics Assoc..

[8]  Ajay Mittal,et al.  Lung field segmentation in chest radiographs: a historical review, current status, and expectations from deep learning , 2017, IET Image Process..

[9]  Sang Min Lee,et al.  Deep Learning Applications in Chest Radiography and Computed Tomography: Current State of the Art , 2019, Journal of thoracic imaging.

[10]  Ronald J. Williams,et al.  A Learning Algorithm for Continually Running Fully Recurrent Neural Networks , 1989, Neural Computation.

[11]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[12]  Matthew T. Freedman,et al.  Artificial convolution neural network techniques and applications for lung nodule detection , 1995, IEEE Trans. Medical Imaging.

[13]  Peng Gang,et al.  Dimensionality reduction in deep learning for chest X-ray analysis of lung cancer , 2018, 2018 Tenth International Conference on Advanced Computational Intelligence (ICACI).

[14]  Qingmao Hu,et al.  Lung nodule classification using deep feature fusion in chest radiography , 2017, Comput. Medical Imaging Graph..

[15]  Mainak Adhikari,et al.  Bangla-Meitei Mayek scripts handwritten character recognition using Convolutional Neural Network , 2020, Applied Intelligence.

[16]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[17]  Khamisi Kalegele,et al.  A Survey of Machine Learning Approaches and Techniques for Student Dropout Prediction , 2019, Data Sci. J..

[18]  Jürgen Schmidhuber,et al.  Training Very Deep Networks , 2015, NIPS.

[19]  Jürgen Schmidhuber,et al.  Stacked Convolutional Auto-Encoders for Hierarchical Feature Extraction , 2011, ICANN.

[20]  Nasir M. Rajpoot,et al.  Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology Images , 2016, IEEE Trans. Medical Imaging.

[21]  Hiroshi Fujita,et al.  Automated detection of pulmonary nodules in PET/CT images: Ensemble false-positive reduction using a convolutional neural network technique. , 2016, Medical physics.

[22]  Bram van Ginneken,et al.  Automatic classification of pulmonary peri-fissural nodules in computed tomography using an ensemble of 2D views and a convolutional neural network out-of-the-box , 2015, Medical Image Anal..

[23]  Holger H. Hoos,et al.  A survey on semi-supervised learning , 2019, Machine Learning.

[24]  Pascal Vincent,et al.  Contractive Auto-Encoders: Explicit Invariance During Feature Extraction , 2011, ICML.

[25]  Lipo Wang,et al.  Deep Learning Applications in Medical Image Analysis , 2018, IEEE Access.

[26]  Bram van Ginneken,et al.  Improving airway segmentation in computed tomography using leak detection with convolutional networks , 2017, Medical Image Anal..

[27]  Marios Anthimopoulos,et al.  Lung Pattern Classification for Interstitial Lung Diseases Using a Deep Convolutional Neural Network , 2016, IEEE Transactions on Medical Imaging.

[28]  Hayit Greenspan,et al.  Chest pathology identification using deep feature selection with non-medical training , 2018, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[29]  Richard C. Pais,et al.  The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): a completed reference database of lung nodules on CT scans. , 2011, Medical physics.

[30]  H. Bosmans,et al.  Survey of chest radiography systems: Any link between contrast detail measurements and visual grading analysis? , 2020, Physica medica : PM : an international journal devoted to the applications of physics to medicine and biology : official journal of the Italian Association of Biomedical Physics.

[31]  Hayit Greenspan,et al.  A comparative study for chest radiograph image retrieval using binary texture and deep learning classification , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[32]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[33]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[34]  Abhishek Hazra,et al.  Diagnosis of Chest Diseases in X-Ray images using Deep Convolutional Neural Network , 2019, 2019 10th International Conference on Computing, Communication and Networking Technologies (ICCCNT).

[35]  Kincho H. Law,et al.  Automatic localization of casting defects with convolutional neural networks , 2017, 2017 IEEE International Conference on Big Data (Big Data).

[36]  K. Doi,et al.  Development of a digital image database for chest radiographs with and without a lung nodule: receiver operating characteristic analysis of radiologists' detection of pulmonary nodules. , 2000, AJR. American journal of roentgenology.

[37]  Bulat Ibragimov,et al.  Deep Learning for Diagnosis and Segmentation of Pneumothorax: The Results on the Kaggle Competition and Validation Against Radiologists , 2020, IEEE Journal of Biomedical and Health Informatics.

[38]  Aldenor G. Santos,et al.  Occurrence of the potent mutagens 2- nitrobenzanthrone and 3-nitrobenzanthrone in fine airborne particles , 2019, Scientific Reports.

[39]  Bram van Ginneken,et al.  Pulmonary Nodule Detection in CT Images: False Positive Reduction Using Multi-View Convolutional Networks , 2016, IEEE Transactions on Medical Imaging.

[40]  Chris Yakopcic,et al.  A State-of-the-Art Survey on Deep Learning Theory and Architectures , 2019, Electronics.

[41]  Maria Wimmer,et al.  Fully Convolutional Architectures for Multiclass Segmentation in Chest Radiographs , 2017, IEEE Transactions on Medical Imaging.

[42]  Prakash Choudhary,et al.  Chest disease radiography in twofold: using convolutional neural networks and transfer learning , 2019, Evolving Systems.

[43]  Ronald M. Summers,et al.  Holistic classification of CT attenuation patterns for interstitial lung diseases via deep convolutional neural networks , 2018, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[44]  Guang-Zhong Yang,et al.  Deep Learning for Health Informatics , 2017, IEEE Journal of Biomedical and Health Informatics.

[45]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[46]  Ronald M. Summers,et al.  ChestX-ray: Hospital-Scale Chest X-ray Database and Benchmarks on Weakly Supervised Classification and Localization of Common Thorax Diseases , 2019, Deep Learning and Convolutional Neural Networks for Medical Imaging and Clinical Informatics.

[47]  Hayit Greenspan,et al.  Visualizing and enhancing a deep learning framework using patients age and gender for chest x-ray image retrieval , 2016, SPIE Medical Imaging.

[48]  N. Rajpoot,et al.  Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology Images , 2016, IEEE Transactions on Medical Imaging.

[49]  M. Shamim Hossain,et al.  Adversarial Examples—Security Threats to COVID-19 Deep Learning Systems in Medical IoT Devices , 2020, IEEE Internet of Things Journal.

[50]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[51]  Antoine Geissbühler,et al.  Building a reference multimedia database for interstitial lung diseases , 2012, Comput. Medical Imaging Graph..

[52]  Jan Theopold,et al.  Detection of articular perforations of the proximal humerus fracture using a mobile 3D image intensifier – a cadaver study , 2017, BMC Medical Imaging.

[53]  Bernhard Stimpel,et al.  Known Operator Learning Enables Constrained Projection Geometry Conversion: Parallel to Cone-Beam for Hybrid MR/X-Ray Imaging , 2020, IEEE Transactions on Medical Imaging.

[54]  Hyo-Eun Kim,et al.  A novel approach for tuberculosis screening based on deep convolutional neural networks , 2016, SPIE Medical Imaging.

[55]  L. Younes On the convergence of markovian stochastic algorithms with rapidly decreasing ergodicity rates , 1999 .

[56]  Uma Narayanan,et al.  A survey on various supervised classification algorithms , 2017, 2017 International Conference on Energy, Communication, Data Analytics and Soft Computing (ICECDS).

[57]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[58]  Marios Anthimopoulos,et al.  Multi-source Transfer Learning with Convolutional Neural Networks for Lung Pattern Analysis , 2016, IEEE journal of biomedical and health informatics.

[59]  Lequan Yu,et al.  Deep Mining External Imperfect Data for Chest X-Ray Disease Screening , 2020, IEEE Transactions on Medical Imaging.

[60]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[61]  Ronald M. Summers,et al.  Learning to Read Chest X-Rays: Recurrent Neural Cascade Model for Automated Image Annotation , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[62]  N. Sri Madhava Raja,et al.  Deep-learning framework to detect lung abnormality - A study with chest X-Ray and lung CT scan images , 2020, Pattern Recognit. Lett..

[63]  Yaozong Gao,et al.  Lung Infection Quantification of COVID-19 in CT Images with Deep Learning , 2020, ArXiv.

[64]  Mei-Ling Shyu,et al.  A Survey on Deep Learning , 2018, ACM Comput. Surv..

[65]  Marc'Aurelio Ranzato,et al.  Efficient Learning of Sparse Representations with an Energy-Based Model , 2006, NIPS.

[66]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[67]  Sounkalo Dembélé,et al.  Autocalibration method for scanning electron microscope using affine camera model , 2020, Mach. Vis. Appl..

[68]  Pingkun Yan,et al.  Deep learning in medical image registration: a survey , 2020, Machine Vision and Applications.

[69]  Amit Kumar Jaiswal,et al.  Identifying pneumonia in chest X-rays: A deep learning approach , 2019, Measurement.

[70]  Jin Mo Goo,et al.  Deep Learning for Chest Radiograph Diagnosis in the Emergency Department. , 2019, Radiology.

[71]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[72]  Bing He,et al.  An Ensemble-Based Densely-Connected Deep Learning System for Assessment of Skeletal Maturity , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[73]  Inkyung Jung,et al.  Deep Learning Algorithms with Demographic Information Help to Detect Tuberculosis in Chest Radiographs in Annual Workers’ Health Examination Data , 2019, International journal of environmental research and public health.

[74]  Prakash Choudhary,et al.  Recent Advances in Deep Learning Techniques and Its Applications: An Overview , 2020 .

[75]  Qianjin Feng,et al.  Cascade of multi-scale convolutional neural networks for bone suppression of chest radiographs in gradient domain , 2017, Medical Image Anal..

[76]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[77]  Asifullah Khan,et al.  A survey of the recent architectures of deep convolutional neural networks , 2019, Artificial Intelligence Review.

[78]  Hayit Greenspan,et al.  Deep learning with non-medical training used for chest pathology identification , 2015, Medical Imaging.

[79]  Wenqing Sun,et al.  Computer aided lung cancer diagnosis with deep learning algorithms , 2016, SPIE Medical Imaging.

[80]  Michael Grass,et al.  Comparison of Deep Learning Approaches for Multi-Label Chest X-Ray Classification , 2018, Scientific Reports.

[81]  Axel Saalbach,et al.  Localization of Critical Findings in Chest X-Ray Without Local Annotations Using Multi-Instance Learning , 2020, 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI).

[82]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[83]  Sanskriti Singh,et al.  PneumoXttention: A CNN compensating for Human Fallibility when Detecting Pneumonia through CXR images with Attention , 2020, 2021 12th International Symposium on Image and Signal Processing and Analysis (ISPA).

[84]  Stefan Jaeger,et al.  Two public chest X-ray datasets for computer-aided screening of pulmonary diseases. , 2014, Quantitative imaging in medicine and surgery.

[85]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[86]  Seunghoon Hong,et al.  Learning Deconvolution Network for Semantic Segmentation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[87]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[88]  Quanzheng Li,et al.  Deep learning-enabled system for rapid pneumothorax screening on chest CT. , 2019, European journal of radiology.

[89]  Naeem Khalid Janjua,et al.  Going Deep in Medical Image Analysis: Concepts, Methods, Challenges, and Future Directions , 2019, IEEE Access.

[90]  Parag Kulkarni,et al.  A Survey of Semi-Supervised Learning Methods , 2008, 2008 International Conference on Computational Intelligence and Security.

[91]  Wei Shen,et al.  Learning from Experts: Developing Transferable Deep Features for Patient-Level Lung Cancer Prediction , 2016, MICCAI.

[92]  Derek Abbott,et al.  Deep learning-based cardiovascular image diagnosis: A promising challenge , 2020, Future Gener. Comput. Syst..

[93]  Xiangzhi Bai,et al.  Convolutional Neural Network (CNN) Based Three Dimensional Tumor Localization Using Single X-Ray Projection , 2019, IEEE Access.

[94]  Bram van Ginneken,et al.  Off-the-shelf convolutional neural network features for pulmonary nodule detection in computed tomography scans , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[95]  Ghazaleh Mehdipoor,et al.  Survey of practitioners’ competency for diagnosis of acute diseases manifest on chest X-ray , 2017, BMC Medical Imaging.

[96]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[97]  Ting Liu,et al.  Recent advances in convolutional neural networks , 2015, Pattern Recognit..

[98]  Bai Ying Lei,et al.  Automatic Scoring of Multiple Semantic Attributes With Multi-Task Feature Leverage: A Study on Pulmonary Nodules in CT Images , 2017, IEEE Transactions on Medical Imaging.

[99]  Dancheng Li,et al.  YU-net Lung Segment Image Preprocess Methods Used for Common Chest Diseases Prediction , 2020, ICML 2020.

[100]  Arvid Lundervold,et al.  An overview of deep learning in medical imaging focusing on MRI , 2018, Zeitschrift fur medizinische Physik.

[101]  Michael Blum,et al.  High-Throughput Classification of Radiographs Using Deep Convolutional Neural Networks , 2016, Journal of Digital Imaging.

[102]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[103]  Li Yao,et al.  Learning to diagnose from scratch by exploiting dependencies among labels , 2017, ArXiv.

[104]  Ezz El-Din Hemdan,et al.  COVIDX-Net: A Framework of Deep Learning Classifiers to Diagnose COVID-19 in X-Ray Images , 2020, ArXiv.

[105]  Rima Kilany,et al.  Deep learning applications in pulmonary medical imaging: recent updates and insights on COVID-19 , 2020, Machine Vision and Applications.

[106]  Xinyi Huang,et al.  Interactive Visual Study of Multiple Attributes Learning Model of X-Ray Scattering Images , 2020, IEEE Transactions on Visualization and Computer Graphics.

[107]  Yun-Dai Chen,et al.  Sex Differences Associated With Circulating PCSK9 in Patients Presenting With Acute Myocardial Infarction , 2019, Scientific Reports.

[108]  Florian Schaff,et al.  Material Decomposition Using Spectral Propagation-Based Phase-Contrast X-Ray Imaging , 2019, IEEE Transactions on Medical Imaging.

[109]  Max A. Viergever,et al.  Computer-aided diagnosis in chest radiography: a survey , 2001, IEEE Transactions on Medical Imaging.

[110]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[111]  Z. Qin,et al.  Using artificial intelligence to read chest radiographs for tuberculosis detection: A multi-site evaluation of the diagnostic accuracy of three deep learning systems , 2019, Scientific Reports.

[112]  Mark D Cicero,et al.  Training and Validating a Deep Convolutional Neural Network for Computer-Aided Detection and Classification of Abnormalities on Frontal Chest Radiographs , 2017, Investigative radiology.

[113]  Jie-Zhi Cheng,et al.  Automatic Scoring of Multiple Semantic Attributes With Multi-Task Feature Leverage: A Study on Pulmonary Nodules in CT Images. , 2017, IEEE transactions on medical imaging.

[114]  Wei Shen,et al.  Multi-scale Convolutional Neural Networks for Lung Nodule Classification , 2015, IPMI.

[115]  Eui Jin Hwang,et al.  Development and Validation of a Deep Learning–Based Automated Detection Algorithm for Major Thoracic Diseases on Chest Radiographs , 2019, JAMA network open.

[116]  Yi Ding,et al.  DeepEDN: A Deep-Learning-Based Image Encryption and Decryption Network for Internet of Medical Things , 2020, IEEE Internet of Things Journal.

[117]  S. Suriya,et al.  A Survey on Supervised and Unsupervised Learning Techniques , 2019, AISGSC 2019.

[118]  Yi Yang,et al.  Diagnose like a Radiologist: Attention Guided Convolutional Neural Network for Thorax Disease Classification , 2018, ArXiv.

[119]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[120]  Yang Song,et al.  Survey on deep learning for pulmonary medical imaging , 2019, Frontiers of Medicine.

[121]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[122]  Yongshuai Ge,et al.  Enhancing the X-Ray Differential Phase Contrast Image Quality With Deep Learning Technique , 2020, IEEE Transactions on Biomedical Engineering.

[123]  Marisa A. Abrajano,et al.  Using Machine Learning to Uncover Hidden Heterogeneities in Survey Data , 2019, Scientific Reports.

[124]  Feng Liu,et al.  Deep Learning and Its Applications in Biomedicine , 2018, Genom. Proteom. Bioinform..

[125]  Ronald M. Summers,et al.  Segmentation label propagation using deep convolutional neural networks and dense conditional random field , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).