Intelligent Pneumonia Identification From Chest X-Rays: A Systematic Literature Review

Chest radiography is an important diagnostic tool for chest-related diseases. Medical imaging research is currently embracing the automatic detection techniques used in computer vision. Over the past decade, Deep Learning techniques have shown an enormous breakthrough in the field of medical diagnostics. Various automated systems have been proposed for the rapid detection of pneumonia on chest x-rays images Although such detection algorithms are many and varied, they have not been summarized into a review that would assist practitioners in selecting the best methods from a real-time perspective, perceiving the available datasets, and understanding the currently achieved results in this domain. This paper overviews the current literature on pneumonia identification from chest x-ray images. After summarizing the topic, the review analyzes the usability, goodness factors, and computational complexities of the algorithms that implement these techniques. It also discusses the quality, usability, and size of the available datasets, and ways of coping with unbalanced datasets.

[1]  Taufik Rahmat,et al.  CHEST X-RAY IMAGE CLASSIFICATION USING FASTER R-CNN , 2019, MALAYSIAN JOURNAL OF COMPUTING.

[2]  Stanley Kok,et al.  Multi-layer Online Sequential Extreme Learning Machine for Image Classification , 2016 .

[3]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Wei Wei,et al.  Complement Objective Training , 2019, ICLR.

[5]  Clement J. McDonald,et al.  Preparing a collection of radiology examinations for distribution and retrieval , 2015, J. Am. Medical Informatics Assoc..

[6]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[7]  Stan Matwin,et al.  Addressing the Curse of Imbalanced Training Sets: One-Sided Selection , 1997, ICML.

[8]  Rahib H Abiyev,et al.  Deep Convolutional Neural Networks for Chest Diseases Detection , 2018, Journal of healthcare engineering.

[9]  Jun Zhang,et al.  Feature extraction and image retrieval based on AlexNet , 2016, International Conference on Digital Image Processing.

[10]  Trevor Darrell,et al.  DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition , 2013, ICML.

[11]  Tatiana Malygina,et al.  GANs 'N Lungs: improving pneumonia prediction , 2019, ArXiv.

[12]  Maria Pantoja,et al.  Introduction to Deep Learning , 2018, Deep Learning.

[13]  Eric P. Xing,et al.  SCAN: Structure Correcting Adversarial Network for Organ Segmentation in Chest X-Rays , 2017, DLMIA/ML-CDS@MICCAI.

[14]  Peter E. Hart,et al.  The condensed nearest neighbor rule (Corresp.) , 1968, IEEE Trans. Inf. Theory.

[15]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Longbing Cao,et al.  Training deep neural networks on imbalanced data sets , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[17]  Noel C. F. Codella,et al.  Skin lesion analysis toward melanoma detection: A challenge at the 2017 International symposium on biomedical imaging (ISBI), hosted by the international skin imaging collaboration (ISIC) , 2016, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[18]  Song Han,et al.  Deep Compression: Compressing Deep Neural Network with Pruning, Trained Quantization and Huffman Coding , 2015, ICLR.

[19]  C. Dolea,et al.  World Health Organization , 1949, International Organization.

[20]  Stefan Jaeger,et al.  Two public chest X-ray datasets for computer-aided screening of pulmonary diseases. , 2014, Quantitative imaging in medicine and surgery.

[21]  H. Ünver,et al.  Diagnosis of Pneumonia from Chest X-Ray Images Using Deep Learning , 2019, 2019 Scientific Meeting on Electrical-Electronics & Biomedical Engineering and Computer Science (EBBT).

[22]  Costantino Grana,et al.  Augmenting data with GANs to segment melanoma skin lesions , 2019, Multimedia Tools and Applications.

[23]  Nassir Navab,et al.  MelanoGANs: High Resolution Skin Lesion Synthesis with GANs , 2018, ArXiv.

[24]  Chi-Wing Fu,et al.  H-DenseUNet: Hybrid Densely Connected UNet for Liver and Tumor Segmentation From CT Volumes , 2018, IEEE Transactions on Medical Imaging.

[25]  O. Arthurs,et al.  Shortage of paediatric radiologists acting as an expert witness: position statement from the British Society of Paediatric Radiology (BSPR) National Working Group on Imaging in Suspected Physical Abuse (SPA). , 2019, Clinical radiology.

[26]  Shahrokh Valaee,et al.  Synthesizing Chest X-Ray Pathology for Training Deep Convolutional Neural Networks , 2019, IEEE Transactions on Medical Imaging.

[27]  I. Tomek,et al.  Two Modifications of CNN , 1976 .

[28]  Oge Marques,et al.  Comparative Performance Analysis of Machine Learning Classifiers in Detection of Childhood Pneumonia Using Chest Radiographs , 2013, ICCS.

[29]  Li Yao,et al.  Learning to diagnose from scratch by exploiting dependencies among labels , 2017, ArXiv.

[30]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[31]  M. Maloof.  Learning When Data Sets are Imbalanced and When Costs are Unequal and Unknown , 2003 .

[32]  M. Arentz,et al.  Tuberculosis Infection: Insight from Immunogenomics. , 2007, Drug discovery today. Disease mechanisms.

[33]  Lixin Zheng,et al.  A transfer learning method with deep residual network for pediatric pneumonia diagnosis , 2020, Comput. Methods Programs Biomed..

[34]  Fernando Bação,et al.  Effective data generation for imbalanced learning using conditional generative adversarial networks , 2018, Expert Syst. Appl..

[35]  Andrew Y. Ng,et al.  CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learning , 2017, ArXiv.

[36]  Ronald M. Summers,et al.  ChestX-ray: Hospital-Scale Chest X-ray Database and Benchmarks on Weakly Supervised Classification and Localization of Common Thorax Diseases , 2019, Deep Learning and Convolutional Neural Networks for Medical Imaging and Clinical Informatics.

[37]  Sameer Antani,et al.  Lung boundary detection in pediatric chest x-rays , 2015, Medical Imaging.

[38]  Bulat Ibragimov,et al.  Deep neural network ensemble for pneumonia localization from a large-scale chest x-ray database , 2019, Comput. Electr. Eng..

[39]  Ammi Reddy Pulagam,et al.  Automated Lung Segmentation from HRCT Scans with Diffuse Parenchymal Lung Diseases , 2016, Journal of Digital Imaging.

[40]  Clement J. McDonald,et al.  Automatic Tuberculosis Screening Using Chest Radiographs , 2014, IEEE Transactions on Medical Imaging.

[41]  Dwarikanath Mahapatra,et al.  Deformable medical image registration using generative adversarial networks , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[42]  Ankush Mittal,et al.  Pneumonia Detection Using CNN based Feature Extraction , 2019, 2019 IEEE International Conference on Electrical, Computer and Communication Technologies (ICECCT).

[43]  Antoine Geissbühler,et al.  Comparative Performance Analysis of State-of-the-Art Classification Algorithms Applied to Lung Tissue Categorization , 2010, Journal of Digital Imaging.

[44]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[45]  Diogo Almeida,et al.  Resnet in Resnet: Generalizing Residual Architectures , 2016, ArXiv.

[46]  Maarten De Vos,et al.  Smart diagnostic algorithms for automated detection of childhood pneumonia in resource-constrained settings , 2015, 2015 IEEE Global Humanitarian Technology Conference (GHTC).

[47]  Hayit Greenspan,et al.  GAN-based Synthetic Medical Image Augmentation for increased CNN Performance in Liver Lesion Classification , 2018, Neurocomputing.

[48]  Muhammad Usman Ghani Khan,et al.  Categorization of Crowd Varieties using Deep Concurrent Convolution Neural Network , 2019, 2019 2nd International Conference on Advancements in Computational Sciences (ICACS).

[49]  H. Kim,et al.  Activities of the Korean Institute of Tuberculosis , 2014, Osong public health and research perspectives.

[50]  B. Antin,et al.  Detecting Pneumonia in Chest X-Rays with Supervised Learning , 2017 .

[51]  Michael H. Goldbaum,et al.  Labeled Optical Coherence Tomography (OCT) and Chest X-Ray Images for Classification , 2018 .

[52]  Li Yao,et al.  Weakly Supervised Medical Diagnosis and Localization from Multiple Resolutions , 2018, ArXiv.

[53]  Mario Ignacio Chacon Murguia,et al.  Self-adaptive SOM-CNN neural system for dynamic object detection in normal and complex scenarios , 2015, Pattern Recognit..

[54]  Mantao Xu,et al.  Classification of Imbalanced Data by Using the SMOTE Algorithm and Locally Linear Embedding , 2006, 2006 8th international Conference on Signal Processing.

[55]  Philip Bachman,et al.  Augmented CycleGAN: Learning Many-to-Many Mappings from Unpaired Data , 2018, ICML.

[56]  Ulas Bagci,et al.  How to fool radiologists with generative adversarial networks? A visual turing test for lung cancer diagnosis , 2017, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[57]  M. Budoff,et al.  2016 SCCT/STR guidelines for coronary artery calcium scoring of noncontrast noncardiac chest CT scans: A report of the Society of Cardiovascular Computed Tomography and Society of Thoracic Radiology. , 2017, Journal of cardiovascular computed tomography.

[58]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[59]  Antonio Torralba,et al.  Building the gist of a scene: the role of global image features in recognition. , 2006, Progress in brain research.

[60]  K. Doi,et al.  Development of a digital image database for chest radiographs with and without a lung nodule: receiver operating characteristic analysis of radiologists' detection of pulmonary nodules. , 2000, AJR. American journal of roentgenology.

[61]  Jorma Laurikkala,et al.  Improving Identification of Difficult Small Classes by Balancing Class Distribution , 2001, AIME.

[62]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[63]  Clarimar José Coelho,et al.  Computer-aided diagnosis in chest radiography for detection of childhood pneumonia , 2008, Int. J. Medical Informatics.

[64]  Fevzullah Temurtas,et al.  Chest diseases diagnosis using artificial neural networks , 2010, Expert Syst. Appl..

[65]  Gustavo E. A. P. A. Batista,et al.  A study of the behavior of several methods for balancing machine learning training data , 2004, SKDD.

[66]  H. H. Thodberg,et al.  The RSNA Pediatric Bone Age Machine Learning Challenge. , 2019, Radiology.

[67]  Raheel Siddiqi,et al.  Automated Pneumonia Diagnosis using a Customized Sequential Convolutional Neural Network , 2019, ICDLT.

[68]  Morteza Mardani,et al.  Deep Generative Adversarial Neural Networks for Compressive Sensing MRI , 2019, IEEE Transactions on Medical Imaging.

[69]  Xinhua Zhuang,et al.  Morphological structuring element decomposition , 1986 .

[70]  Okeke Stephen,et al.  An Efficient Deep Learning Approach to Pneumonia Classification in Healthcare , 2019, Journal of healthcare engineering.

[71]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[72]  George R. Thoma,et al.  Visualizing and explaining deep learning predictions for pneumonia detection in pediatric chest radiographs , 2019, Medical Imaging.

[73]  Michael Grass,et al.  Comparison of Deep Learning Approaches for Multi-Label Chest X-Ray Classification , 2018, Scientific Reports.

[74]  Aditya Khamparia,et al.  A Novel Transfer Learning Based Approach for Pneumonia Detection in Chest X-ray Images , 2020, Applied Sciences.

[75]  D. Mollura,et al.  Computer-aided diagnosis of pulmonary infections using texture analysis and support vector machine classification. , 2011, Academic radiology.

[76]  Bartosz Krawczyk,et al.  Analyzing the oversampling of different classes and types of examples in multi-class imbalanced datasets , 2016, Pattern Recognit..

[77]  Shalini Govil,et al.  Can Artificial Intelligence Reliably Report Chest X-Rays?: Radiologist Validation of an Algorithm trained on 2.3 Million X-Rays , 2018 .

[78]  Anant Gupta,et al.  Generative Image Translation for Data Augmentation of Bone Lesion Pathology , 2018, MIDL.

[79]  Rajesh Mehra,et al.  Breast cancer histology images classification: Training from scratch or transfer learning? , 2018, ICT Express.

[80]  Kawal S. Rhode,et al.  CardiacNET: Segmentation of Left Atrium and Proximal Pulmonary Veins from MRI Using Multi-view CNN , 2017, MICCAI.

[81]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[82]  G. Deng,et al.  An adaptive Gaussian filter for noise reduction and edge detection , 1993, 1993 IEEE Conference Record Nuclear Science Symposium and Medical Imaging Conference.

[83]  Khalid Ashraf,et al.  Abnormality Detection and Localization in Chest X-Rays using Deep Convolutional Neural Networks , 2017, ArXiv.

[84]  Raimundo C. S. Freire,et al.  Wavelet transform processing applied to partial discharge evaluation , 2012 .

[85]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[86]  Amit Kumar Jaiswal,et al.  Identifying pneumonia in chest X-rays: A deep learning approach , 2019, Measurement.

[87]  Roger G. Mark,et al.  MIMIC-CXR: A large publicly available database of labeled chest radiographs , 2019, ArXiv.

[88]  Hayit Greenspan,et al.  Deep learning with non-medical training used for chest pathology identification , 2015, Medical Imaging.

[89]  Jaakko Lehtinen,et al.  Analyzing and Improving the Image Quality of StyleGAN , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[90]  Dimitris Kanellopoulos,et al.  Handling imbalanced datasets: A review , 2006 .

[91]  Burhan Ergen,et al.  A Deep Feature Learning Model for Pneumonia Detection Applying a Combination of mRMR Feature Selection and Machine Learning Models , 2020, IRBM.