Comprehensive Computer-Aided Decision Support Framework to Diagnose Tuberculosis From Chest X-Ray Images: Data Mining Study

Background Tuberculosis (TB) is one of the most infectious diseases that can be fatal. Its early diagnosis and treatment can significantly reduce the mortality rate. In the literature, several computer-aided diagnosis (CAD) tools have been proposed for the efficient diagnosis of TB from chest radiograph (CXR) images. However, the majority of previous studies adopted conventional handcrafted feature-based algorithms. In addition, some recent CAD tools utilized the strength of deep learning methods to further enhance diagnostic performance. Nevertheless, all these existing methods can only classify a given CXR image into binary class (either TB positive or TB negative) without providing further descriptive information. Objective The main objective of this study is to propose a comprehensive CAD framework for the effective diagnosis of TB by providing visual as well as descriptive information from the previous patients’ database. Methods To accomplish our objective, first we propose a fusion-based deep classification network for the CAD decision that exhibits promising performance over the various state-of-the-art methods. Furthermore, a multilevel similarity measure algorithm is devised based on multiscale information fusion to retrieve the best-matched cases from the previous database. Results The performance of the framework was evaluated based on 2 well-known CXR data sets made available by the US National Library of Medicine and the National Institutes of Health. Our classification model exhibited the best diagnostic performance (0.929, 0.937, 0.921, 0.928, and 0.965 for F1 score, average precision, average recall, accuracy, and area under the curve, respectively) and outperforms the performance of various state-of-the-art methods. Conclusions This paper presents a comprehensive CAD framework to diagnose TB from CXR images by retrieving the relevant cases and their clinical observations from the previous patients’ database. These retrieval results assist the radiologist in making an effective diagnostic decision related to the current medical condition of a patient. Moreover, the retrieval results can facilitate the radiologists in subjectively validating the CAD decision.

[1]  Jaebeom Lee,et al.  Recent tuberculosis diagnosis toward the end TB strategy. , 2016, Journal of microbiological methods.

[2]  Vishnu Prasad Shenoy,et al.  Deep learning, computer-aided radiography reading for tuberculosis: a diagnostic accuracy study from a tertiary hospital in India , 2020, Scientific Reports.

[3]  Ginés García-Mateos,et al.  A Computer-Aided Detection System for Digital Chest Radiographs , 2016, Journal of healthcare engineering.

[4]  P. Van de Perre,et al.  Pulmonary tuberculosis due to Mycobacterium microti: a study of six recent cases in France. , 2010, Journal of medical microbiology.

[5]  Xi-Lin Li,et al.  Preconditioned Stochastic Gradient Descent , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[6]  C. Dolea,et al.  World Health Organization , 1949, International Organization.

[7]  I. Cuthill,et al.  Effect size, confidence interval and statistical significance: a practical guide for biologists , 2007, Biological reviews of the Cambridge Philosophical Society.

[8]  Alexandros Karargyris,et al.  Combination of texture and shape features to detect pulmonary abnormalities in digital chest X-rays , 2015, International Journal of Computer Assisted Radiology and Surgery.

[9]  João Francisco Valiati,et al.  Pre-trained convolutional neural networks as feature extractors for tuberculosis detection , 2017, Comput. Biol. Medicine.

[10]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  George R. Thoma,et al.  Edge map analysis in chest X-rays for automatic pulmonary abnormality screening , 2016, International Journal of Computer Assisted Radiology and Surgery.

[12]  Charu C. Aggarwal,et al.  Neural Networks and Deep Learning , 2018, Springer International Publishing.

[13]  A. Flahault,et al.  Use of Digital Technology to Enhance Tuberculosis Control: Scoping Review , 2020, Journal of medical Internet research.

[14]  Jacob Cohen,et al.  A power primer. , 1992, Psychological bulletin.

[15]  Z. Qin,et al.  Using artificial intelligence to read chest radiographs for tuberculosis detection: A multi-site evaluation of the diagnostic accuracy of three deep learning systems , 2019, Scientific Reports.

[16]  Jing Li,et al.  SD-CNN: a Shallow-Deep CNN for Improved Breast Cancer Diagnosis , 2018, Comput. Medical Imaging Graph..

[17]  Mathias Prokop,et al.  Digital chest radiography: an update on modern technology, dose containment and control of image quality , 2008, European Radiology.

[18]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[19]  Clement J. McDonald,et al.  Lung Segmentation in Chest Radiographs Using Anatomical Atlases With Nonrigid Registration , 2014, IEEE Transactions on Medical Imaging.

[20]  E. Valuations A REVIEW ON EVALUATION METRICS FOR DATA CLASSIFICATION EVALUATIONS , 2015 .

[21]  Tianfu Wang,et al.  Breast Cancer Detection and Diagnosis Using Mammographic Data: Systematic Review , 2019, Journal of medical Internet research.

[22]  P. Lakhani,et al.  Deep Learning at Chest Radiography: Automated Classification of Pulmonary Tuberculosis by Using Convolutional Neural Networks. , 2017, Radiology.

[23]  Xiangyu Zhang,et al.  ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[24]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[25]  Bolei Zhou,et al.  Learning Deep Features for Discriminative Localization , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  F. Pfeiffer,et al.  Efficient Deep Network Architectures for Fast Chest X-Ray Tuberculosis Screening and Visualization , 2019, Scientific Reports.

[27]  Edward H Livingston,et al.  Who was student and why do we care so much about his t-test? , 2004, The Journal of surgical research.

[28]  Atul Kumar,et al.  Distinguishing normal and pulmonary edema chest x-ray using Gabor filter and SVM , 2014, 2014 IEEE International Symposium on Bioelectronics and Bioinformatics (IEEE ISBB 2014).

[29]  Sameer Antani,et al.  Automated Chest X-Ray Screening: Can Lung Region Symmetry Help Detect Pulmonary Abnormalities? , 2018, IEEE Transactions on Medical Imaging.

[30]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  S. Santhosh Baboo,et al.  Image Retrieval using Harris Corners and Histogram of Oriented Gradients , 2011 .

[32]  R. Balasubramanian,et al.  Local maximum edge binary patterns: A new descriptor for image retrieval and object tracking , 2012, Signal Process..

[33]  Bram van Ginneken,et al.  Automatic Detection of Tuberculosis in Chest Radiographs Using a Combination of Textural, Focal, and Shape Abnormality Analysis , 2015, IEEE Transactions on Medical Imaging.

[34]  Ali Afzalian Mand,et al.  Classification of tuberculosis with SURF spatial pyramid features , 2017, 2017 International Conference on Robotics, Automation and Sciences (ICORAS).

[35]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[36]  M. N. Sulaiman,et al.  A Review On Evaluation Metrics For Data Classification Evaluations , 2015 .

[37]  S. Freire,et al.  Rapid molecular test for tuberculosis: impact of its routine use at a referral hospital , 2018, Jornal brasileiro de pneumologia : publicacao oficial da Sociedade Brasileira de Pneumologia e Tisilogia.

[38]  Alexandros Karargyris,et al.  Feature Selection for Automatic Tuberculosis Screening in Frontal Chest Radiographs , 2018, Journal of Medical Systems.

[39]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[40]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[41]  Songjing Chen,et al.  Identifying Lung Cancer Risk Factors in the Elderly Using Deep Neural Networks: Quantitative Analysis of Web-Based Survey Data , 2020, Journal of medical Internet research.

[42]  Swaminathan Ramakrishnan,et al.  Analysis of Tuberculosis in Chest Radiographs for Computerized Diagnosis using Bag of Keypoint Features , 2019, Journal of Medical Systems.

[43]  Clement J. McDonald,et al.  Automatic Tuberculosis Screening Using Chest Radiographs , 2014, IEEE Transactions on Medical Imaging.

[44]  S. Santos,et al.  Teste rápido molecular para tuberculose: avaliação do impacto de seu uso na rotina em um hospital de referência , 2018 .

[45]  Ronald M. Summers,et al.  Learning to Read Chest X-Rays: Recurrent Neural Cascade Model for Automated Image Annotation , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[46]  A. Tsanas,et al.  Applications of Machine Learning in Real-Life Digital Health Interventions: Review of the Literature , 2019, Journal of medical Internet research.

[47]  Hyo-Eun Kim,et al.  A novel approach for tuberculosis screening based on deep convolutional neural networks , 2016, SPIE Medical Imaging.