Pulmonary nodule detection on chest radiographs using balanced convolutional neural network and classic candidate detection

Computer-aided detection (CADe) systems play a crucial role in pulmonary nodule detection via chest radiographs (CXRs). A two-stage CADe scheme usually includes nodule candidate detection and false positive reduction. A pure deep learning model, such as faster region convolutional neural network (faster R-CNN), has been successfully applied for nodule candidate detection via computed tomography (CT). The model is yet to achieve a satisfactory performance in CXR, because the size of the CXR is relatively large and the nodule in CXR has been obscured by structures such as ribs. In contrast, the CNN has proved effective for false positive reduction compared to the shallow method. In this paper, we developed a CADe scheme using the balanced CNN with classic candidate detection. First, the scheme applied a multi-segment active shape model to accurately segment pulmonary parenchyma. The grayscale morphological enhancement technique was then used to improve the conspicuity of the nodule structure. Based on the nodule enhancement image, 200 nodule candidates were selected and a region of interest (ROI) was cropped for each. Nodules in CXR exhibit a large variation in density, and rib crossing and vessel tissue usually present similar features to the nodule. Compared to the original ROI image, the nodule enhancement ROI image has potential discriminative features from false positive reduction. In this study, the nodule enhancement ROI image, corresponding segmentation result, and original ROI image were encoded into a red-green-blue (RGB) color image instead of the duplicated original ROI image as input of the CNN (GoogLeNet) for false positive reduction. With the Japanese Society of Radiological Technology database, the CADe scheme achieved high performance of the published literatures (a sensitivity of 91.4 % and 97.1 %, with 2.0 false positives per image (FPs/image) and 5.0 FPs/image, respectively) for nodule cases.

[1]  Geoffrey E. Hinton,et al.  Adaptive Mixtures of Local Experts , 1991, Neural Computation.

[2]  Akinobu Shimizu,et al.  Optimal image feature set for detecting lung nodules on chest X-ray images , 2002 .

[3]  Chaofeng Li,et al.  False-Positive Reduction on Lung Nodules Detection in Chest Radiographs by Ensemble of Convolutional Neural Networks , 2018, IEEE Access.

[4]  Heung-Il Suk,et al.  Deep Learning in Medical Image Analysis. , 2017, Annual review of biomedical engineering.

[5]  Thomas Brox,et al.  Discriminative Unsupervised Feature Learning with Exemplar Convolutional Neural Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Hiroyuki Yoshida,et al.  Local contralateral subtraction based on bilateral symmetry of lung for reduction of false positives in computerized detection of pulmonary nodules , 2004, IEEE Transactions on Biomedical Engineering.

[7]  Dev P Chakraborty,et al.  A brief history of free-response receiver operating characteristic paradigm data analysis. , 2013, Academic radiology.

[8]  Hiroyuki Yoshida,et al.  Computerized detection of pulmonary nodules in chest radiographs based on morphological features and wavelet snake model , 2002, Medical Image Anal..

[9]  Suhuai Luo,et al.  A Solitary Feature-Based Lung Nodule Detection Approach for Chest X-Ray Radiographs , 2018, IEEE Journal of Biomedical and Health Informatics.

[10]  Marcelo Gattass,et al.  Automatic segmentation of lung nodules with growing neural gas and support vector machine , 2012, Comput. Biol. Medicine.

[11]  Kenji Suzuki,et al.  Computerized Detection of Lung Nodules by Means of “Virtual Dual-Energy” Radiography , 2013, IEEE Transactions on Biomedical Engineering.

[12]  K. Doi,et al.  Development of a digital image database for chest radiographs with and without a lung nodule: receiver operating characteristic analysis of radiologists' detection of pulmonary nodules. , 2000, AJR. American journal of roentgenology.

[13]  Guido Valli,et al.  Neural networks for computer-aided diagnosis: detection of lung nodules in chest radiograms , 2003, IEEE Transactions on Information Technology in Biomedicine.

[14]  Zohreh Azimifar,et al.  Lung nodule segmentation and recognition using SVM classifier and active contour modeling: A complete intelligent system , 2013, Comput. Biol. Medicine.

[15]  Ronald M. Summers,et al.  ChestX-ray: Hospital-Scale Chest X-ray Database and Benchmarks on Weakly Supervised Classification and Localization of Common Thorax Diseases , 2019, Deep Learning and Convolutional Neural Networks for Medical Imaging and Clinical Informatics.

[16]  K. Doi,et al.  False-positive reduction in computer-aided diagnostic scheme for detecting nodules in chest radiographs by means of massive training artificial neural network. , 2005, Academic radiology.

[17]  Heber MacMahon,et al.  Development and evaluation of a computer-aided diagnostic scheme for lung nodule detection in chest radiographs by means of two-stage nodule enhancement with support vector classification. , 2011, Medical physics.

[18]  Yongdong Zhang,et al.  Automated pulmonary nodule detection in CT images using deep convolutional neural networks , 2019, Pattern Recognit..

[19]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[20]  Alexandre Moreau-Gaudry,et al.  Differentiating pre- and minimally invasive from invasive adenocarcinoma using CT-features in persistent pulmonary part-solid nodules in Caucasian patients. , 2015, European journal of radiology.

[21]  Jason Cong,et al.  An automated lung segmentation approach using bidirectional chain codes to improve nodule detection accuracy , 2015, Comput. Biol. Medicine.

[22]  Lubomir M. Hadjiiski,et al.  Classifier performance prediction for computer-aided diagnosis using a limited dataset. , 2008, Medical physics.

[23]  Jing Zhang,et al.  Performance comparison of artificial neural network and logistic regression model for differentiating lung nodules on CT scans , 2012, Expert Syst. Appl..

[24]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[25]  Qiang Li,et al.  Reduction of bias and variance for evaluation of computer-aided diagnostic schemes. , 2006, Medical physics.

[26]  H. Miller.  The FROC curve: a representation of the observer's performance for the method of free response. , 1969, The Journal of the Acoustical Society of America.

[27]  Nitish Srivastava,et al.  Improving neural networks by preventing co-adaptation of feature detectors , 2012, ArXiv.

[28]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[29]  Max A. Viergever,et al.  On Combining Computer-Aided Detection Systems , 2011, IEEE Transactions on Medical Imaging.

[30]  Russell C. Hardie,et al.  Performance analysis of a new computer aided detection system for identifying lung nodules on chest radiographs , 2008, Medical Image Anal..

[31]  Abbas Z. Kouzani,et al.  Automated detection of lung nodules in computed tomography images: a review , 2010, Machine Vision and Applications.

[32]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Bram van Ginneken,et al.  A computer-aided diagnosis system for detection of lung nodules in chest radiographs with an evaluation on a public database , 2006, Medical Image Anal..

[34]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[36]  Dinggang Shen,et al.  Segmenting Lung Fields in Serial Chest Radiographs Using Both Population-Based and Patient-Specific Shape Statistics , 2008, IEEE Transactions on Medical Imaging.

[37]  Ronald M. Summers,et al.  Improving Computer-Aided Detection Using Convolutional Neural Networks and Random View Aggregation , 2015, IEEE Transactions on Medical Imaging.

[38]  Temesguen Messay,et al.  Segmentation of pulmonary nodules in computed tomography using a regression neural network approach and its application to the Lung Image Database Consortium and Image Database Resource Initiative dataset , 2015, Medical Image Anal..

[39]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..