A Two-Stage Framework for Automated Malignant Pulmonary Nodule Detection in CT Scans

This research is concerned with malignant pulmonary nodule detection (PND) in low-dose CT scans. Due to its crucial role in the early diagnosis of lung cancer, PND has considerable potential in improving the survival rate of patients. We propose a two-stage framework that exploits the ever-growing advances in deep neural network models, and that is comprised of a semantic segmentation stage followed by localization and classification. We employ the recently published DeepLab model for semantic segmentation, and we show that it significantly improves the accuracy of nodule detection compared to the classical U-Net model and its most recent variants. Using the widely adopted Lung Nodule Analysis dataset (LUNA16), we evaluate the performance of the semantic segmentation stage by adopting two network backbones, namely, MobileNet-V2 and Xception. We present the impact of various model training parameters and the computational time on the detection accuracy, featuring a 79.1% mean intersection-over-union (mIoU) and an 88.34% dice coefficient. This represents a mIoU increase of 60% and a dice coefficient increase of 30% compared to U-Net. The second stage involves feeding the output of the DeepLab-based semantic segmentation to a localization-then-classification stage. The second stage is realized using Faster RCNN and SSD, with an Inception-V2 as a backbone. On LUNA16, the two-stage framework attained a sensitivity of 96.4%, outperforming other recent models in the literature, including deep models. Finally, we show that adopting a transfer learning approach, particularly, the DeepLab model weights of the first stage of the framework, to infer binary (malignant-benign) labels on the Kaggle dataset for pulmonary nodules achieves a classification accuracy of 95.66%, which represents approximately 4% improvement over the recent literature.

[1]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[2]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[3]  George Papandreou,et al.  Rethinking Atrous Convolution for Semantic Image Segmentation , 2017, ArXiv.

[4]  Joaquim Salvi,et al.  Multiple Sclerosis Lesion Synthesis in MRI Using an Encoder-Decoder U-NET , 2019, IEEE Access.

[5]  Dr. Shailendra Narayan Singh,et al.  Region-based Object Detection and Classification using Faster R-CNN , 2018, 2018 4th International Conference on Computational Intelligence & Communication Technology (CICT).

[6]  Yu Qian,et al.  Segmentation of brain lesions from CT images based on deep learning techniques , 2018, Medical Imaging.

[7]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Hao Chen,et al.  Automated Pulmonary Nodule Detection via 3D ConvNets with Online Sample Filtering and Hybrid-Loss Residual Learning , 2017, MICCAI.

[9]  Prionjit Sarker,et al.  Segmentation and classification of lung tumor from 3D CT image using K-means clustering algorithm , 2017, 2017 4th International Conference on Advances in Electrical Engineering (ICAEE).

[10]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Luca Maria Gambardella,et al.  Fast image scanning with deep max-pooling convolutional neural networks , 2013, 2013 IEEE International Conference on Image Processing.

[12]  Xiuying Wang,et al.  Learning Deep Spatial Lung Features by 3D Convolutional Neural Network for Early Cancer Detection , 2017, 2017 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[13]  Jaewoo Kang,et al.  Classification of lung nodules in CT scans using three-dimensional deep convolutional neural networks with a checkpoint ensemble method , 2018, BMC Medical Imaging.

[14]  Ayman El-Baz,et al.  Computer-Aided Diagnosis Systems for Lung Cancer: Challenges and Methodologies , 2013, Int. J. Biomed. Imaging.

[15]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[16]  Ulas Bagci,et al.  TumorNet: Lung nodule characterization using multi-view Convolutional Neural Network with Gaussian Process , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[17]  Richard C. Pais,et al.  The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): a completed reference database of lung nodules on CT scans. , 2011, Medical physics.

[18]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[19]  Weipeng Jing,et al.  Fully Convolutional Neural Network with Augmented Atrous Spatial Pyramid Pool and Fully Connected Fusion Path for High Resolution Remote Sensing Image Segmentation , 2019, Applied Sciences.

[20]  Sébastien Ourselin,et al.  Interactive Medical Image Segmentation Using Deep Learning With Image-Specific Fine Tuning , 2017, IEEE Transactions on Medical Imaging.

[21]  Xiaoling Xia,et al.  Inception-v3 for flower classification , 2017, 2017 2nd International Conference on Image, Vision and Computing (ICIVC).

[22]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[24]  Hüseyin Polat,et al.  Classification of Pulmonary CT Images by Using Hybrid 3D-Deep Convolutional Neural Network Architecture , 2019, Applied Sciences.

[25]  Shehzad Khalid,et al.  Segmentation of Lung Nodules in CT Scan Data: A Review , 2015 .

[26]  Kaijian Xia,et al.  Liver Semantic Segmentation Algorithm Based on Improved Deep Adversarial Networks in Combination of Weighted Loss Function on Abdominal CT Images , 2019, IEEE Access.

[27]  Gavriel Salomon,et al.  T RANSFER OF LEARNING , 1992 .

[28]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[30]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Haibo Hu,et al.  Automated Lung Nodule Detection and Classification Using Deep Learning Combined with Multiple Strategies , 2019, Sensors.

[32]  Iasonas Kokkinos,et al.  Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs , 2014, ICLR.

[33]  Albert Chon,et al.  Deep Convolutional Neural Networks for Lung Cancer Detection , 2017 .

[34]  H. Al-Jahdali,et al.  Solitary pulmonary nodule: A diagnostic algorithm in the light of current imaging technique , 2011, Avicenna Journal of Medicine.

[35]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[36]  George Papandreou,et al.  Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation , 2018, ECCV.

[37]  Bin Sheng,et al.  Computer-Assisted Decision Support System in Pulmonary Cancer detection and stage classification on CT images , 2018, J. Biomed. Informatics.

[38]  Yanning Zhang,et al.  Pulmonary nodule detection in medical images: A survey , 2018, Biomed. Signal Process. Control..

[39]  Jianrong Wu,et al.  A survey of pulmonary nodule detection, segmentation and classification in computed tomography with deep learning techniques , 2019, Journal of Medical Artificial Intelligence.

[40]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Р Ю Чуйков,et al.  Обнаружение транспортных средств на изображениях загородных шоссе на основе метода Single shot multibox Detector , 2017 .

[42]  Manu Goyal,et al.  Region of Interest Detection in Dermoscopic Images for Natural Data-augmentation , 2018, ArXiv.

[43]  Yi Ding,et al.  RUN: Residual U-Net for Computer-Aided Detection of Pulmonary Nodules without Candidate Selection , 2018, ArXiv.