Automated pulmonary nodule detection in CT images using 3D deep squeeze-and-excitation networks

PurposePulmonary nodule detection has great significance for early treating lung cancer and increasing patient survival. This work presents a novel automated computer-aided detection scheme for pulmonary nodules based on deep convolutional neural networks (DCNNs).MethodsThe proposed approach employs 3D DCNNs based on squeeze-and-excitation network and residual network (SE-ResNet) for pulmonary nodule candidate detection and false-positive reduction. Specifically, a 3D region proposal network with a U-Net-like structure is designed for detecting pulmonary nodule candidates. For the subsequent false-positive reduction, a 3D SE-ResNet-based classifier is presented to accurately discriminate the true nodules from candidates. The 3D SE-ResNet modules boost the representational power of the network by adaptively recalibrating channel-wise residual feature responses. Both models utilize 3D SE-ResNet modules to learn nodule features effectively and improve nodule detection performance.ResultsOn the public available lung nodule analysis 2016 dataset with 888 scans included, the proposed method reaches high detection sensitivities of 93.6% and 95.7% at one and four false positives per scan, respectively. Meanwhile, the competition performance metric score of 0.904 is achieved. The proposed method has the capability to detect multi-size nodules, especially the extremely small nodules.ConclusionIn this paper, a 3D DCNNs framework based on 3D SE-ResNet modules is proposed to detect pulmonary nodules in chest CT images accurately. Experimental results demonstrate superior effectiveness of the proposed approach in pulmonary nodule detection task.

[1]  O. Miettinen,et al.  Early Lung Cancer Action Project: overall design and findings from baseline screening , 1999, The Lancet.

[2]  C. Henschke Early lung cancer action project , 2000, Cancer.

[3]  C. Gatsonis,et al.  Reduced Lung-Cancer Mortality with Low-Dose Computed Tomographic Screening , 2012 .

[4]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[5]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[7]  Lin Lu,et al.  Hybrid detection of lung nodules on CT scan images. , 2015, Medical physics.

[8]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Bram van Ginneken,et al.  Pulmonary Nodule Detection in CT Images: False Positive Reduction Using Multi-View Convolutional Networks , 2016, IEEE Transactions on Medical Imaging.

[10]  Nikos Komodakis,et al.  Wide Residual Networks , 2016, BMVC.

[11]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  A. Jemal,et al.  Lung Cancer Statistics. , 2016, Advances in experimental medicine and biology.

[13]  A. Fein,et al.  Multiple pulmonary nodules in malignancy , 2017, Current opinion in pulmonary medicine.

[14]  Hao Chen,et al.  Automated Pulmonary Nodule Detection via 3D ConvNets with Online Sample Filtering and Hybrid-Loss Residual Learning , 2017, MICCAI.

[15]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[16]  Hao Chen,et al.  Multilevel Contextual 3-D CNNs for False Positive Reduction in Pulmonary Nodule Detection , 2017, IEEE Transactions on Biomedical Engineering.

[17]  Vivek Vaidya,et al.  Lung nodule detection in CT using 3D convolutional neural networks , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[18]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Hamid Abrishami Moghaddam,et al.  A unified methodology based on sparse field level sets and boosting algorithms for false positives reduction in lung nodules detection , 2018, International Journal of Computer Assisted Radiology and Surgery.

[20]  Hao Chen,et al.  Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: The LUNA16 challenge , 2016, Medical Image Anal..

[21]  Xiaohui Xie,et al.  DeepLung: 3D Deep Convolutional Nets for Automated Pulmonary Nodule Detection and Classification , 2017, bioRxiv.

[22]  Shuicheng Yan,et al.  Dual Path Networks , 2017, NIPS.

[23]  Aoxue Li,et al.  Accurate Pulmonary Nodule Detection in Computed Tomography Images Using Deep Convolutional Neural Networks , 2017, MICCAI.

[24]  A. Jemal,et al.  Cancer statistics, 2018 , 2018, CA: a cancer journal for clinicians.

[25]  Ulas Bagci,et al.  S4ND: Single-Shot Single-Scale Lung Nodule Detection , 2018, MICCAI.

[26]  Bin Zheng,et al.  Automatic detection of pulmonary nodules in CT images by incorporating 3D tensor filtering with local image feature analysis. , 2018, Physica medica : PM : an international journal devoted to the applications of physics to medicine and biology : official journal of the Italian Association of Biomedical Physics.

[27]  Xiaohui Xie,et al.  DeepEM: Deep 3D ConvNets With EM For Weakly Supervised Pulmonary Nodule Detection , 2018, bioRxiv.

[28]  M. Skalski,et al.  The utilisation of convolutional neural networks in detecting pulmonary nodules: a review. , 2018, The British journal of radiology.

[29]  Lanfen Lin,et al.  A deep 3D residual CNN for false-positive reduction in pulmonary nodule detection. , 2018, Medical physics.

[30]  Kai Zhang,et al.  Deep learning for image-based cancer detection and diagnosis - A survey , 2018, Pattern Recognit..

[31]  Qi Liu,et al.  Automatic nodule detection for lung cancer in CT images: A review , 2018, Comput. Biol. Medicine.

[32]  Wentao Zhu,et al.  DeepEM: Deep 3D ConvNets With EM For Weakly Supervised Pulmonary Nodule Detection , 2018 .

[33]  Gang Sun,et al.  Squeeze-and-Excitation Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[34]  Xiaohui Xie,et al.  AnatomyNet: Deep learning for fast and fully automated whole‐volume segmentation of head and neck anatomy , 2018, Medical physics.