Pulmonary Nodule Detection in Volumetric Chest CT Scans Using CNNs-Based Nodule-Size-Adaptive Detection and Classification

In computed tomography, automated detection of pulmonary nodules with a broad spectrum of appearance is still a challenge, especially, in the detection of small nodules. An automated detection system usually contains two major steps: candidate detection and false positive (FP) reduction. We propose a novel strategy for fast candidate detection from volumetric chest CT scans, which can minimize false negatives (FNs) and false positives (FPs). The core of the strategy is a nodule-size-adaptive deep model that can detect nodules of various types, locations, and sizes from 3D images. After candidate detection, each result is located with a bounding cube, which can provide rough size information of the detected objects. Furthermore, we propose a simple yet effective CNNs-based classifier for FP reduction, which benefits from the candidate detection. The performance of the proposed nodule detection was evaluated on both independent and publicly available datasets. Our detection could reach high sensitivity with few FPs and it was comparable with the state-of-the-art systems and manual screenings. The study demonstrated that excellent candidate detection plays an important role in the nodule detection and can simplify the design of the FP reduction. The proposed candidate detection is an independent module, so it can be incorporated with any other FP reduction methods. Besides, it can be used as a potential solution for other similar clinical applications.

[1]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Receiver operating characteristic analysis in medical imaging: contents. , 2008, Journal of the ICRU.

[4]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[5]  Ulas Bagci,et al.  Risk Stratification of Lung Nodules Using 3D CNN-Based Multi-task Learning , 2017, IPMI.

[6]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[7]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[8]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Jamshid Dehmeshki,et al.  Shape-Based Computer-Aided Detection of Lung Nodules in Thoracic CT Images , 2009, IEEE Transactions on Biomedical Engineering.

[10]  Lanfen Lin,et al.  A deep 3D residual CNN for false-positive reduction in pulmonary nodule detection. , 2018, Medical physics.

[11]  Matthijs Oudkerk,et al.  Prospects for population screening and diagnosis of lung cancer , 2013, The Lancet.

[12]  Heng Huang,et al.  Lung Nodule Classification With Multilevel Patch-Based Context Analysis , 2014, IEEE Transactions on Biomedical Engineering.

[13]  Hong Chen,et al.  Seven-layer deep neural network based on sparse autoencoder for voxelwise detection of cerebral microbleed , 2017, Multimedia Tools and Applications.

[14]  Bram van Ginneken,et al.  Pulmonary Nodule Detection in CT Images: False Positive Reduction Using Multi-View Convolutional Networks , 2016, IEEE Transactions on Medical Imaging.

[15]  Hao Chen,et al.  Multilevel Contextual 3-D CNNs for False Positive Reduction in Pulmonary Nodule Detection , 2017, IEEE Transactions on Biomedical Engineering.

[16]  Xiaohui Xie,et al.  DeepLung: Deep 3D Dual Path Nets for Automated Pulmonary Nodule Detection and Classification , 2018, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[17]  Hao Chen,et al.  Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: The LUNA16 challenge , 2016, Medical Image Anal..

[18]  Xiaohui Xie,et al.  AnatomyNet: Deep learning for fast and fully automated whole‐volume segmentation of head and neck anatomy , 2018, Medical physics.

[19]  Bram van Ginneken,et al.  Automatic detection of subsolid pulmonary nodules in thoracic computed tomography images , 2014, Medical Image Anal..

[20]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[21]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[22]  Aoxue Li,et al.  Accurate Pulmonary Nodule Detection in Computed Tomography Images Using Deep Convolutional Neural Networks , 2017, MICCAI.

[23]  M. Oudkerk,et al.  Computed tomographic characteristics of interval and post screen carcinomas in lung cancer screening , 2014, European Radiology.

[24]  Richard C. Pais,et al.  The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): a completed reference database of lung nodules on CT scans. , 2011, Medical physics.

[25]  D. Xu,et al.  Low-Dose CT Screening for Lung Cancer: Computer-aided Detection of Missed Lung Cancers. , 2016, Radiology.

[26]  Yu Zhang,et al.  Learning to Transfer , 2017, ArXiv.

[27]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Bram van Ginneken,et al.  A large-scale evaluation of automatic pulmonary nodule detection in chest CT using local image features and k-nearest-neighbour classification , 2009, Medical Image Anal..

[29]  Fuchun Sun,et al.  HyperNet: Towards Accurate Region Proposal Generation and Joint Object Detection , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Hichem Frigui,et al.  3-D Active Contour Segmentation Based on Sparse Linear Combination of Training Shapes (SCoTS) , 2017, IEEE Transactions on Medical Imaging.

[32]  Luc Van Gool,et al.  Temporal 3D ConvNets: New Architecture and Transfer Learning for Video Classification , 2017, ArXiv.

[33]  Wei Shen,et al.  Multi-scale Convolutional Neural Networks for Lung Nodule Classification , 2015, IPMI.

[34]  Leonidas J. Guibas,et al.  Taskonomy: Disentangling Task Transfer Learning , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[35]  Bai Ying Lei,et al.  Automatic Scoring of Multiple Semantic Attributes With Multi-Task Feature Leverage: A Study on Pulmonary Nodules in CT Images , 2017, IEEE Transactions on Medical Imaging.

[36]  Bram van Ginneken,et al.  Automatic detection of large pulmonary solid nodules in thoracic CT images. , 2015, Medical physics.

[37]  Hao Chen,et al.  Automated Pulmonary Nodule Detection via 3D ConvNets with Online Sample Filtering and Hybrid-Loss Residual Learning , 2017, MICCAI.

[38]  Bram van Ginneken,et al.  Bag-of-Frequencies: A Descriptor of Pulmonary Nodules in Computed Tomography Images , 2015, IEEE Transactions on Medical Imaging.

[39]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[40]  Xiaohui Xie,et al.  DeepEM: Deep 3D ConvNets With EM For Weakly Supervised Pulmonary Nodule Detection , 2018, bioRxiv.