Automated pulmonary nodule detection in CT images using deep convolutional neural networks

Abstract Lung cancer is one of the leading causes of cancer-related death worldwide. Early diagnosis can effectively reduce the mortality, and computer-aided diagnosis (CAD) as an important way to assist doctors has developed rapidly. In particular, automated pulmonary nodule detection in computed tomography (CT) images is crucial to CAD. It is a challenging task to quickly locate the exact positions of lung nodules. In this paper, a novel automated pulmonary nodule detection framework with 2D convolutional neural network (CNN) is proposed to assist the CT reading process. Firstly, we adjust the structure of Faster R-CNN with two region proposal networks and a deconvolutional layer to detect nodule candidates, and then three models are trained for three kinds of slices for later result fusion. Secondly, a boosting architecture based on 2D CNN is designed for false positive reduction, which is a classifier to distinguish true nodules from the candidates. The misclassified samples are still kept for retraining a model which boosts the sensitivity for pulmonary nodule detection. Finally, the results of these networks are fused to vote out the final classification results. Extensive experiments are conducted on LUNA16, and the sensitivity of nodule candidate detection achieves 86.42%. For the false positive reduction, the sensitivity reaches 73.4% and 74.4% at 1/8 and 1/4 FPs/scan, respectively. It illustrates that the proposed method can obviously achieve accurate pulmonary nodule detection.

[1]  Temesguen Messay,et al.  A new computationally efficient CAD system for pulmonary nodule detection in CT imagery , 2010, Medical Image Anal..

[2]  Yi Li,et al.  R-FCN: Object Detection via Region-based Fully Convolutional Networks , 2016, NIPS.

[3]  Hao Chen,et al.  Automated Pulmonary Nodule Detection via 3D ConvNets with Online Sample Filtering and Hybrid-Loss Residual Learning , 2017, MICCAI.

[4]  Nima Tajbakhsh,et al.  Comparing two classes of end-to-end machine-learning models in lung nodule detection and classification: MTANNs vs. CNNs , 2017, Pattern Recognit..

[5]  Lijun Xie,et al.  A regularized ensemble framework of deep learning for cancer detection from multi-class, imbalanced training data , 2018, Pattern Recognit..

[6]  Wei Li,et al.  A multi-kernel based framework for heterogeneous feature selection and over-sampling for computer-aided detection of pulmonary nodules , 2017, Pattern Recognit..

[7]  Sabina Sonia Tangaro,et al.  Automatic Lung Segmentation in CT Images with Accurate Handling of the Hilar Region , 2011, Journal of Digital Imaging.

[8]  Hao Chen,et al.  Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: The LUNA16 challenge , 2016, Medical Image Anal..

[9]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[10]  He Ma,et al.  An Automatic Detection System of Lung Nodule Based on Multigroup Patch-Based Deep Learning Network , 2018, IEEE Journal of Biomedical and Health Informatics.

[11]  A. Jemal,et al.  Global cancer statistics, 2012 , 2015, CA: a cancer journal for clinicians.

[12]  Bram van Ginneken,et al.  Automatic detection of subsolid pulmonary nodules in thoracic computed tomography images , 2014, Medical Image Anal..

[13]  Jan Cornelis,et al.  A novel computer-aided lung nodule detection system for CT images. , 2011, Medical physics.

[14]  Roberto Bellotti,et al.  3-D object segmentation using ant colonies , 2010, Pattern Recognit..

[15]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[16]  Bram van Ginneken,et al.  Computer analysis of computed tomography scans of the lung: a survey , 2006, IEEE Transactions on Medical Imaging.

[17]  Éloi Bossé,et al.  An iterative possibilistic knowledge diffusion approach for blind medical image segmentation , 2018, Pattern Recognit..

[18]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[19]  Hao Chen,et al.  Multilevel Contextual 3-D CNNs for False Positive Reduction in Pulmonary Nodule Detection , 2017, IEEE Transactions on Biomedical Engineering.

[20]  Bram van Ginneken,et al.  Automatic detection of large pulmonary solid nodules in thoracic CT images. , 2015, Medical physics.

[21]  Richard C. Pais,et al.  The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): a completed reference database of lung nodules on CT scans. , 2011, Medical physics.

[22]  Nikos Komodakis,et al.  Wide Residual Networks , 2016, BMVC.

[23]  Ilaria Gori,et al.  Comparing and combining algorithms for computer-aided detection of pulmonary nodules in computed tomography scans: The ANODE09 study , 2010, Medical Image Anal..

[24]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Aimin Hao,et al.  Multi-view multi-scale CNNs for lung nodule type classification from CT images , 2018, Pattern Recognit..

[26]  Wen-Huang Cheng,et al.  Computer-aided classification of lung nodules on computed tomography images via deep learning technique , 2015, OncoTargets and therapy.

[27]  Yongdong Zhang,et al.  Supervised Hash Coding With Deep Neural Network for Environment Perception of Intelligent Vehicles , 2018, IEEE Transactions on Intelligent Transportation Systems.

[28]  Wen-Huang Cheng,et al.  Background Extraction Based on Joint Gaussian Conditional Random Fields , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[29]  Sheng Tang,et al.  Robust common visual pattern discovery using graph matching , 2013, J. Vis. Commun. Image Represent..

[30]  Mario Ignacio Chacon Murguia,et al.  Automatic Segmentation of Regions of Interest in Breast Thermographic Images , 2015, Mexican Conference on Pattern Recognition.

[31]  Takeo Kanade,et al.  A Semi-Markov Model for Mitosis Segmentation in Time-Lapse Phase Contrast Microscopy Image Sequences of Stem Cell Populations , 2012, IEEE Transactions on Medical Imaging.

[32]  Bram van Ginneken,et al.  Pulmonary Nodule Detection in CT Images: False Positive Reduction Using Multi-View Convolutional Networks , 2016, IEEE Transactions on Medical Imaging.

[33]  Wen-Huang Cheng,et al.  Background Extraction Using Random Walk Image Fusion , 2018, IEEE Transactions on Cybernetics.

[34]  Geoffrey E. Hinton,et al.  On the importance of initialization and momentum in deep learning , 2013, ICML.

[35]  Kai Zhang,et al.  Deep learning for image-based cancer detection and diagnosis - A survey , 2018, Pattern Recognit..

[36]  Mohan S. Kankanhalli,et al.  Hierarchical Clustering Multi-Task Learning for Joint Human Action Grouping and Recognition , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Wen-Huang Cheng,et al.  Gestalt Rule Feature Points , 2015, IEEE Transactions on Multimedia.

[38]  C Peroni,et al.  Large scale validation of the M5L lung CAD on heterogeneous CT datasets. , 2015, Medical physics.

[39]  Bram van Ginneken,et al.  A large-scale evaluation of automatic pulmonary nodule detection in chest CT using local image features and k-nearest-neighbour classification , 2009, Medical Image Anal..

[40]  Wei Shen,et al.  Multi-crop Convolutional Neural Networks for lung nodule malignancy suspiciousness classification , 2017, Pattern Recognit..

[41]  Jinhui Tang,et al.  Multi-Grained Random Fields for Mitosis Identification in Time-Lapse Phase Contrast Microscopy Image Sequences , 2017, IEEE Transactions on Medical Imaging.

[42]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[43]  Chenggang Clarence Yan,et al.  Supervised deep quantization for efficient image search , 2017, 2017 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[44]  Xiaohui Xie,et al.  DeepLung: 3D Deep Convolutional Nets for Automated Pulmonary Nodule Detection and Classification , 2017, bioRxiv.

[45]  Alberto Traverso,et al.  Computer-aided detection systems to improve lung cancer early diagnosis: state-of-the-art and challenges , 2017 .

[46]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[47]  Sergio Guadarrama,et al.  Speed/Accuracy Trade-Offs for Modern Convolutional Object Detectors , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[48]  Yongdong Zhang,et al.  Local geometric consistency constraint for image retrieval , 2011, 2011 18th IEEE International Conference on Image Processing.

[49]  Robert E. Schapire,et al.  A Brief Introduction to Boosting , 1999, IJCAI.

[50]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[51]  Aoxue Li,et al.  Accurate Pulmonary Nodule Detection in Computed Tomography Images Using Deep Convolutional Neural Networks , 2017, MICCAI.

[52]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[53]  Xiaoyan Gu,et al.  Detecting Uyghur text in complex background images with convolutional neural network , 2017, Multimedia Tools and Applications.