NODULe: Combining constrained multi-scale LoG filters with densely dilated 3D deep convolutional neural network for pulmonary nodule detection

Abstract Detection of pulmonary nodules on chest CT is an essential step in the early diagnosis of lung cancer, which is critical for best patient care. In this paper, we propose an automated pulmonary nodule detection algorithm, denoted by NODULe, which jointly uses a conventional method for nodule detection and a deep learning model for genuine nodule identification. Specifically, we first use multi-scale Laplacian of Gaussian (LoG) filters and prior shape and size constraints to detect nodule candidates, and then construct the densely dilated 3D deep convolutional neural network (DCNN), which combines dilated convolutional layers and dense blocks, for simultaneous identification of genuine nodules and estimation of nodule diameters. We have evaluated this algorithm on the benchmark LUng Nodule Analysis 2016 (LUNA16) dataset and achieved a detection score of 0.947, which ranks the 3rd on the LUNA16 Challenge leaderboard, and an average diameter estimation error of 1.23 mm. Our results suggest that the proposed NODULe algorithm can detect pulmonary nodules on chest CT scans effectively and estimate their diameters accurately.

[1]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[2]  Sushmita Mitra,et al.  Medical image analysis for cancer management in natural computing framework , 2015, Inf. Sci..

[3]  Lin Lu,et al.  Hybrid detection of lung nodules on CT scan images. , 2015, Medical physics.

[4]  M. Callister,et al.  How should pulmonary nodules be optimally investigated and managed? , 2016, Lung cancer.

[5]  Zhou Yu,et al.  Beyond Bilinear: Generalized Multimodal Factorized High-Order Pooling for Visual Question Answering , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[6]  Hau-San Wong,et al.  Adaptive activation functions in convolutional neural networks , 2018, Neurocomputing.

[7]  David R Baldwin,et al.  Prediction of risk of lung cancer in populations and in pulmonary nodules: Significant progress to drive changes in paradigms. , 2015, Lung cancer.

[8]  Hao Chen,et al.  Automated Pulmonary Nodule Detection via 3D ConvNets with Online Sample Filtering and Hybrid-Loss Residual Learning , 2017, MICCAI.

[9]  Hao Chen,et al.  Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: The LUNA16 challenge , 2016, Medical Image Anal..

[10]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[11]  Niranjan Khandelwal,et al.  An automated lung nodule detection system for CT images using synthetic minority oversampling , 2016, SPIE Medical Imaging.

[12]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[13]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.

[14]  Richard C. Pais,et al.  The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): a completed reference database of lung nodules on CT scans. , 2011, Medical physics.

[15]  Berkman Sahiner,et al.  3D convolutional neural network for automatic detection of lung nodules in chest CT , 2017, Medical Imaging.

[16]  S. Thrun,et al.  Corrigendum: Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[17]  Jamshid Dehmeshki,et al.  Shape-Based Computer-Aided Detection of Lung Nodules in Thoracic CT Images , 2009, IEEE Transactions on Biomedical Engineering.

[18]  Hengyong Yu,et al.  Correlation coefficient based supervised locally linear embedding for pulmonary nodule recognition , 2016, Comput. Methods Programs Biomed..

[19]  João Manuel R. S. Tavares,et al.  Automatic 3D pulmonary nodule detection in CT images: A survey , 2016, Comput. Methods Programs Biomed..

[20]  Meng Wang,et al.  Multimodal Deep Autoencoder for Human Pose Recovery , 2015, IEEE Transactions on Image Processing.

[21]  Fei Gao,et al.  Deep Multimodal Distance Metric Learning Using Click Constraints for Image Ranking , 2017, IEEE Transactions on Cybernetics.

[22]  J. L. Vercher-Conejero,et al.  N staging of lung cancer patients with PET/MRI using a three-segment model attenuation correction algorithm: Initial experience , 2013, European Radiology.

[23]  Yanning Zhang,et al.  Pulmonary nodule detection in medical images: A survey , 2018, Biomed. Signal Process. Control..

[24]  Giorgio Valentini,et al.  Support vector machines for candidate nodules classification , 2005, Neurocomputing.

[25]  Tony Lindeberg,et al.  Detecting salient blob-like image structures and their scales with a scale-space primal sketch: A method for focus-of-attention , 1993, International Journal of Computer Vision.

[26]  Yanning Zhang,et al.  Fusing texture, shape and deep model-learned information at decision level for automated classification of lung nodules on chest CT , 2018, Inf. Fusion.

[27]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Syed Irtiza Ali Shah,et al.  A novel approach to CAD system for the detection of lung nodules in CT images , 2016, Comput. Methods Programs Biomed..

[29]  Tae-Sun Choi,et al.  Automated pulmonary nodule detection based on three-dimensional shape-based feature descriptor , 2014, Comput. Methods Programs Biomed..

[30]  Tae-Sun Choi,et al.  Genetic programming-based feature transform and classification for the automatic detection of pulmonary nodules on computed tomography images , 2012, Inf. Sci..

[31]  Ezhil E. Nithila,et al.  Automatic detection of solitary pulmonary nodules using swarm intelligence optimized neural networks on CT images , 2017 .

[32]  Wei Shen,et al.  Multi-crop Convolutional Neural Networks for lung nodule malignancy suspiciousness classification , 2017, Pattern Recognit..

[33]  Max A. Viergever,et al.  On Combining Computer-Aided Detection Systems , 2011, IEEE Transactions on Medical Imaging.

[34]  Aurélio Campilho,et al.  Detection of juxta-pleural lung nodules in computed tomography images , 2017, Medical Imaging.

[35]  Bram van Ginneken,et al.  Automatic detection of subsolid pulmonary nodules in thoracic computed tomography images , 2014, Medical Image Anal..

[36]  Zhou Yu,et al.  Multi-modal Factorized Bilinear Pooling with Co-attention Learning for Visual Question Answering , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[37]  David Dagan Feng,et al.  Classification of Medical Images in the Biomedical Literature by Jointly Using Deep and Handcrafted Visual Features , 2018, IEEE Journal of Biomedical and Health Informatics.

[38]  Olivier Salvado,et al.  Automatic detection of small spherical lesions using multiscale approach in 3D medical images , 2013, 2013 IEEE International Conference on Image Processing.

[39]  Anselmo Cardoso de Paiva,et al.  Automatic detection of solitary lung nodules using quality threshold clustering, genetic algorithm and diversity index , 2014, Artif. Intell. Medicine.

[40]  C. Mathers,et al.  Cancer incidence and mortality worldwide: Sources, methods and major patterns in GLOBOCAN 2012 , 2015, International journal of cancer.

[41]  Zhengrong Liang,et al.  Fast and Adaptive Detection of Pulmonary Nodules in Thoracic CT Images Using a Hierarchical Vector Quantization Scheme , 2015, IEEE Journal of Biomedical and Health Informatics.

[42]  Jun Zhao,et al.  Automatic detection of lung nodules: false positive reduction using convolution neural networks and handcrafted features , 2017, Medical Imaging.

[43]  Anselmo Cardoso de Paiva,et al.  Automatic detection of small lung nodules in 3D CT data using Gaussian mixture models, Tsallis entropy and SVM , 2014, Eng. Appl. Artif. Intell..

[44]  Bram van Ginneken,et al.  Pulmonary Nodule Detection in CT Images: False Positive Reduction Using Multi-View Convolutional Networks , 2016, IEEE Transactions on Medical Imaging.

[45]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[46]  Yiguang Liu,et al.  The Euclidean embedding learning based on convolutional neural network for stereo matching , 2017, Neurocomputing.

[47]  David Dagan Feng,et al.  Atlas registration and ensemble deep convolutional neural network-based prostate segmentation using magnetic resonance imaging , 2018, Neurocomputing.

[48]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[49]  Anthony T. Chronopoulos,et al.  Computational intelligence approaches for classification of medical data: State-of-the-art, future challenges and research directions , 2018, Neurocomputing.