3D deep learning for detecting pulmonary nodules in CT scans

Objective To demonstrate and test the validity of a novel deep-learning-based system for the automated detection of pulmonary nodules. Materials and Methods The proposed system uses 2 3D deep learning models, 1 for each of the essential tasks of computer-aided nodule detection: candidate generation and false positive reduction. A total of 888 scans from the LIDC-IDRI dataset were used for training and evaluation. Results Results for candidate generation on the test data indicated a detection rate of 94.77% with 30.39 false positives per scan, while the test results for false positive reduction exhibited a sensitivity of 94.21% with 1.789 false positives per scan. The overall system detection rate on the test data was 89.29% with 1.789 false positives per scan. Discussion An extensive and rigorous validation was conducted to assess the performance of the proposed system. The system demonstrated a novel combination of 3D deep neural network architectures and demonstrates the use of deep learning for both candidate generation and false positive reduction to be evaluated with a substantial test dataset. The results strongly support the ability of deep learning pulmonary nodule detection systems to generalize to unseen data. The source code and trained model weights have been made available. Conclusion A novel deep-neural-network-based pulmonary nodule detection system is demonstrated and validated. The results provide comparison of the proposed deep-learning-based system over other similar systems based on performance.

[1]  C. Mathers,et al.  Cancer incidence and mortality worldwide: Sources, methods and major patterns in GLOBOCAN 2012 , 2015, International journal of cancer.

[2]  Bram van Ginneken,et al.  Off-the-shelf convolutional neural network features for pulmonary nodule detection in computed tomography scans , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[3]  Peter Herzog,et al.  Computer-aided diagnosis as a second reader: spectrum of findings in CT studies of the chest interpreted as normal. , 2005, Chest.

[4]  Christian Igel,et al.  Deep Feature Learning for Knee Cartilage Segmentation Using a Triplanar Convolutional Neural Network , 2013, MICCAI.

[5]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[6]  Berkman Sahiner,et al.  3D convolutional neural network for automatic detection of lung nodules in chest CT , 2017, Medical Imaging.

[7]  David Gur,et al.  Area under the Free‐Response ROC Curve (FROC) and a Related Summary Index , 2009, Biometrics.

[8]  Wei Shen,et al.  Multi-scale Convolutional Neural Networks for Lung Nodule Classification , 2015, IPMI.

[9]  Hao Chen,et al.  Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: The LUNA16 challenge , 2016, Medical Image Anal..

[10]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Lilla Böröczky,et al.  Feature Subset Selection for Improving the Performance of False Positive Reduction in Lung Nodule CAD , 2005, IEEE Transactions on Information Technology in Biomedicine.

[12]  Tae-Sun Choi,et al.  Genetic programming-based feature transform and classification for the automatic detection of pulmonary nodules on computed tomography images , 2012, Inf. Sci..

[13]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[14]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[15]  Jamshid Dehmeshki,et al.  Automated detection of lung nodules in CT images using shape-based genetic algorithm , 2007, Comput. Medical Imaging Graph..

[16]  Hao Chen,et al.  Multilevel Contextual 3-D CNNs for False Positive Reduction in Pulmonary Nodule Detection , 2017, IEEE Transactions on Biomedical Engineering.

[17]  Temesguen Messay,et al.  A new computationally efficient CAD system for pulmonary nodule detection in CT imagery , 2010, Medical Image Anal..

[18]  Ashish Gupta,et al.  Using Deep Learning for Pulmonary Nodule Detection & Diagnosis , 2016, AMCIS.

[19]  Zhenyu Liu,et al.  Central focused convolutional neural networks: Developing a data-driven model for lung nodule segmentation , 2017, Medical Image Anal..

[20]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.

[21]  5. Extensions to Conventional ROC Methodology: LROC, FROC, and AFROC , 2008 .

[22]  S. Armato,et al.  Computerized detection of pulmonary nodules on CT scans. , 1999, Radiographics : a review publication of the Radiological Society of North America, Inc.

[23]  Berkman Sahiner,et al.  Lung nodule detection on thoracic computed tomography images: preliminary evaluation of a computer-aided diagnosis system. , 2002, Medical physics.

[24]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[25]  Hao Chen,et al.  Volumetric ConvNets with Mixed Residual Connections for Automated Prostate Segmentation from 3D MR Images , 2017, AAAI.

[26]  Tae-Sun Choi,et al.  Automated pulmonary nodule detection based on three-dimensional shape-based feature descriptor , 2014, Comput. Methods Programs Biomed..

[27]  Max A. Viergever,et al.  On Combining Computer-Aided Detection Systems , 2011, IEEE Transactions on Medical Imaging.

[28]  Jorge Juan Suárez-Cuenca,et al.  Application of the iris filter for automatic detection of pulmonary nodules on computed tomography images , 2009, Comput. Biol. Medicine.

[29]  Luca Maria Gambardella,et al.  Deep Neural Networks Segment Neuronal Membranes in Electron Microscopy Images , 2012, NIPS.

[30]  S. Armato,et al.  Massive training artificial neural network (MTANN) for reduction of false positives in computerized detection of lung nodules in low-dose computed tomography. , 2003, Medical physics.

[31]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[32]  Matthew T. Freedman,et al.  Artificial convolution neural network techniques and applications for lung nodule detection , 1995, IEEE Trans. Medical Imaging.

[33]  Richard C. Pais,et al.  The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): a completed reference database of lung nodules on CT scans. , 2011, Medical physics.

[34]  Hardeep Singh,et al.  Errors in cancer diagnosis: current understanding and future directions. , 2007, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[35]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[36]  T. Sørensen,et al.  A method of establishing group of equal amplitude in plant sociobiology based on similarity of species content and its application to analyses of the vegetation on Danish commons , 1948 .

[37]  Luca Maria Gambardella,et al.  Mitosis Detection in Breast Cancer Histology Images with Deep Neural Networks , 2013, MICCAI.

[38]  Jan Cornelis,et al.  A novel computer-aided lung nodule detection system for CT images. , 2011, Medical physics.

[39]  Hao Chen,et al.  VoxResNet: Deep voxelwise residual networks for brain segmentation from 3D MR images , 2017, NeuroImage.

[40]  Wei Zhang,et al.  Reduction of false positives in computerized detection of lung nodules in chest radiographs using artificial neural networks, discriminant analysis, and a rule-based scheme , 1994, Journal of Digital Imaging.

[41]  Qiang Li,et al.  Selective enhancement filters for nodules, vessels, and airway walls in two- and three-dimensional CT scans. , 2003, Medical physics.

[42]  Tobias Klinder,et al.  Pulmonary nodule detection using a cascaded SVM classifier , 2016, SPIE Medical Imaging.

[43]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[44]  Sepp Hochreiter,et al.  Self-Normalizing Neural Networks , 2017, NIPS.

[45]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[46]  Ronald M. Summers,et al.  A New 2.5D Representation for Lymph Node Detection Using Random Sets of Deep Convolutional Neural Network Observations , 2014, MICCAI.

[47]  Stephen M. Moore,et al.  The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository , 2013, Journal of Digital Imaging.

[48]  Bram van Ginneken,et al.  Pulmonary Nodule Detection in CT Images: False Positive Reduction Using Multi-View Convolutional Networks , 2016, IEEE Transactions on Medical Imaging.

[49]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[50]  Lubomir M. Hadjiiski,et al.  Computer-aided detection of lung nodules: false positive reduction using a 3D gradient field method and 3D ellipsoid fitting. , 2005, Medical physics.

[51]  D. Lynch,et al.  The National Lung Screening Trial: overview and study design. , 2011, Radiology.

[52]  Jan Cornelis,et al.  Phased searching with NEAT in a Time-Scaled Framework: Experiments on a computer-aided detection system for lung nodules , 2013, Artif. Intell. Medicine.

[53]  Ali Gooya,et al.  Fully automatic detection of lung nodules in CT images using a hybrid feature set , 2017, Medical physics.

[54]  Ricardo A. M. Valentim,et al.  Computer-aided detection (CADe) and diagnosis (CADx) system for lung cancer with likelihood of malignancy , 2016, BioMedical Engineering OnLine.

[55]  Jamshid Dehmeshki,et al.  Shape-Based Computer-Aided Detection of Lung Nodules in Thoracic CT Images , 2009, IEEE Transactions on Biomedical Engineering.

[56]  Bram van Ginneken,et al.  Computer-aided detection of pulmonary nodules: a comparative study using the public LIDC/IDRI database , 2015, European Radiology.

[57]  Kunio Doi,et al.  Computer-aided diagnostic scheme for distinction between benign and malignant nodules in thoracic low-dose CT by use of massive training artificial neural network , 2005, IEEE Transactions on Medical Imaging.

[58]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[59]  Matthew D. Zeiler ADADELTA: An Adaptive Learning Rate Method , 2012, ArXiv.

[60]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[61]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[62]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[63]  M. Roizen Reduced Lung-Cancer Mortality with Low-Dose Computed Tomographic Screening , 2012 .

[64]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[65]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[66]  D. Berry,et al.  Benefits and harms of CT screening for lung cancer: a systematic review. , 2012, JAMA.

[67]  Alejandro F. Frangi,et al.  Fully automatic and accurate detection of lung nodules in CT images using a hybrid feature set. , 2017 .

[68]  Tae-Sun Choi,et al.  Automated Pulmonary Nodule Detection System in Computed Tomography Images: A Hierarchical Block Classification Approach , 2013, Entropy.