2.75D Convolutional Neural Network for Pulmonary Nodule Classification in Chest CT

Early detection and classification of pulmonary nodules in Chest Computed tomography (CT) images is an essential step for effective treatment of lung cancer. However, due to the large volume of CT data, finding nodules in chest CT is a time consuming thus error prone task for radiologists. Benefited from the recent advances in Convolutional Neural Networks (ConvNets), many algorithms based on ConvNets for automatic nodule detection have been proposed. According to the data representation in their input, these algorithms can be further categorized into: 2D, 3D and 2.5D which uses a combination of 2D images to approximate 3D information. Leveraging 3D spatial and contextual information, the method using 3D input generally outperform that based on 2D or 2.5D input, whereas its large memory footprints becomes the bottleneck for many applications. In this paper, we propose a novel 2D data representation of a 3D CT volume, which is constructed by spiral scanning a set of radials originated from the 3D volume center, referred to as the 2.75D. Comparing to the 2.5D, the 2.75D representation captures omni-directional spatial information of a 3D volume. Based on 2.75D representation of 3D nodule candidates in Chest CT, we train a convolutional neural network to perform the false positive reduction in the nodule detection pipeline. We evaluate the nodule false positive reduction system on the LUNA16 data set which contains 1186 nodules out of 551,065 candidates. By comparing 2.75D with 2D, 2.5D and 3D, we show that our system using 2.75D input outperforms 2D and 2.5D, yet slightly inferior to the systems using 3D input. The proposed strategy dramatically reduces the memory consumption thus allow fast inference and training by enabling larger number of batches comparing to the methods using 3D input.

[1]  Fei-Fei Li,et al.  Large-Scale Video Classification with Convolutional Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Bram van Ginneken,et al.  Automatic detection of subsolid pulmonary nodules in thoracic computed tomography images , 2014, Medical Image Anal..

[3]  Guixia Kang,et al.  Multiview convolutional neural networks for lung nodule classification , 2017, Int. J. Imaging Syst. Technol..

[4]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[5]  Anthony P. Reeves,et al.  Three-dimensional segmentation and growth-rate estimation of small pulmonary nodules in helical CT images , 2003, IEEE Transactions on Medical Imaging.

[6]  Binsheng Zhao,et al.  Small pulmonary nodules: volumetrically determined growth rates based on CT evaluation. , 2000, Radiology.

[7]  Hao Chen,et al.  Multilevel Contextual 3-D CNNs for False Positive Reduction in Pulmonary Nodule Detection , 2017, IEEE Transactions on Biomedical Engineering.

[8]  Rajiv Gupta,et al.  Small pulmonary nodules: evaluation with repeat CT--preliminary experience. , 1999, Radiology.

[9]  Dazhe Zhao,et al.  Accurate Lung Segmentation For X-ray CT Images , 2007, Third International Conference on Natural Computation (ICNC 2007).

[10]  Kunio Doi,et al.  Computer-aided diagnosis for improved detection of lung nodules by use of posterior-anterior and lateral chest radiographs. , 2007, Academic radiology.

[11]  Hao Chen,et al.  Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: The LUNA16 challenge , 2016, Medical Image Anal..

[12]  S. Armato,et al.  Computerized detection of pulmonary nodules on CT scans. , 1999, Radiographics : a review publication of the Radiological Society of North America, Inc.

[13]  Matthew T. Freedman,et al.  Reduction of false positives in lung nodule detection using a two-level neural classification , 1996, IEEE Trans. Medical Imaging.

[14]  Terry M. Peters,et al.  Medical Image Computing and Computer Assisted Intervention – MICCAI 2019: 22nd International Conference, Shenzhen, China, October 13–17, 2019, Proceedings, Part IV , 2019, MICCAI.

[15]  Aimin Hao,et al.  Multi-view multi-scale CNNs for lung nodule type classification from CT images , 2018, Pattern Recognit..

[16]  Jun Zhao,et al.  Automatic Detection of Lung Nodules Using 3D Deep Convolutional Neural Networks , 2019 .

[17]  Noboru Niki,et al.  Classification of pulmonary nodules in thin-section CT images based on shape characterization , 1997, Proceedings of International Conference on Image Processing.

[18]  Matthew T. Freedman,et al.  Artificial convolution neural network techniques and applications for lung nodule detection , 1995, IEEE Trans. Medical Imaging.

[19]  Richard C. Pais,et al.  The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): a completed reference database of lung nodules on CT scans. , 2011, Medical physics.

[20]  Bram van Ginneken,et al.  Pulmonary Nodule Detection in CT Images: False Positive Reduction Using Multi-View Convolutional Networks , 2016, IEEE Transactions on Medical Imaging.

[21]  Andinet Enquobahrie,et al.  Automated detection of pulmonary nodules from whole lung helical CT scans: performance comparison for isolated and attached nodules , 2004, SPIE Medical Imaging.

[22]  Eric A. Hoffman,et al.  Automatic lung segmentation for accurate quantitation of volumetric X-ray CT images , 2001, IEEE Transactions on Medical Imaging.

[23]  Raunak Dey,et al.  Diagnostic classification of lung nodules using 3D neural networks , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[24]  Bram van Ginneken,et al.  A large-scale evaluation of automatic pulmonary nodule detection in chest CT using local image features and k-nearest-neighbour classification , 2009, Medical Image Anal..

[25]  R. Engelmann,et al.  Segmentation of pulmonary nodules in three-dimensional CT images by use of a spiral-scanning technique. , 2007, Medical physics.

[26]  Heinz-Otto Peitgen,et al.  Fast Automated Segmentation and Reproducible Volumetry of Pulmonary Metastases in CT-Scans for Therapy Monitoring , 2004, MICCAI.

[27]  Max A. Viergever,et al.  On Combining Computer-Aided Detection Systems , 2011, IEEE Transactions on Medical Imaging.

[28]  Yongdong Zhang,et al.  Automated pulmonary nodule detection in CT images using deep convolutional neural networks , 2019, Pattern Recognit..

[29]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[30]  Adin Ramirez Rivera,et al.  Large residual multiple view 3D CNN for false positive reduction in pulmonary nodule detection , 2017, 2017 IEEE Conference on Computational Intelligence in Bioinformatics and Computational Biology (CIBCB).

[31]  Guixia Kang,et al.  3D multi-view convolutional neural networks for lung nodule classification , 2017, PloS one.

[32]  Christopher J. Taylor,et al.  Medical Image Computing and Computer-Assisted Intervention – MICCAI 2009 , 2009, Lecture Notes in Computer Science.

[33]  Amr Badr,et al.  Lung Cancer Detection and Classification with 3D Convolutional Neural Network (3D-CNN) , 2017 .

[34]  Bram van Ginneken,et al.  Automatic detection of large pulmonary solid nodules in thoracic CT images. , 2015, Medical physics.

[35]  William A. Lampeter,et al.  Computer-Aided Detection of Pulmonary Nodules , 1985 .

[36]  Wei Shen,et al.  Multi-scale Convolutional Neural Networks for Lung Nodule Classification , 2015, IPMI.

[37]  Hüseyin Polat,et al.  Classification of Pulmonary CT Images by Using Hybrid 3D-Deep Convolutional Neural Network Architecture , 2019, Applied Sciences.

[38]  Vivek Vaidya,et al.  Lung nodule detection in CT using 3D convolutional neural networks , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[39]  Christian Igel,et al.  Deep Feature Learning for Knee Cartilage Segmentation Using a Triplanar Convolutional Neural Network , 2013, MICCAI.

[40]  Dennis Wollersheim,et al.  Pulmonary nodule classification with deep residual networks , 2017, International Journal of Computer Assisted Radiology and Surgery.