CT-LungNet: A Deep Learning Framework for Precise Lung Tissue Segmentation in 3D Thoracic CT Scans

Segmentation of lung tissue in computed tomography (CT) images is a precursor to most pulmonary image analysis applications. Semantic segmentation methods using deep learning have exhibited top-tier performance in recent years, however designing accurate and robust segmentation models for lung tissue is challenging due to the variations in shape, size, and orientation. Additionally, medical image artifacts and noise can affect lung tissue segmentation and degrade the accuracy of downstream analysis. The practicality of current deep learning methods for lung tissue segmentation is limited as they require significant computational resources and may not be easily deployable in clinical settings. This paper presents a fully automatic method that identifies the lungs in three-dimensional (3D) pulmonary CT images using deep networks and transfer learning. We introduce (1) a novel 2.5-dimensional image representation from consecutive CT slices that succinctly represents volumetric information and (2) a U-Net architecture equipped with pre-trained InceptionV3 blocks to segment 3D CT scans while maintaining the number of learnable parameters as low as possible. Our method was quantitatively assessed using one public dataset, LUNA16, for training and testing and two public datasets, namely, VESSEL12 and CRPF, only for testing. Due to the low number of learnable parameters, our method achieved high generalizability to the unseen VESSEL12 and CRPF datasets while obtaining superior performance over Luna16 compared to existing methods (Dice coefficients of 99.7, 99.1, and 98.8 over LUNA16, VESSEL12, and CRPF datasets, respectively). We made our method publicly accessible via a graphical user interface at medvispy.ee.kntu.ac.ir.

[1]  Haiying Xia,et al.  HT-Net: hierarchical context-attention transformer network for medical ct image segmentation , 2022, Applied Intelligence.

[2]  Xiuyuan Xu,et al.  LTS-NET: Lung Tissue Segmentation from CT Images using Fully Convolutional Neural Network , 2021, 2021 11th International Conference on Information Science and Technology (ICIST).

[3]  Kuan-Bing Chen,et al.  Lung computed tomography image segmentation based on U-Net network fused with dilated convolution , 2021, Comput. Methods Programs Biomed..

[4]  Tam V. Nguyen,et al.  R2U3D: Recurrent Residual 3D U-Net for Lung Segmentation , 2021, IEEE Access.

[5]  Narendra D. Londhe,et al.  A deep Residual U-Net convolutional neural network for automated lung segmentation in computed tomography images , 2020 .

[6]  Shenghua Gao,et al.  CE-Net: Context Encoder Network for 2D Medical Image Segmentation , 2019, IEEE Transactions on Medical Imaging.

[7]  W. Qian,et al.  Segmentation of lung parenchyma in CT images using CNN trained with the clustering algorithm generated dataset , 2019, Biomedical engineering online.

[8]  Jeovane H. Alves,et al.  Extracting Lungs from CT Images Using Fully Convolutional Networks , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[9]  Vijayan K. Asari,et al.  Recurrent Residual Convolutional Neural Network based on U-Net (R2U-Net) for Medical Image Segmentation , 2018, ArXiv.

[10]  Hamid Abrishami Moghaddam,et al.  A new model-based framework for lung tissue segmentation in three-dimensional thoracic CT images , 2018, Signal Image Video Process..

[11]  Brahim Ait Skourt,et al.  Lung CT Image Segmentation Using Deep Neural Networks , 2018 .

[12]  Isabelle Bloch,et al.  From neonatal to adult brain MR image segmentation in a few seconds using 3D-like fully convolutional network and transfer learning , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[13]  Hao Chen,et al.  Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: The LUNA16 challenge , 2016, Medical Image Anal..

[14]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[16]  Ayman El-Baz,et al.  Accurate Lungs Segmentation on CT Chest Images by Adaptive Appearance-Guided Shape Modeling , 2017, IEEE Transactions on Medical Imaging.

[17]  Song Wang,et al.  Three-Dimensional CT Image Segmentation by Combining 2D Fully Convolutional Network with 3D Majority Voting , 2016, LABELS/DLMIA@MICCAI.

[18]  Jaime S. Cardoso,et al.  Deep Learning and Data Labeling for Medical Applications , 2016, Lecture Notes in Computer Science.

[19]  Christopher Joseph Pal,et al.  The Importance of Skip Connections in Biomedical Image Segmentation , 2016, LABELS/DLMIA@MICCAI.

[20]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[23]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[24]  Mert R. Sabuncu,et al.  Multi-atlas segmentation of biomedical images: A survey , 2014, Medical Image Anal..

[25]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[28]  Sung Bum Pan,et al.  Automatic lung segmentation for large-scale medical image management , 2016, Multimedia Tools and Applications.

[29]  Matthew Toews,et al.  Robust Initialization of Active Shape Models for Lung Segmentation in CT Scans: A Feature-Based Atlas Approach , 2014, Int. J. Biomed. Imaging.

[30]  Valery Naranjo,et al.  Comparing algorithms for automated vessel segmentation in computed tomography scans of the lung: the VESSEL12 study , 2014, Medical Image Anal..

[31]  Timo Kohlberger,et al.  Lung Segmentation from CT with Severe Pathologies Using Anatomical Constraints , 2014, MICCAI.

[32]  智一 吉田,et al.  Efficient Graph-Based Image Segmentationを用いた圃場図自動作成手法の検討 , 2014 .

[33]  Reinhard Beichel,et al.  Automated 3-D Segmentation of Lungs With Lung Cancer in CT Data Using a Novel Robust Active Shape Model Approach , 2012, IEEE Transactions on Medical Imaging.

[34]  M. Valliammai,et al.  Lungs Segmentation using Multi-level Thresholding in CT Images , 2012 .

[35]  Richard C. Pais,et al.  The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): a completed reference database of lung nodules on CT scans. , 2011, Medical physics.

[36]  A. P. Reeves,et al.  A public image database to support research in computer aided diagnosis , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[37]  B. van Ginneken,et al.  Automatic lung segmentation from thoracic computed tomography scans using a hybrid approach with error detection. , 2009, Medical physics.

[38]  Jamshid Dehmeshki,et al.  Segmentation of Pulmonary Nodules in Thoracic CT Scans: A Region Growing Approach , 2008, IEEE Transactions on Medical Imaging.

[39]  Bram van Ginneken,et al.  Computer analysis of computed tomography scans of the lung: a survey , 2006, IEEE Transactions on Medical Imaging.

[40]  Hamid Abrishami Moghaddam,et al.  A New Segmentation Method for Lung HRCT Images , 2005, Digital Image Computing: Techniques and Applications (DICTA'05).

[41]  Javad Alirezaie,et al.  Automatic lung segmentation in CT images using watershed transform , 2005, IEEE International Conference on Image Processing 2005.

[42]  S. Armato,et al.  Automated lung segmentation for thoracic CT impact on computer-aided diagnosis. , 2004, Academic radiology.

[43]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[44]  Eric A. Hoffman,et al.  Automatic lung segmentation for accurate quantitation of volumetric X-ray CT images , 2001, IEEE Transactions on Medical Imaging.

[45]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[46]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[47]  H L Kundel,et al.  Global and segmented search for lung nodules of different edge gradients. , 1980, Investigative radiology.

[48]  V.,et al.  A Spatial Thresholding Method for Image Segmentation , 2022 .