LungSeg-Net: Lung field segmentation using generative adversarial network

Abstract Automatic lung segmentation is an essential step towards the Computer-Aided Diagnosis of the lung CT scan. However, in presence of dense abnormalities, existing methods fail in accurate lung segmentation. In this paper, a generative adversarial networks-based approach is proposed for improving the accuracy of lung segmentation. The proposed network effectively segments the lung region from the surrounding chest region hence, named as LungSeg-Net. In the proposed LungSeg-Net, the input lung CT slices are processed through the trail of encoders which encode these slices into a set of feature maps. Further, a multi-scale dense-feature extraction (MSDFE) module is designed for extraction of multi-scale features from the set of encoded feature maps. Finally, the decoders are employed to obtain the lung segmentation map from the multi-scale features. The MSDFE makes the network to learn the relevant features of dense abnormalities whereas the iterative down-sampling followed by the up-sampling makes it invariant to the size of the dense abnormality. The publicly available benchmark ILD dataset is used for the experimental analysis. The qualitative and quantitative analysis has been carried out to compare the performance of the proposed network with the existing state-of-the-art methods for lung segmentation. The experimental analysis show that the performance of the proposed LungSeg-Net is invariant to the presence of dense abnormalities in lung CT scan.

[1]  S. S. Kumar,et al.  Segmentation of lung from CT using various active contour models , 2019, Biomed. Signal Process. Control..

[2]  Aly A. Farag,et al.  A Novel Approach for Lung Nodules Segmentation in Chest CT Using Level Sets , 2013, IEEE Transactions on Image Processing.

[3]  Ronald M. Summers,et al.  Spatial aggregation of holistically‐nested convolutional neural networks for automated pancreas localization and segmentation☆ , 2017, Medical Image Anal..

[4]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[5]  Jason Cong,et al.  An automated lung segmentation approach using bidirectional chain codes to improve nodule detection accuracy , 2015, Comput. Biol. Medicine.

[6]  Qaisar Abbas,et al.  Segmentation of differential structures on computed tomography images for diagnosis lung-related diseases , 2017, Biomed. Signal Process. Control..

[7]  João Manuel R. S. Tavares,et al.  Novel and powerful 3D adaptive crisp active contour method applied in the segmentation of CT lung images , 2017, Medical Image Anal..

[8]  David Beymer,et al.  Automated volumetric lung segmentation of thoracic CT images using fully convolutional neural network , 2018, Medical Imaging.

[9]  Huichuan Duan,et al.  3D computerized segmentation of lung volume with computed tomography. , 2006, Academic radiology.

[10]  Andrea Vedaldi,et al.  Instance Normalization: The Missing Ingredient for Fast Stylization , 2016, ArXiv.

[11]  Bram van Ginneken,et al.  Pulmonary Nodule Detection in CT Images: False Positive Reduction Using Multi-View Convolutional Networks , 2016, IEEE Transactions on Medical Imaging.

[12]  Fereidoun Abtin,et al.  Automatic segmentation of lung parenchyma in the presence of diseases based on curvature of ribs. , 2008, Academic radiology.

[13]  Eric A. Hoffman,et al.  Automatic lung segmentation for accurate quantitation of volumetric X-ray CT images , 2001, IEEE Transactions on Medical Imaging.

[14]  Subrahmanyam Murala,et al.  RYF-Net: Deep Fusion Network for Single Image Haze Removal , 2020, IEEE Transactions on Image Processing.

[15]  Julia A. Schnabel,et al.  A level-set approach to joint image segmentation and registration with application to CT lung imaging , 2017, Comput. Medical Imaging Graph..

[16]  S. Armato,et al.  Automated lung segmentation for thoracic CT impact on computer-aided diagnosis. , 2004, Academic radiology.

[17]  Mingyong Pang,et al.  Automatic lung segmentation based on image decomposition and wavelet transform , 2020, Biomed. Signal Process. Control..

[18]  Bram van Ginneken,et al.  Toward automated segmentation of the pathological lung in CT , 2005, IEEE Transactions on Medical Imaging.

[19]  Jacek M. Zurada,et al.  3-D Lung Segmentation by Incremental Constrained Nonnegative Matrix Factorization , 2016, IEEE Transactions on Biomedical Engineering.

[20]  Junfeng Chen,et al.  Global optimal hybrid geometric active contour for automated lung segmentation on CT images , 2017, Comput. Biol. Medicine.

[21]  Sanjay N. Talbar,et al.  Radiomics for peripheral zone and intra-prostatic urethra segmentation in MR imaging , 2019, Biomed. Signal Process. Control..

[22]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[23]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Ronald M. Summers,et al.  Progressive and Multi-path Holistically Nested Neural Networks for Pathological Lung Segmentation from CT Images , 2017, MICCAI.

[25]  Subrahmanyam Murala,et al.  FgGAN: A Cascaded Unpaired Learning for Background Estimation and Foreground Segmentation , 2019, 2019 IEEE Winter Conference on Applications of Computer Vision (WACV).

[26]  David Gur,et al.  Automated lung segmentation in X-ray computed tomography: development and evaluation of a heuristic threshold-based scheme. , 2003, Academic radiology.

[27]  Vijayan K. Asari,et al.  Recurrent Residual Convolutional Neural Network based on U-Net (R2U-Net) for Medical Image Segmentation , 2018, ArXiv.

[28]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[29]  Shinichi Tamura,et al.  Automated lung segmentation and smoothing techniques for inclusion of juxtapleural nodules and pulmonary vessels on chest CT images , 2014, Biomed. Signal Process. Control..

[30]  Lisheng Xu,et al.  Segmentation of lung parenchyma in CT images using CNN trained with the clustering algorithm generated dataset , 2019, BioMedical Engineering OnLine.

[31]  J. Roth,et al.  Survival in early-stage non-small cell lung cancer. , 1995, The Annals of thoracic surgery.

[32]  Seiichiro Kagei,et al.  Integrated lung field segmentation of injured region with anatomical structure analysis by failure-recovery algorithm from chest CT images , 2014, Biomed. Signal Process. Control..

[33]  B. van Ginneken,et al.  Automatic lung segmentation from thoracic computed tomography scans using a hybrid approach with error detection. , 2009, Medical physics.

[34]  Michael F. McNitt-Gray,et al.  Method for segmenting chest CT image data using an anatomical model: preliminary results , 1997, IEEE Transactions on Medical Imaging.

[35]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[36]  Sanjay Talbar,et al.  Deep Deconvolutional Residual Network Based Automatic Lung Nodule Segmentation , 2020, Journal of Digital Imaging.

[37]  Zhenyu Liu,et al.  Central focused convolutional neural networks: Developing a data-driven model for lung nodule segmentation , 2017, Medical Image Anal..

[38]  Tao Zhou,et al.  Automatic lung nodule detection using a 3D deep convolutional neural network combined with a multi-scale prediction strategy in chest CTs , 2018, Comput. Biol. Medicine.

[39]  Sanjay N. Talbar,et al.  Automatic lung segmentation for the inclusion of juxtapleural nodules and pulmonary vessels using curvature based border correction , 2018, J. King Saud Univ. Comput. Inf. Sci..

[40]  A. Jemal,et al.  Cancer statistics, 2020 , 2020, CA: a cancer journal for clinicians.

[41]  Antoine Geissbühler,et al.  Building a reference multimedia database for interstitial lung diseases , 2012, Comput. Medical Imaging Graph..

[42]  Tae-Sun Choi,et al.  Genetic programming-based feature transform and classification for the automatic detection of pulmonary nodules on computed tomography images , 2012, Inf. Sci..

[43]  J W Sayre,et al.  Knowledge-based segmentation of thoracic computed tomography images for assessment of split lung function. , 2000, Medical physics.

[44]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[45]  Subrahmanyam Murala,et al.  RescueNet: An unpaired GAN for brain tumor segmentation , 2020, Biomed. Signal Process. Control..

[46]  David Dagan Feng,et al.  Feature-Based Image Patch Approximation for Lung Tissue Classification , 2013, IEEE Transactions on Medical Imaging.

[47]  Yi Ding,et al.  RUN: Residual U-Net for Computer-Aided Detection of Pulmonary Nodules without Candidate Selection , 2018, ArXiv.

[48]  Jamshid Dehmeshki,et al.  Shape-Based Computer-Aided Detection of Lung Nodules in Thoracic CT Images , 2009, IEEE Transactions on Biomedical Engineering.

[49]  David P. Naidich,et al.  High-Resolution CT of the Lung , 1997 .

[50]  Geoffrey D. Rubin,et al.  Adaptive border marching algorithm: Automatic lung segmentation on chest CT images , 2008, Comput. Medical Imaging Graph..

[51]  Jacek M. Zurada,et al.  Lung segmentation based on Nonnegative Matrix Factorization , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[52]  Xiaoming Liu,et al.  Automatic Organ Segmentation for CT Scans Based on Super-Pixel and Convolutional Neural Networks , 2018, Journal of Digital Imaging.

[53]  Subrahmanyam Murala,et al.  Motion Saliency Based Generative Adversarial Network for Underwater Moving Object Segmentation , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[54]  Yong Li,et al.  Improved U-NET network for pulmonary nodules segmentation , 2018, Optik.

[55]  A. Mearns,et al.  Results of surgical treatment of stage I and II lung cancer. , 1996, The Journal of cardiovascular surgery.