Structure Correction for Robust Volume Segmentation in Presence of Tumors.

CNN based lung segmentation models in absence of diverse training dataset fail to segment lung volumes in presence of severe pathologies such as large masses, scars, and tumors. To rectify this problem, we propose a multi-stage algorithm for lung volume segmentation from CT scans. The algorithm uses a 3D CNN in the first stage to obtain a coarse segmentation of the left and right lungs. In the second stage, shape correction is performed on the segmentation mask using a 3D structure correction CNN. A novel data augmentation strategy is adopted to train a 3D CNN which helps in incorporating global shape prior. Finally, the shape corrected segmentation mask is up-sampled and refined using a parallel flood-fill operation. The proposed multi-stage algorithm is robust in the presence of large nodules/tumors and does not require labeled segmentation masks for entire pathological lung volume for training. Through extensive experiments conducted on publicly available datasets such as NSCLC, LUNA, and LOLA11 we demonstrate that the proposed approach improves the recall of large juxtapleural tumor voxels by at least 15% over state-of-the-art models without sacrificing segmentation accuracy in case of normal lungs. The proposed method also meets the requirement of CAD software by performing segmentation within 5 seconds which is significantly faster than present methods.

[1]  Junzhou Huang,et al.  Towards robust and effective shape modeling: Sparse shape composition , 2012, Medical Image Anal..

[2]  Nima Tajbakhsh,et al.  Fast and automatic segmentation of pulmonary lobes from chest CT using a progressive dense V-network , 2019, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[3]  João Manuel R. S. Tavares,et al.  Novel and powerful 3D adaptive crisp active contour method applied in the segmentation of CT lung images , 2017, Medical Image Anal..

[4]  Richard C. Pais,et al.  The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): a completed reference database of lung nodules on CT scans. , 2011, Medical physics.

[5]  D. Mollura,et al.  Segmentation and Image Analysis of Abnormal Lungs at CT: Current Approaches, Challenges, and Future Trends. , 2015, Radiographics : a review publication of the Radiological Society of North America, Inc.

[6]  Zhaozheng Yin,et al.  Lung segmentation in CT images using a fully convolutional neural network with multi-instance and conditional adversary loss , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[7]  Yadong Wang,et al.  Low‐rank and sparse decomposition based shape model and probabilistic atlas for automatic pathological organ segmentation , 2017, Medical Image Anal..

[8]  Shinichi Tamura,et al.  Automated lung segmentation and smoothing techniques for inclusion of juxtapleural nodules and pulmonary vessels on chest CT images , 2014, Biomed. Signal Process. Control..

[9]  David W. Kaczka,et al.  Multi-resolution convolutional neural networks for fully automated segmentation of acutely injured lungs in multiple species , 2019, Medical Image Anal..

[10]  Eric A. Hoffman,et al.  Atlas-driven lung lobe segmentation in volumetric X-ray CT images , 2006, IEEE Transactions on Medical Imaging.

[11]  Xiaohui Xie,et al.  AnatomyNet: Deep learning for fast and fully automated whole‐volume segmentation of head and neck anatomy , 2018, Medical physics.

[12]  Konstantinos Kamnitsas,et al.  Anatomically Constrained Neural Networks (ACNNs): Application to Cardiac Image Enhancement and Segmentation , 2017, IEEE Transactions on Medical Imaging.

[13]  Olivier Gevaert,et al.  A radiogenomic dataset of non-small cell lung cancer , 2018, Scientific Data.

[14]  Jayaram K. Udupa,et al.  A Generic Approach to Pathological Lung Segmentation , 2014, IEEE Transactions on Medical Imaging.

[15]  A. Leung,et al.  Computer-aided detection (CAD) of lung nodules in CT scans: radiologist performance and reading time with incremental CAD assistance , 2010, European Radiology.

[16]  Jinke Wang,et al.  Automatic Approach for Lung Segmentation with Juxta-Pleural Nodules from Thoracic CT Based on Contour Tracing and Correction , 2016, Comput. Math. Methods Medicine.

[17]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Reinhard Beichel,et al.  Automated 3-D Segmentation of Lungs With Lung Cancer in CT Data Using a Novel Robust Active Shape Model Approach , 2012, IEEE Transactions on Medical Imaging.

[19]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[20]  Hao Chen,et al.  Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: The LUNA16 challenge , 2016, Medical Image Anal..

[21]  Marios Anthimopoulos,et al.  Semantic Segmentation of Pathological Lung Tissue With Dilated Fully Convolutional Networks , 2018, IEEE Journal of Biomedical and Health Informatics.

[22]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[23]  Akinobu Shimizu,et al.  Multi-shape graph cuts with neighbor prior constraints and its application to lung segmentation from a chest CT volume , 2013, Medical Image Anal..

[24]  Sanjay N. Talbar,et al.  Automatic lung segmentation for the inclusion of juxtapleural nodules and pulmonary vessels using curvature based border correction , 2018, J. King Saud Univ. Comput. Inf. Sci..

[25]  Xinjian Chen,et al.  Automatic Pathological Lung Segmentation in Low-Dose CT Image Using Eigenspace Sparse Shape Composition , 2019, IEEE Transactions on Medical Imaging.

[26]  Zhe Li,et al.  Evaluate the Malignancy of Pulmonary Nodules Using the 3-D Deep Leaky Noisy-OR Network , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[27]  Xinjian Chen,et al.  Automatic Liver Segmentation Based on Shape Constraints and Deformable Graph Cut in CT Images , 2015, IEEE Transactions on Image Processing.

[28]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[29]  Jerry F. Magnan,et al.  Lung nodule malignancy classification using only radiologist-quantified image features as inputs to statistical learning algorithms: probing the Lung Image Database Consortium dataset with two statistical learning methods , 2016, Journal of medical imaging.

[30]  Xiaohui Xie,et al.  DeepEM: Deep 3D ConvNets With EM For Weakly Supervised Pulmonary Nodule Detection , 2018, bioRxiv.

[31]  Michael F. McNitt-Gray,et al.  The Lung Image Database Consortium (LIDC) data collection process for nodule detection and annotation , 2007, SPIE Medical Imaging.

[32]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[33]  B. van Ginneken,et al.  Automatic lung segmentation from thoracic computed tomography scans using a hybrid approach with error detection. , 2009, Medical physics.

[34]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[35]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[36]  Ronald M. Summers,et al.  Progressive and Multi-path Holistically Nested Neural Networks for Pathological Lung Segmentation from CT Images , 2017, MICCAI.

[37]  Hans-Peter Meinzer,et al.  Statistical shape models for 3D medical image segmentation: A review , 2009, Medical Image Anal..

[38]  Allan Hanbury,et al.  Metrics for evaluating 3D medical image segmentation: analysis, selection, and tool , 2015, BMC Medical Imaging.