Dynamic Regulation of Level Set Parameters Using 3D Convolutional Neural Network for Liver Tumor Segmentation

Segmentation of liver tumors plays an important role in the choice of therapeutic strategies for liver disease and treatment monitoring. In this paper, we generalize the process of a level set with a novel algorithm of dynamic regulation to energy functional parameters. The presented method is fully automatic once the tumor has been detected. First, a 3D convolutional neural network with dense layers for classification is used to estimate current contour location relative to the tumor boundary. Second, the output 3D CNN probabilities can dynamically regulate parameters of the level set functional over the process of segmentation. Finally, for full automation, appropriate initializations and local window size are generated based on the current contour position probabilities. We demonstrate the proposed method on the dataset of MICCAI 2017 LiTS Challenge and 3DIRCADb that include low contrast and heterogeneous tumors as well as noisy images. To illustrate the strength of our method, we evaluated it against the state-of-the-art methods. Compared with the level set framework with fixed parameters, our method performed better significantly with an average DICE improvement of 0.15. We also analyzed a challenging dataset 3DIRCADb of tumors and obtained a competitive DICE of 0.85 ± 0.06 with the proposed method.

[1]  Yen-Wei Chen,et al.  Improved segmentation of low-contrast lesions using sigmoid edge model , 2016, International Journal of Computer Assisted Radiology and Surgery.

[2]  Changming Sun,et al.  RA-UNet: A Hybrid Deep Attention-Aware Network to Extract Liver and Tumor in CT Scans , 2018, Frontiers in Bioengineering and Biotechnology.

[3]  R. Westphal,et al.  CT-based manual segmentation and evaluation of paranasal sinuses , 2009, European Archives of Oto-Rhino-Laryngology.

[4]  Martin Styner,et al.  Comparison and Evaluation of Methods for Liver Segmentation From CT Datasets , 2009, IEEE Transactions on Medical Imaging.

[5]  Simon Haykin,et al.  GradientBased Learning Applied to Document Recognition , 2001 .

[6]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[7]  Hans Meine,et al.  Automatic liver tumor segmentation in CT with fully convolutional neural networks and object-based postprocessing , 2018, Scientific Reports.

[8]  Sebastian J. Schlecht,et al.  Automatic Liver and Tumor Segmentation of CT and MRI Volumes using Cascaded Fully Convolutional Neural Networks , 2017, ArXiv.

[9]  Chunming Li,et al.  Level set evolution without re-initialization: a new variational formulation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[10]  Allen R. Tannenbaum,et al.  Localizing Region-Based Active Contours , 2008, IEEE Transactions on Image Processing.

[11]  Assaf Hoogi,et al.  Adaptive Estimation of Active Contour Parameters Using Convolutional Neural Networks and Texture Analysis , 2017, IEEE Trans. Medical Imaging.

[12]  S. Ong,et al.  Integrating FCM and Level Sets for Liver Tumor Segmentation , 2009 .

[13]  Rémi Ronfard,et al.  Region-based strategies for active contour models , 1994, International Journal of Computer Vision.

[14]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[15]  Jayaram K. Udupa,et al.  A general approach to liver lesion segmentation in CT images , 2016, SPIE Medical Imaging.

[16]  J. Sethian,et al.  FRONTS PROPAGATING WITH CURVATURE DEPENDENT SPEED: ALGORITHMS BASED ON HAMILTON-JACOB1 FORMULATIONS , 2003 .

[17]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.

[18]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[19]  Wang Liang,et al.  A Unified Level Set Framework Combining Hybrid Algorithms for Liver and Liver Tumor Segmentation in CT Images , 2018, BioMed research international.

[20]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[21]  Aaron C. Courville,et al.  Recurrent Batch Normalization , 2016, ICLR.

[22]  S. Osher,et al.  A level set approach for computing solutions to incompressible two-phase flow , 1994 .

[23]  Luca Maria Gambardella,et al.  Deep Neural Networks Segment Neuronal Membranes in Electron Microscopy Images , 2012, NIPS.

[24]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[25]  L. Schwartz,et al.  Semiautomatic segmentation of liver metastases on volumetric CT images. , 2015, Medical physics.

[26]  Yong Yin,et al.  Supervised Variational Model With Statistical Inference and Its Application in Medical Image Segmentation , 2015, IEEE Transactions on Biomedical Engineering.

[27]  Hans Meine,et al.  Neural Network-Based Automatic Liver Tumor Segmentation With Random Forest-Based Candidate Filtering , 2017, ArXiv.

[28]  Said Ghnomiey Medical Image Segmentation Techniques: An Overview , 2016 .

[29]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[30]  Xianghua Xie,et al.  Active Contouring Based on Gradient Vector Interaction and Constrained Level Set Diffusion , 2010, IEEE Transactions on Image Processing.

[31]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[32]  Yanhua Zhang,et al.  3D Liver Tumor Segmentation in CT Images Using Improved Fuzzy C-Means and Graph Cuts , 2017, BioMed research international.

[33]  Hui Ding,et al.  Robust extraction for low-contrast liver tumors using modified adaptive likelihood estimation , 2018, International Journal of Computer Assisted Radiology and Surgery.

[34]  Syamsiah Mashohor,et al.  Automatic liver tumor segmentation on computed tomography for patient treatment planning and monitoring , 2016, EXCLI journal.

[35]  Anthony J. Yezzi,et al.  Curve evolution implementation of the Mumford-Shah functional for image segmentation, denoising, interpolation, and magnification , 2001, IEEE Trans. Image Process..

[36]  Dário Augusto Borges Oliveira,et al.  Liver Segmentation using Level Sets and Genetic Algorithms , 2009, VISAPP.

[37]  Patrick Bouthemy,et al.  Robust Adaptive Segmentation of 3D Medical Images with Level Sets , 1999 .

[38]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  M. Kerin,et al.  Effect of the World Health Organization Checklist on Patient Outcomes: A Stepped Wedge Cluster Randomized Controlled Trial. , 2016, Annals of surgery.

[40]  Chunming Li,et al.  Distance Regularized Level Set Evolution and Its Application to Image Segmentation , 2010, IEEE Transactions on Image Processing.

[41]  David Zhang,et al.  Reinitialization-Free Level Set Evolution via Reaction Diffusion , 2011, IEEE Transactions on Image Processing.

[42]  Lei Zhang,et al.  Active contours driven by local image fitting energy , 2010, Pattern Recognit..

[43]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[44]  Xiaoming Liu,et al.  Automatic segmentation of liver tumors from multiphase contrast-enhanced CT images based on FCNs , 2017, Artif. Intell. Medicine.

[45]  Anthony J. Yezzi,et al.  A Fully Global Approach to Image Segmentation via Coupled Curve Evolution Equations , 2002, J. Vis. Commun. Image Represent..

[46]  Simone Moreira de Macêdo,et al.  The role of renin-angiotensin system modulation on treatment and prevention of liver diseases , 2014, Peptides.

[47]  P. Smereka,et al.  A Remark on Computing Distance Functions , 2000 .

[48]  Xiao Han,et al.  Automatic Liver Lesion Segmentation Using A Deep Convolutional Neural Network Method , 2017, ArXiv.