A variational level set model for multiscale image segmentation

Abstract In this paper, we propose a variational level set model for multiscale image segmentation that can extract desired object from the background under various scales. The new model consists of three terms: A boundary extraction term, a regularization term and a multiscale representation term. The boundary extraction term is based on the Chan–Vese (CV) functional, which drives the active contour toward the boundaries of the objects. The regularization term penalizes the length of the active contour and keeps the level set function close to a signed distance function, which enables the active contour to maintain its stability during the evolution process. The multiscale representation term is based on the total variation (TV) energy that can provide a multiscale representation of the input image by tuning the scale parameter. We use an alternating iterative algorithm that combines the gradient descent algorithm and the alternating direction method of multipliers (ADMM) to numerically solve the model. The experimental results for both synthetic and real images demonstrate the robustness and effectiveness of the proposed model for multiscale image segmentation. In addition, the proposed model is a promising model for image denoising applications.

[1]  Chunming Li,et al.  Active contours driven by local Gaussian distribution fitting energy , 2009, Signal Process..

[2]  Chunxiao Liu,et al.  Weighted variational model for selective image segmentation with application to medical images , 2018, Pattern Recognit..

[3]  Chunming Li,et al.  Level set evolution without re-initialization: a new variational formulation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[4]  Frank Y. Shih,et al.  Retinal vessels segmentation based on level set and region growing , 2014, Pattern Recognit..

[5]  Lijuan Duan,et al.  A new approach to image segmentation based on simplified region growing PCNN , 2008, Appl. Math. Comput..

[6]  Tao Mei,et al.  Deep Collaborative Embedding for Social Image Understanding , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  David Zhang,et al.  Reinitialization-Free Level Set Evolution via Reaction Diffusion , 2011, IEEE Transactions on Image Processing.

[8]  Yang Liu,et al.  Variational model with kernel metric-based data term for noisy image segmentation , 2018, Digit. Signal Process..

[9]  Jinhui Tang,et al.  Weakly Supervised Deep Metric Learning for Community-Contributed Image Retrieval , 2015, IEEE Transactions on Multimedia.

[10]  Luminita A. Vese,et al.  Image segmentation using a multilayer level-set approach , 2009 .

[11]  Qianting Ma,et al.  A new variational model for joint restoration and segmentation based on the Mumford-Shah model , 2018, J. Vis. Commun. Image Represent..

[12]  Min Li,et al.  Convergence Analysis of the Generalized Alternating Direction Method of Multipliers with Logarithmic–Quadratic Proximal Regularization , 2015, J. Optim. Theory Appl..

[13]  Naokazu Yokoya,et al.  Image segmentation schema for low-level computer vision , 1981, Pattern Recognit..

[14]  Chuanjiang He,et al.  Indirectly regularized variational level set model for image segmentation , 2016, Neurocomputing.

[15]  Hui Wang,et al.  An active contour model and its algorithms with local and global Gaussian distribution fitting energies , 2014, Inf. Sci..

[16]  Mila Nikolova,et al.  Fast Nonconvex Nonsmooth Minimization Methods for Image Restoration and Reconstruction , 2010, IEEE Transactions on Image Processing.

[17]  Lei Zhang,et al.  Active contours driven by local image fitting energy , 2010, Pattern Recognit..

[18]  Chunming Li,et al.  A Level Set Method for Image Segmentation in the Presence of Intensity Inhomogeneities With Application to MRI , 2011, IEEE Transactions on Image Processing.

[19]  Ting-Zhu Huang,et al.  Image segmentation based on an active contour model of partial image restoration with local cosine fitting energy , 2018, Inf. Sci..

[20]  Liming Tang.  A Variational Level Set Model Combined with FCMS for Image Clustering Segmentation , 2014 .

[21]  Daniel Díaz-Pernil,et al.  Segmenting images with gradient-based edge detection using Membrane Computing , 2013, Pattern Recognit. Lett..

[22]  B. S. Manjunath,et al.  On the Length and Area Regularization for Multiphase Level Set Segmentation , 2010, International Journal of Computer Vision.

[23]  K. G. Srinivasagan,et al.  Multilevel thresholding for segmentation of medical brain images using real coded genetic algorithm , 2014 .

[24]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[25]  Swarnajyoti Patra,et al.  A novel context sensitive multilevel thresholding for image segmentation , 2014, Appl. Soft Comput..

[26]  Chunming Li,et al.  Implicit Active Contours Driven by Local Binary Fitting Energy , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Bingsheng He,et al.  Linearized Alternating Direction Method with Gaussian Back Substitution for Separable Convex Programming , 2011 .

[28]  Weimin Huang,et al.  The $L_{0}$ Regularized Mumford–Shah Model for Bias Correction and Segmentation of Medical Images , 2015, IEEE Transactions on Image Processing.

[29]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[30]  David Zhang,et al.  A Level Set Approach to Image Segmentation With Intensity Inhomogeneity , 2016, IEEE Transactions on Cybernetics.

[31]  Yang Liu,et al.  A binary level set variational model with L1 data term for image segmentation , 2019, Signal Process..

[32]  Jinhui Tang,et al.  Weakly Supervised Deep Matrix Factorization for Social Image Understanding , 2017, IEEE Transactions on Image Processing.

[33]  B. S. Manjunath,et al.  EdgeFlow: a technique for boundary detection and image segmentation , 2000, IEEE Trans. Image Process..

[34]  Tony F. Chan,et al.  A Multiphase Level Set Framework for Image Segmentation Using the Mumford and Shah Model , 2002, International Journal of Computer Vision.

[35]  Yongfei Wu,et al.  A Retinex modulated piecewise constant variational model for image segmentation and bias correction , 2018 .

[36]  Maoguo Gong,et al.  Novel fuzzy active contour model with kernel metric for image segmentation , 2015, Appl. Soft Comput..

[37]  Xuelong Li,et al.  A Variational Approach to Simultaneous Image Segmentation and Bias Correction , 2015, IEEE Transactions on Cybernetics.

[38]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[39]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[40]  Lei Wang,et al.  An active contour model based on local fitted images for image segmentation , 2017, Inf. Sci..

[41]  Manik Mondal,et al.  Object identification for computer vision using image segmentation , 2010, 2010 2nd International Conference on Education Technology and Computer.

[42]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[43]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[44]  Lei Zhang,et al.  A variational multiphase level set approach to simultaneous segmentation and bias correction , 2010, 2010 IEEE International Conference on Image Processing.

[45]  Lei Wang,et al.  Active contours driven by edge entropy fitting energy for image segmentation , 2018, Signal Process..

[46]  Yunyun Yang,et al.  Split Bregman method based level set formulations for segmentation and correction with application to MR images and color images. , 2019, Magnetic resonance imaging.

[47]  Baba C. Vemuri,et al.  Shape Modeling with Front Propagation: A Level Set Approach , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[48]  Dimitri P. Bertsekas,et al.  On the Douglas—Rachford splitting method and the proximal point algorithm for maximal monotone operators , 1992, Math. Program..