Image Segmentation with Depth Information via Simplified Variational Level Set Formulation

Image segmentation with depth information can be modeled as a minimization problem with Nitzberg–Mumford–Shiota functional, which can be transformed into a tractable variational level set formulation. However, such formulation leads to a series of complicated high-order nonlinear partial differential equations which are difficult to solve efficiently. In this paper, we first propose an equivalently reduced variational level set formulation without using curvatures by taking level set functions as signed distance functions. Then, an alternating direction method of multipliers (ADMM) based on this simplified variational level set formulation is designed by introducing some auxiliary variables, Lagrange multipliers via using alternating optimization strategy. With the proposed ADMM method, the minimization problem for this simplified variational level set formulation is transformed into a series of sub-problems, which can be solved easily via using the Gauss–Seidel iterations, fast Fourier transform and soft thresholding formulas. The level set functions are treated as signed distance functions during computation process via implementing a simple algebraic projection method, which avoids the traditional re-initialization process for conventional variational level set methods. Extensive experiments have been conducted on both synthetic and real images, which validate the proposed approach, and show advantages of the proposed ADMM projection over algorithms based on traditional gradient descent method in terms of computational efficiency.

[1]  Mila Nikolova,et al.  Algorithms for Finding Global Minimizers of Image Segmentation and Denoising Models , 2006, SIAM J. Appl. Math..

[2]  L. Ambrosio,et al.  Approximation of functional depending on jumps by elliptic functional via t-convergence , 1990 .

[3]  Richard G. Baraniuk,et al.  Fast Alternating Direction Optimization Methods , 2014, SIAM J. Imaging Sci..

[4]  Xue-Cheng Tai,et al.  Augmented Lagrangian method for a mean curvature based image denoising model , 2013 .

[5]  P. Loreti,et al.  Propagation of fronts in a nonlinear fourth order equation , 2000, European Journal of Applied Mathematics.

[6]  Xue-Cheng Tai,et al.  Augmented Lagrangian Method, Dual Methods, and Split Bregman Iteration for ROF, Vectorial TV, and High Order Models , 2010, SIAM J. Imaging Sci..

[7]  Andy M. Yip,et al.  A fast modified Newton's method for curvature based denoising of 1D signals , 2013, Inverse Problems & Imaging.

[8]  Xue-Cheng Tai,et al.  A binary level set model and some applications to Mumford-Shah image segmentation , 2006, IEEE Transactions on Image Processing.

[9]  Mohamed R. Amer,et al.  Monocular Extraction of 2.1D Sketch Using Constrained Convex Optimization , 2014, International Journal of Computer Vision.

[10]  Tommi Kärkkäinen,et al.  A New Augmented Lagrangian Approach for L1-mean Curvature Image Denoising , 2015, SIAM J. Imaging Sci..

[11]  Yong-Jin Liu,et al.  A global energy optimization framework for 2.1D sketch extraction from monocular images , 2014, Graph. Model..

[12]  David Mumford,et al.  Filtering, Segmentation and Depth , 1993, Lecture Notes in Computer Science.

[13]  T. Chan,et al.  A Variational Level Set Approach to Multiphase Motion , 1996 .

[14]  Tony F. Chan,et al.  Segmentation with Depth: A Level Set Approach , 2006, SIAM J. Sci. Comput..

[15]  Wotao Yin,et al.  Global Convergence of ADMM in Nonconvex Nonsmooth Optimization , 2015, Journal of Scientific Computing.

[16]  Tony F. Chan,et al.  A Variational Model for Capturing Illusory Contours Using Curvature , 2006, Journal of Mathematical Imaging and Vision.

[17]  D. Mumford Elastica and Computer Vision , 1994 .

[18]  Chunming Li,et al.  Level set evolution without re-initialization: a new variational formulation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[19]  Peter Smereka,et al.  Semi-Implicit Level Set Methods for Curvature and Surface Diffusion Motion , 2003, J. Sci. Comput..

[20]  Xue-Cheng Tai,et al.  Some Facts About Operator-Splitting and Alternating Direction Methods , 2016 .

[21]  David Mumford,et al.  The 2.1-D sketch , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[22]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[23]  Simon Masnou,et al.  Disocclusion: a variational approach using level lines , 2002, IEEE Trans. Image Process..

[24]  Tony F. Chan,et al.  Image Denoising Using Mean Curvature of Image Surface , 2012, SIAM J. Imaging Sci..

[25]  王国栋,et al.  Some fast projection methods based on Chan-Vese model for image segmentation , 2014 .

[26]  Tony F. Chan,et al.  Euler's Elastica and Curvature-Based Inpainting , 2003, SIAM J. Appl. Math..

[27]  Xue-Cheng Tai,et al.  Fast numerical schemes related to curvature minimization: a brief and elementary review , 2013 .

[28]  S. Osher,et al.  Algorithms Based on Hamilton-Jacobi Formulations , 1988 .

[29]  Maryam Yashtini,et al.  Alternating Direction Method of Multiplier for Euler's Elastica-Based Denoising , 2015, SSVM.

[30]  Stanley Osher,et al.  Explicit Algorithms for a New Time Dependent Model Based on Level Set Motion for Nonlinear Deblurring and Noise Removal , 2000, SIAM J. Sci. Comput..

[31]  Wei Zhu,et al.  Illusory Shapes via Corner Fusion , 2014, SIAM J. Imaging Sci..

[32]  Chunxiao Liu,et al.  New Variational Formulations for Level Set Evolution Without Reinitialization with Applications to Image Segmentation , 2011, Journal of Mathematical Imaging and Vision.

[33]  Selim Esedoglu,et al.  Segmentation with Depth but Without Detecting Junctions , 2004, Journal of Mathematical Imaging and Vision.

[34]  Ronald Fedkiw,et al.  Level set methods and dynamic implicit surfaces , 2002, Applied mathematical sciences.

[35]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[36]  Tony F. Chan,et al.  Active Contours without Edges for Vector-Valued Images , 2000, J. Vis. Commun. Image Represent..

[37]  Xue-Cheng Tai,et al.  Image Segmentation Using Euler’s Elastica as the Regularization , 2013, J. Sci. Comput..

[38]  Hongkai Zhao,et al.  A fast sweeping method for Eikonal equations , 2004, Math. Comput..

[39]  Xue-Cheng Tai,et al.  A Fast Algorithm for Euler's Elastica Model Using Augmented Lagrangian Method , 2011, SIAM J. Imaging Sci..

[40]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[41]  Tony F. Chan,et al.  A Multiphase Level Set Framework for Image Segmentation Using the Mumford and Shah Model , 2002, International Journal of Computer Vision.