Image restoration and segmentation using the Ambrosio-Tortorelli functional and Discrete Calculus

Essential image processing and analysis tasks, such as image segmentation, simplification and denoising, can be conducted in a unified way by minimizing the Mumford-Shah (MS) functional. Although seductive, this minimization is in practice difficult because it requires to jointly define a sharp set of contours and a smooth version of the initial image. For this reason, various relaxations of the original formulations have been proposed, together with optimisation methods. Among these, the Ambrosio-Tortorelli (AT) parametric functional is of particular interest, because minimizers of AT can be shown to converge to a minimizer of MS. However this convergence is difficult to achieve numerically using standard finite difference schemes. Indeed, with AT, discontinuities need to be represented explicitly rather than implicitly. In this work, we propose to formulate AT using the full framework of Discrete Calculus (DC), which is able to sharply represent discontinuities thanks to a more sophisticated topological framework. We present our proposed formulation, its resolution, and results on synthetic and real images. We show that we are indeed able to represent sharp discontinuities and as a result significantly better stability to noise, compared with finite difference schemes.

[1]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[2]  Andrea Braides Approximation of Free-Discontinuity Problems , 1998 .

[3]  Giuseppe Buttazzo,et al.  Gamma-convergence and its Applications to Some Problems in the Calculus of Variations , 2004 .

[4]  Pascal Getreuer,et al.  Rudin-Osher-Fatemi Total Variation Denoising using Split Bregman , 2012, Image Process. Line.

[5]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[6]  E. D. Giorgi,et al.  Existence theorem for a minimum problem with free discontinuity set , 1989 .

[7]  Mila Nikolova,et al.  Algorithms for Finding Global Minimizers of Image Segmentation and Denoising Models , 2006, SIAM J. Appl. Math..

[8]  L. Ambrosio,et al.  Approximation of functional depending on jumps by elliptic functional via t-convergence , 1990 .

[9]  Hervé Le Men,et al.  Scale-Sets Image Analysis , 2005, International Journal of Computer Vision.

[10]  Gareth Funka-Lea,et al.  Graph Cuts and Efficient N-D Image Segmentation , 2006, International Journal of Computer Vision.

[11]  ANTONIN CHAMBOLLE,et al.  An Algorithm for Total Variation Minimization and Applications , 2004, Journal of Mathematical Imaging and Vision.

[12]  Christopher V. Alvino,et al.  The Piecewise Smooth Mumford–Shah Functional on an Arbitrary Graph , 2009, IEEE Transactions on Image Processing.

[13]  Anil N. Hirani,et al.  Discrete exterior calculus , 2005, math/0508341.

[14]  Daniel Cremers,et al.  Real-Time Minimization of the Piecewise Smooth Mumford-Shah Functional , 2014, ECCV.

[15]  Michael Möller,et al.  Collaborative Total Variation: A General Framework for Vectorial TV Models , 2015, SIAM J. Imaging Sci..

[16]  LUMINITA VESEy,et al.  Reduced Non-convex Functional Approximations for Image Restoration & Segmentation , 1997 .

[17]  Antonin Chambolle,et al.  Implementation of a finite-elements approximation of the Mumford-Shah functional , 2000 .

[18]  Junmo Kim,et al.  A Convex Relaxation of the Ambrosio-Tortorelli Elliptic Functionals for the Mumford-Shah Functional , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Catalina Sbert,et al.  Chambolle's Projection Algorithm for Total Variation Denoising , 2013, Image Process. Line.

[20]  Michel Barlaud,et al.  Deterministic edge-preserving regularization in computed imaging , 1997, IEEE Trans. Image Process..

[21]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[22]  Jérôme Idier,et al.  Convex half-quadratic criteria and interacting auxiliary variables for image restoration , 2001, IEEE Trans. Image Process..