Semi-Linearized Proximal Alternating Minimization for a Discrete Mumford–Shah Model

The Mumford–Shah model is a standard model in image segmentation, and due to its difficulty, many approximations have been proposed. The major interest of this functional is to enable joint image restoration and contour detection. In this work, we propose a general formulation of the discrete counterpart of the Mumford–Shah functional, adapted to nonsmooth penalizations, fitting the assumptions required by the Proximal Alternating Linearized Minimization (PALM), with convergence guarantees. A second contribution aims to relax some assumptions on the involved functionals and derive a novel Semi-Linearized Proximal Alternated Minimization (SL-PAM) algorithm, with proved convergence. We compare the performances of the algorithm with several nonsmooth penalizations, for Gaussian and Poisson denoising, image restoration and RGB-color denoising. We compare the results with state-of-the-art convex relaxations of the Mumford–Shah functional, and a discrete version of the Ambrosio–Tortorelli functional. We show that the SL-PAM algorithm is faster than the original PALM algorithm, and leads to competitive denoising, restoration and segmentation results.

[1]  Stuart German,et al.  Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images , 1988 .

[2]  Daniel Cremers,et al.  Real-Time Minimization of the Piecewise Smooth Mumford-Shah Functional , 2014, ECCV.

[3]  J. Pesquet,et al.  Parallel algorithm and hybrid regularization for dynamic PET reconstruction , 2010, IEEE Nuclear Science Symposuim & Medical Imaging Conference.

[4]  Andreas Weinmann,et al.  Jump-Sparse and Sparse Recovery Using Potts Functionals , 2013, IEEE Transactions on Signal Processing.

[5]  Julien Mairal,et al.  Optimization with Sparsity-Inducing Penalties , 2011, Found. Trends Mach. Learn..

[6]  Gabriele Steidl,et al.  Multiclass Segmentation by Iterated ROF Thresholding , 2013, EMMCVPR.

[7]  Xavier Bresson,et al.  Fast Global Minimization of the Active Contour/Snake Model , 2007, Journal of Mathematical Imaging and Vision.

[8]  Martin Storath,et al.  Iterative Potts and Blake–Zisserman minimization for the recovery of functions with discontinuities from indirect measurements , 2015, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[9]  Nelly Pustelnik,et al.  A New Proximal Method for Joint Image Restoration and Edge Detection with the Mumford-Shah Model , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[10]  Martin Storath,et al.  An algorithmic framework for Mumford–Shah regularization of inverse problems in imaging , 2015 .

[11]  Tieyong Zeng,et al.  Regularized Non-local Total Variation and Application in Image Restoration , 2017, Journal of Mathematical Imaging and Vision.

[12]  G. Herman,et al.  Algebraic reconstruction techniques (ART) for three-dimensional electron microscopy and x-ray photography. , 1970, Journal of theoretical biology.

[13]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[14]  P. Jaccard Distribution de la flore alpine dans le bassin des Dranses et dans quelques régions voisines , 1901 .

[15]  Cewu Lu,et al.  Image smoothing via L0 gradient minimization , 2011, ACM Trans. Graph..

[16]  Andrea Braides Approximation of Free-Discontinuity Problems , 1998 .

[17]  Jayant Shah,et al.  Free-discontinuity problems via functionals involving the L1-norm of the gradient and their approximations , 1999 .

[18]  Laurent Condat,et al.  Discrete Total Variation: New Definition and Minimization , 2017, SIAM J. Imaging Sci..

[19]  Nelly Pustelnik,et al.  Hybrid regularization for data restoration in the presence of Poisson noise , 2009, 2009 17th European Signal Processing Conference.

[20]  Dimitri Van De Ville,et al.  Dynamic PET Reconstruction Using Wavelet Regularization With Adapted Basis Functions , 2008, IEEE Transactions on Medical Imaging.

[21]  Gabriele Steidl,et al.  Removing Multiplicative Noise by Douglas-Rachford Splitting Methods , 2010, Journal of Mathematical Imaging and Vision.

[22]  Jayant Shah,et al.  A common framework for curve evolution, segmentation and anisotropic diffusion , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[23]  A. N. Tikhonov,et al.  REGULARIZATION OF INCORRECTLY POSED PROBLEMS , 1963 .

[24]  Sixun Huang,et al.  Inverse problems in atmospheric science and their application , 2005 .

[25]  Tony F. Chan,et al.  Mumford and Shah Model and Its Applications to Image Segmentation and Image Restoration , 2015, Handbook of Mathematical Methods in Imaging.

[26]  Raymond H. Chan,et al.  Linkage between Piecewise Constant Mumford-Shah model and ROF model and its virtue in image segmentation , 2018, ArXiv.

[27]  J. Pesquet,et al.  Wavelet-Based Image Deconvolution and Reconstruction , 2016 .

[28]  Josiane Zerubia,et al.  Richardson–Lucy algorithm with total variation regularization for 3D confocal microscope deconvolution , 2006, Microscopy research and technique.

[29]  Michael Unser,et al.  Joint image reconstruction and segmentation using the Potts model , 2014, 1405.5850.

[30]  Hédy Attouch,et al.  Proximal Alternating Minimization and Projection Methods for Nonconvex Problems: An Approach Based on the Kurdyka-Lojasiewicz Inequality , 2008, Math. Oper. Res..

[31]  Heinz H. Bauschke,et al.  Convex Analysis and Monotone Operator Theory in Hilbert Spaces , 2011, CMS Books in Mathematics.

[32]  Mila Nikolova,et al.  Algorithms for Finding Global Minimizers of Image Segmentation and Denoising Models , 2006, SIAM J. Appl. Math..

[33]  L. Ambrosio,et al.  Approximation of functional depending on jumps by elliptic functional via t-convergence , 1990 .

[34]  Jacques-Olivier Lachaud,et al.  Image restoration and segmentation using the Ambrosio-Tortorelli functional and Discrete Calculus , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[35]  F. Bach,et al.  Optimization with Sparsity-Inducing Penalties (Foundations and Trends(R) in Machine Learning) , 2011 .

[36]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Jacques-Olivier Lachaud,et al.  Numerical Implementation of the Ambrosio-Tortorelli Functional Using Discrete Calculus and Application to Image Restoration and Inpainting , 2016, RRPR@ICPR.

[38]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  XuYi,et al.  Image smoothing via L0 gradient minimization , 2011 .

[40]  K. Lange,et al.  EM reconstruction algorithms for emission and transmission tomography. , 1984, Journal of computer assisted tomography.

[41]  Xavier Bresson,et al.  Nonlocal Mumford-Shah Regularizers for Color Image Restoration , 2011, IEEE Transactions on Image Processing.

[42]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[43]  Nahum Kiryati,et al.  Semi-blind image restoration via Mumford-Shah regularization , 2006, IEEE Transactions on Image Processing.

[44]  Marc Teboulle,et al.  Proximal alternating linearized minimization for nonconvex and nonsmooth problems , 2013, Mathematical Programming.

[45]  Guillermo Sapiro,et al.  A Variational Framework for Simultaneous Motion Estimation and Restoration of Motion-Blurred Video , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[46]  Huaiyu Zhu On Information and Sufficiency , 1997 .

[47]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[48]  Ken D. Sauer,et al.  Parallelizable Bayesian tomography algorithms with rapid, guaranteed convergence , 2000, IEEE Trans. Image Process..

[49]  Christopher Zach,et al.  Discretized Convex Relaxations for the Piecewise Smooth Mumford-Shah Model , 2017, EMMCVPR.

[50]  Patrick L. Combettes,et al.  Proximal Splitting Methods in Signal Processing , 2009, Fixed-Point Algorithms for Inverse Problems in Science and Engineering.