Bregmanized Domain Decomposition for Image Restoration

Computational problems of large-scale data are gaining attention recently due to better hardware and hence, higher dimensionality of images and data sets acquired in applications. In the last couple of years non-smooth minimization problems such as total variation minimization became increasingly important for the solution of these tasks. While being favorable due to the improved enhancement of images compared to smooth imaging approaches, non-smooth minimization problems typically scale badly with the dimension of the data. Hence, for large imaging problems solved by total variation minimization domain decomposition algorithms have been proposed, aiming to split one large problem into N>1 smaller problems which can be solved on parallel CPUs. The N subproblems constitute constrained minimization problems, where the constraint enforces the support of the minimizer to be the respective subdomain.In this paper we discuss a fast computational algorithm to solve domain decomposition for total variation minimization. In particular, we accelerate the computation of the subproblems by nested Bregman iterations. We propose a Bregmanized Operator Splitting–Split Bregman (BOS-SB) algorithm, which enforces the restriction onto the respective subdomain by a Bregman iteration that is subsequently solved by a Split Bregman strategy. The computational performance of this new approach is discussed for its application to image inpainting and image deblurring. It turns out that the proposed new solution technique is up to three times faster than the iterative algorithm currently used in domain decomposition methods for total variation minimization.

[1]  Wotao Yin,et al.  An Iterative Regularization Method for Total Variation-Based Image Restoration , 2005, Multiscale Model. Simul..

[2]  Simon Setzer,et al.  Split Bregman Algorithm, Douglas-Rachford Splitting and Frame Shrinkage , 2009, SSVM.

[3]  Yurii Nesterov,et al.  Smooth minimization of non-smooth functions , 2005, Math. Program..

[4]  Ronald F. Gariepy FUNCTIONS OF BOUNDED VARIATION AND FREE DISCONTINUITY PROBLEMS (Oxford Mathematical Monographs) , 2001 .

[5]  Jérôme Darbon,et al.  A Fast and Exact Algorithm for Total Variation Minimization , 2005, IbPRIA.

[6]  Gjlles Aubert,et al.  Mathematical problems in image processing , 2001 .

[7]  L. Vese A Study in the BV Space of a Denoising—Deblurring Variational Problem , 2001 .

[8]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[9]  Carola-Bibiane Schoenlieb,et al.  TOTAL VARIATION MINIMIZATION WITH AN H − 1 CONSTRAINT , 2009 .

[10]  D. Dobson,et al.  Convergence of an Iterative Method for Total Variation Denoising , 1997 .

[11]  I. Daubechies,et al.  An iterative thresholding algorithm for linear inverse problems with a sparsity constraint , 2003, math/0307152.

[12]  I. Loris On the performance of algorithms for the minimization of ℓ1-penalized functionals , 2007, 0710.4082.

[13]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[14]  L. Bregman The relaxation method of finding the common point of convex sets and its application to the solution of problems in convex programming , 1967 .

[15]  Pierre Kornprobst,et al.  Mathematical problems in image processing - partial differential equations and the calculus of variations , 2010, Applied mathematical sciences.

[16]  Gene H. Golub,et al.  A Nonlinear Primal-Dual Method for Total Variation-Based Image Restoration , 1999, SIAM J. Sci. Comput..

[17]  L. Evans Measure theory and fine properties of functions , 1992 .

[18]  H. Engl,et al.  Regularization of Inverse Problems , 1996 .

[19]  P. Lions,et al.  Image recovery via total variation minimization and related problems , 1997 .

[20]  Patrick L. Combettes,et al.  Signal Recovery by Proximal Forward-Backward Splitting , 2005, Multiscale Model. Simul..

[21]  ANTONIN CHAMBOLLE,et al.  An Algorithm for Total Variation Minimization and Applications , 2004, Journal of Mathematical Imaging and Vision.

[22]  A. Chambolle Practical, Unified, Motion and Missing Data Treatment in Degraded Video , 2004, Journal of Mathematical Imaging and Vision.

[23]  I. Daubechies,et al.  Iteratively solving linear inverse problems under general convex constraints , 2007 .

[24]  Michael Hintermüller,et al.  An Infeasible Primal-Dual Algorithm for Total Bounded Variation-Based Inf-Convolution-Type Image Restoration , 2006, SIAM J. Sci. Comput..

[25]  Wotao Yin,et al.  Bregman Iterative Algorithms for (cid:2) 1 -Minimization with Applications to Compressed Sensing ∗ , 2008 .

[26]  Kazufumi Ito,et al.  Lagrange multiplier approach to variational problems and applications , 2008, Advances in design and control.

[27]  Antonin Chambolle,et al.  On Total Variation Minimization and Surface Evolution Using Parametric Maximum Flows , 2009, International Journal of Computer Vision.

[28]  Carola-Bibiane Schönlieb,et al.  A convergent overlapping domain decomposition method for total variation minimization , 2009, Numerische Mathematik.

[29]  L. Ambrosio,et al.  Functions of Bounded Variation and Free Discontinuity Problems , 2000 .

[30]  O. Scherzer,et al.  Regularization of ill-posed linear equations by the non- stationary augmented Lagrangian method , 2010 .

[31]  Carola-Bibiane Schönlieb,et al.  Subspace Correction Methods for Total Variation and 1-Minimization , 2007, SIAM J. Numer. Anal..

[32]  J. Kepler,et al.  Subspace Correction and Domain Decomposition Methods for Total Variation Minimization , 2011 .

[33]  L. Elsgolts Differential Equations and the Calculus of Variations , 2003 .

[34]  Massimo Fornasier,et al.  Analysis of the Adaptive Iterative Bregman Algorithm , 2010 .

[35]  Xavier Bresson,et al.  Bregmanized Nonlocal Regularization for Deconvolution and Sparse Reconstruction , 2010, SIAM J. Imaging Sci..

[36]  M. Fornasier Domain decomposition methods for linear inverse problems with sparsity constraints , 2007 .