Error estimation for Bregman iterations and inverse scale space methods in image restoration

SummaryIn this paper, we consider error estimation for image restoration problems based on generalized Bregman distances. This error estimation technique has been used to derive convergence rates of variational regularization schemes for linear and nonlinear inverse problems by the authors before (cf. Burger in Inverse Prob 20: 1411–1421, 2004; Resmerita in Inverse Prob 21: 1303–1314, 2005; Inverse Prob 22: 801–814, 2006), but so far it was not applied to image restoration in a systematic way. Due to the flexibility of the Bregman distances, this approach is particularly attractive for imaging tasks, where often singular energies (non-differentiable, not strictly convex) are used to achieve certain tasks such as preservation of edges. Besides the discussion of the variational image restoration schemes, our main goal in this paper is to extend the error estimation approach to iterative regularization schemes (and time-continuous flows) that have emerged recently as multiscale restoration techniques and could improve some shortcomings of the variational schemes. We derive error estimates between the iterates and the exact image both in the case of clean and noisy data, the latter also giving indications on the choice of termination criteria. The error estimates are applied to various image restoration approaches such as denoising and decomposition by total variation and wavelet methods. We shall see that interesting results for various restoration approaches can be deduced from our general results by just exploring the structure of subgradients.

[1]  J. J. Koenderink,et al.  Scale-time , 1988, Biological Cybernetics.

[2]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  S. Osher,et al.  Nonlinear inverse scale space methods , 2006 .

[4]  M. Nikolova An Algorithm for Total Variation Minimization and Applications , 2004 .

[5]  Xiaobing Feng,et al.  Analysis of total variation flow and its finite element approximations , 2003 .

[6]  D. L. Donoho,et al.  Ideal spacial adaptation via wavelet shrinkage , 1994 .

[7]  C. Vogel,et al.  Analysis of bounded variation penalty methods for ill-posed problems , 1994 .

[8]  H. Engl,et al.  Regularization of Inverse Problems , 1996 .

[9]  Antonin Chambolle,et al.  Nonlinear wavelet image processing: variational problems, compression, and noise removal through wavelet shrinkage , 1998, IEEE Trans. Image Process..

[10]  L. Bregman The relaxation method of finding the common point of convex sets and its application to the solution of problems in convex programming , 1967 .

[11]  G. Aubert,et al.  Modeling Very Oscillating Signals. Application to Image Processing , 2005 .

[12]  Stanley Osher,et al.  Denoising by BV-duality , 2006, J. Sci. Comput..

[13]  Tony F. Chan,et al.  Image processing and analysis , 2005 .

[14]  Otmar Scherzer,et al.  Inverse Scale Space Theory for Inverse Problems , 2001, Scale-Space.

[15]  Michael Kerckhove,et al.  Scale-Space and Morphology in Computer Vision , 2001, Lecture Notes in Computer Science 2106.

[16]  Stanley Osher,et al.  Iterative Regularization and Nonlinear Inverse Scale Space Applied to Wavelet-Based Denoising , 2007, IEEE Transactions on Image Processing.

[17]  R. Holmes Geometric Functional Analysis and Its Applications , 1975 .

[18]  Jan M. Nordbotten,et al.  Inverse Scale Spaces for Nonlinear Regularization , 2006, Journal of Mathematical Imaging and Vision.

[19]  V. Caselles,et al.  Minimizing total variation flow , 2000, Differential and Integral Equations.

[20]  S. Osher,et al.  IMAGE DECOMPOSITION AND RESTORATION USING TOTAL VARIATION MINIMIZATION AND THE H−1 NORM∗ , 2002 .

[21]  S. Osher,et al.  Convergence rates of convex variational regularization , 2004 .

[22]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[23]  Ingrid Daubechies,et al.  Wavelet-based image decomposition by variational functionals , 2004, SPIE Optics East.

[24]  Stanley Osher,et al.  Image Decomposition and Restoration Using Total Variation Minimization and the H1 , 2003, Multiscale Model. Simul..

[25]  Tony F. Chan,et al.  Image processing and analysis - variational, PDE, wavelet, and stochastic methods , 2005 .

[26]  A. Bruce,et al.  WAVESHRINK WITH FIRM SHRINKAGE , 1997 .

[27]  Tal Schuster,et al.  Nonlinear iterative methods for linear ill-posed problems in Banach spaces , 2006 .

[28]  L. Ambrosio,et al.  Functions of Bounded Variation and Free Discontinuity Problems , 2000 .

[29]  Andrew P. Witkin,et al.  Scale-Space Filtering , 1983, IJCAI.

[30]  I. Johnstone,et al.  Ideal spatial adaptation by wavelet shrinkage , 1994 .

[31]  Eitan Tadmor,et al.  A Multiscale Image Representation Using Hierarchical (BV, L2 ) Decompositions , 2004, Multiscale Model. Simul..

[32]  E. Resmerita Regularization of ill-posed problems in Banach spaces: convergence rates , 2005 .

[33]  Otmar Scherzer,et al.  Inverse Total Variation Flow , 2007, Multiscale Model. Simul..

[34]  Wotao Yin,et al.  An Iterative Regularization Method for Total Variation-Based Image Restoration , 2005, Multiscale Model. Simul..

[35]  I. Ekeland,et al.  Convex analysis and variational problems , 1976 .

[36]  O. Scherzer,et al.  Error estimates for non-quadratic regularization and the relation to enhancement , 2006 .

[37]  Yehoshua Y. Zeevi,et al.  Estimation of optimal PDE-based denoising in the SNR sense , 2006, IEEE Transactions on Image Processing.

[38]  Rachid Deriche,et al.  Regularizing Flows for Constrained Matrix-Valued Images , 2004 .

[39]  Yves Meyer,et al.  Oscillating Patterns in Image Processing and Nonlinear Evolution Equations: The Fifteenth Dean Jacqueline B. Lewis Memorial Lectures , 2001 .