Convergence rates in $\mathbf{\ell^1}$-regularization if the sparsity assumption fails

Variational sparsity regularization based on $\ell^1$-norms and other nonlinear functionals has gained enormous attention recently, both with respect to its applications and its mathematical analysis. A focus in regularization theory has been to develop error estimation in terms of regularization parameter and noise strength. For this sake specific error measures such as Bregman distances and specific conditions on the solution such as source conditions or variational inequalities have been developed and used. In this paper we provide, for a certain class of ill-posed linear operator equations, a convergence analysis that works for solutions that are not completely sparse, but have a fast decaying nonzero part. This case is not covered by standard source conditions, but surprisingly can be treated with an appropriate variational inequality. As a consequence the paper also provides the first examples where the variational inequality approach, which was often believed to be equivalent to appropriate source conditions, can indeed go farther than the latter.

[1]  Bernd Hofmann,et al.  Parameter choice in Banach space regularization under variational inequalities , 2012 .

[2]  B. Hofmann Approximate source conditions in Tikhonov–Phillips regularization and consequences for inverse problems with multiplication operators , 2006 .

[3]  O. Scherzer,et al.  Necessary and sufficient conditions for linear convergence of ℓ1‐regularization , 2011 .

[4]  Markus Grasmair,et al.  Well-posedness and Convergence Rates for Sparse Regularization with Sublinear l q Penalty Term , 2009 .

[5]  G. Teschke Multi-frame representations in linear inverse problems with mixed multi-constraints , 2007 .

[6]  Massimo Fornasier Sparse Recovery in Inverse Problems , 2010 .

[7]  D. Lorenz,et al.  Convergence rates and source conditions for Tikhonov regularization with sparsity constraints , 2008, 0801.1774.

[8]  Lin He,et al.  Error estimation for Bregman iterations and inverse scale space methods in image restoration , 2007, Computing.

[9]  Markus Grasmair,et al.  Convergence Rates for Tikhonov Regularisation on Banach Spaces , 2011 .

[10]  Bernd Hofmann,et al.  Approximate source conditions for nonlinear ill-posed problems—chances and limitations , 2009 .

[11]  Bernd Hofmann,et al.  An extension of the variational inequality approach for obtaining convergence rates in regularization of nonlinear ill-posed problems , 2010 .

[12]  V. Morozov The Regularization Method , 1984 .

[13]  I. Daubechies,et al.  An iterative thresholding algorithm for linear inverse problems with a sparsity constraint , 2003, math/0307152.

[14]  Jens Flemming,et al.  Solution smoothness of ill-posed equations in Hilbert spaces: four concepts and their cross connections , 2012 .

[15]  Markus Grasmair,et al.  Linear convergence rates for Tikhonov regularization with positively homogeneous functionals , 2011 .

[16]  Ronny Ramlau,et al.  REGULARIZATION PROPERTIES OF TIKHONOV REGULARIZATION WITH SPARSITY CONSTRAINTS , 2008 .

[17]  O. Scherzer,et al.  FA ] 2 9 Ju l 2 00 8 Sparse Regularization with l q Penalty Term , 2008 .

[18]  Ronny Ramlau,et al.  Convergence rates for Morozov's discrepancy principle using variational inequalities , 2011 .

[19]  Michael Möller Multiscale methods for (generalized) sparse recovery and applications in high dimensional imaging , 2012 .

[20]  Ronny Ramlau,et al.  CONVERGENCE RATES FOR REGULARIZATION WITH SPARSITY CONSTRAINTS , 2010 .

[21]  S. Osher,et al.  Convergence rates of convex variational regularization , 2004 .

[22]  K. Bredies,et al.  Regularization with non-convex separable constraints , 2009 .

[23]  O. Scherzer,et al.  A convergence rates result for Tikhonov regularization in Banach spaces with non-smooth operators , 2007 .

[24]  Barbara Kaltenbacher,et al.  Regularization Methods in Banach Spaces , 2012, Radon Series on Computational and Applied Mathematics.

[25]  M. Grasmair Generalized Bregman distances and convergence rates for non-convex regularization methods , 2010 .

[26]  Martin Burger,et al.  ERROR ESTIMATES FOR GENERAL FIDELITIES , 2011 .

[27]  Bernd Hofmann,et al.  On the interplay of source conditions and variational inequalities for nonlinear ill-posed problems , 2010 .