A new iterative firm-thresholding algorithm for inverse problems with sparsity constraints

Abstract In this paper we propose a variation of the soft-thresholding algorithm for finding sparse approximate solutions of the equation A x = b , where as the sparsity of the iterate increases the penalty function changes. In this approach, sufficiently large entries in a sparse iterate are left untouched. The advantage of this approach is that a higher regularization constant can be used, leading to a significant reduction of the total number of iterations. Numerical experiments for sparse recovery problems, also with noisy data, are included.

[1]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[2]  Michael Elad,et al.  Optimally sparse representation in general (nonorthogonal) dictionaries via ℓ1 minimization , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[3]  I. Daubechies,et al.  Tomographic inversion using L1-norm regularization of wavelet coefficients , 2006, physics/0608094.

[4]  Massimo Fornasier,et al.  The application of joint sparsity and total variation minimization algorithms to a real-life art restoration problem , 2009, Adv. Comput. Math..

[5]  M. Fornasier,et al.  Iterative thresholding algorithms , 2008 .

[6]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[7]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[8]  Andrea Montanari,et al.  Accurate Prediction of Phase Transitions in Compressed Sensing via a Connection to Minimax Denoising , 2011, IEEE Transactions on Information Theory.

[9]  Marc Teboulle,et al.  Fast Gradient-Based Algorithms for Constrained Total Variation Image Denoising and Deblurring Problems , 2009, IEEE Transactions on Image Processing.

[10]  Y. Nesterov Gradient methods for minimizing composite objective function , 2007 .

[11]  Thomas Blumensath,et al.  Accelerated iterative hard thresholding , 2012, Signal Process..

[12]  I. Daubechies,et al.  An iterative thresholding algorithm for linear inverse problems with a sparsity constraint , 2003, math/0307152.