A new generalized thresholding algorithm for inverse problems with sparsity constraints

We propose a new generalized thresholding algorithm useful for inverse problems with sparsity constraints. The algorithm uses a thresholding function with a parameter p, first mentioned in [1]. When p = 1, the thresholding function is equivalent to classical soft thresholding. For values of p below 1, the thresholding penalizes small coefficients over a wider range and applies less bias to the larger coefficients, much like hard thresholding but without discontinuities. The functional that the new thresholding minimizes is non-convex for p <; 1. We state an algorithm similar to the Iterative Soft Thresholding Algorithm (ISTA) [2].We show that the new thresholding performs better in numerical examples than soft thresholding.

[1]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[2]  R. Chartrand,et al.  Restricted isometry properties and nonconvex compressive sensing , 2007 .

[3]  Rick Chartrand,et al.  Exact Reconstruction of Sparse Signals via Nonconvex Minimization , 2007, IEEE Signal Processing Letters.

[4]  Rick Chartrand,et al.  Fast algorithms for nonconvex compressive sensing: MRI reconstruction from very few data , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[5]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[6]  Robert R. Meyer,et al.  Sufficient Conditions for the Convergence of Monotonic Mathematical Programming Algorithms , 1976, J. Comput. Syst. Sci..

[7]  Rick Chartrand,et al.  Nonconvex Regularization for Shape Preservation , 2007, 2007 IEEE International Conference on Image Processing.

[8]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[9]  D. Hunter,et al.  A Tutorial on MM Algorithms , 2004 .

[10]  Bastian Goldlücke,et al.  Variational Analysis , 2014, Computer Vision, A Reference Guide.

[11]  Sergey Voronin,et al.  A new iterative firm-thresholding algorithm for inverse problems with sparsity constraints , 2013 .

[12]  I. Daubechies,et al.  An iterative thresholding algorithm for linear inverse problems with a sparsity constraint , 2003, math/0307152.