Automatic threshold estimation for Iterative Shrinkage Algorithms used with compressed sensing

Recently, a new class of algorithms has been developed which iteratively build a sparse solution to an underdetermined linear system of equations. These algorithms are known in the literature as Iterative Shrinkage Algorithms (ISA). ISA algorithms depend on a thresholding parameter, which is usually provided by the user. In this paper we develop a new approach for automatically estimating this thresholding parameter. The proposed approach is general in a sense that it does not assume any distribution on the entries of the dictionary matrix, nor on the nonzero coefficients of the solution vector. In addition, the proposed approach is simple and can be adapted for use with newly evolving ISA algorithms. Moreover, the simulation results show that these proposed algorithms outperform their previous counterparts.

[1]  T. Blumensath,et al.  Iterative Thresholding for Sparse Approximations , 2008 .

[2]  Arian Maleki,et al.  Optimally Tuned Iterative Reconstruction Algorithms for Compressed Sensing , 2009, IEEE Journal of Selected Topics in Signal Processing.

[3]  Simon Foucart,et al.  Hard Thresholding Pursuit: An Algorithm for Compressive Sensing , 2011, SIAM J. Numer. Anal..

[4]  David L. Donoho,et al.  Sparse Solution Of Underdetermined Linear Equations By Stagewise Orthogonal Matching Pursuit , 2006 .

[5]  Bhaskar D. Rao,et al.  An affine scaling methodology for best basis selection , 1999, IEEE Trans. Signal Process..

[6]  Rémi Gribonval,et al.  Learning unions of orthonormal bases with thresholded singular value decomposition , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[7]  B. Achiriloaie,et al.  VI REFERENCES , 1961 .

[8]  Olgica Milenkovic,et al.  Subspace Pursuit for Compressive Sensing Signal Reconstruction , 2008, IEEE Transactions on Information Theory.

[9]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[10]  Mike E. Davies,et al.  Iterative Hard Thresholding and L0 Regularisation , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[11]  Deanna Needell,et al.  CoSaMP: Iterative signal recovery from incomplete and inaccurate samples , 2008, ArXiv.

[12]  Y. C. Pati,et al.  Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[13]  Michael Elad,et al.  Sparse and Redundant Representations - From Theory to Applications in Signal and Image Processing , 2010 .

[14]  Mike E. Davies,et al.  Normalized Iterative Hard Thresholding: Guaranteed Stability and Performance , 2010, IEEE Journal of Selected Topics in Signal Processing.