Forward - Backward Hard Thresholding algorithm for compressed sensing

Compressed sensing aims to recover the sparse signal from small linear random combination. The recovery process of the sparse signal through an underdetermined system is the most challenging part of the compressed sensing area. Recently, there are many algorithms have been developed for the recovery process to solve the optimization problem such as hard thresholding, greedy and convex optimization algorithms. In this paper, modifications of hard thresholding algorithms are proposed. An iterative algorithm is introduced which is called Forward and Backward Hard Thresholding algorithm (FBHT). It depends on two stages. One expands the support size and the other removes some elements from it with the guarantee of expanding the support size after each iteration. The forward and the backward steps are continued until reaching of the minimum value of residual by using a certain threshold. Many simulation programs are executed to compare the performance of the proposed FBHT algorithm with the related previous ones. The FBHT algorithm outperforms the previous ones in chosen performance metrics which are the mean square error and the signal to error ratio. Furthermore, the impact of some related parameters of the proposed FBHT algorithm and the impact of the sparsity level is discussed.

[1]  Y. C. Pati,et al.  Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[2]  David L. Donoho,et al.  Sparse Solution Of Underdetermined Linear Equations By Stagewise Orthogonal Matching Pursuit , 2006 .

[3]  Deanna Needell,et al.  CoSaMP: Iterative signal recovery from incomplete and inaccurate samples , 2008, ArXiv.

[4]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[5]  Simon Foucart,et al.  Hard Thresholding Pursuit: An Algorithm for Compressive Sensing , 2011, SIAM J. Numer. Anal..

[6]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[7]  Hakan Erdogan,et al.  Compressed sensing signal recovery via forward-backward pursuit , 2012, Digit. Signal Process..

[8]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[9]  Mike E. Davies,et al.  Iterative Hard Thresholding for Compressed Sensing , 2008, ArXiv.

[10]  Balas K. Natarajan,et al.  Sparse Approximate Solutions to Linear Systems , 1995, SIAM J. Comput..

[11]  Moawad I. Dessouky,et al.  Efficient Parameters for Compressed Sensing Recovery Algorithms , 2016, Wireless Personal Communications.

[12]  Olgica Milenkovic,et al.  Subspace Pursuit for Compressive Sensing Signal Reconstruction , 2008, IEEE Transactions on Information Theory.

[13]  Arian Maleki,et al.  Optimally Tuned Iterative Reconstruction Algorithms for Compressed Sensing , 2009, IEEE Journal of Selected Topics in Signal Processing.

[14]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[15]  Mike E. Davies,et al.  Normalized Iterative Hard Thresholding: Guaranteed Stability and Performance , 2010, IEEE Journal of Selected Topics in Signal Processing.

[16]  Ingrid Daubechies,et al.  The wavelet transform, time-frequency localization and signal analysis , 1990, IEEE Trans. Inf. Theory.