On a Gradient-Based Algorithm for Sparse Signal Reconstruction in the Signal/Measurements Domain

Sparse signals can be recovered from a reduced set of samples by using compressive sensing algorithms. In common compressive sensing methods the signal is recovered in the sparsity domain. A method for the reconstruction of sparse signals which reconstructs the missing/unavailable samples/measurements is recently proposed. This method can be efficiently used in signal processing applications where a complete set of signal samples exists. The missing samples are considered as the minimization variables, while the available samples are fixed. Reconstruction of the unavailable signal samples/measurements is preformed using a gradient-based algorithm in the time domain, with an adaptive step. Performance of this algorithm with respect to the step-size and convergence are analyzed and a criterion for the step-size adaptation is proposed in this paper. The step adaptation is based on the gradient direction angles. Illustrative examples and statistical study are presented. Computational efficiency of this algorithm is compared with other two commonly used gradient algorithms that reconstruct signal in the sparsity domain. Uniqueness of the recovered signal is checked using a recently introduced theorem. The algorithm application to the reconstruction of highly corrupted images is presented as well.

[1]  Ljubisa Stankovic,et al.  On the Uniqueness of the Sparse Signals Reconstruction Based on the Missing Samples Variation Analysis , 2015 .

[2]  Patrick Flandrin,et al.  Time-Frequency Energy Distributions Meet Compressed Sensing , 2010, IEEE Transactions on Signal Processing.

[3]  Gerardo Toraldo,et al.  On the Solution of Large Quadratic Programming Problems with Bound Constraints , 1991, SIAM J. Optim..

[4]  R. Tibshirani,et al.  Regression shrinkage and selection via the lasso: a retrospective , 2011 .

[5]  Yoshitaka Morikawa,et al.  An l p Norm Minimization Using Auxiliary Function for Compressed Sensing , 2012 .

[6]  Kenneth E. Barner,et al.  Robust Sampling and Reconstruction Methods for Sparse Signals in the Presence of Impulsive Noise , 2010, IEEE Journal of Selected Topics in Signal Processing.

[7]  Stephen J. Wright Implementing proximal point methods for linear programming , 1990 .

[8]  S. Mallat,et al.  Adaptive greedy approximations , 1997 .

[9]  Irena Orovic,et al.  Robust Time-Frequency Analysis Based on the L-Estimation and Compressive Sensing , 2013, IEEE Signal Processing Letters.

[10]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[11]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[12]  Deanna Needell,et al.  CoSaMP: Iterative signal recovery from incomplete and inaccurate samples , 2008, ArXiv.

[13]  Tom Chau,et al.  Compressive sampling of swallowing accelerometry signals using time-frequency dictionaries based on modulated discrete prolate spheroidal sequences , 2012, EURASIP J. Adv. Signal Process..

[14]  Berwin A. Turlach,et al.  On algorithms for solving least squares problems under an L1 penalty or an L1 constraint , 2005 .

[15]  Peter Bühlmann Regression shrinkage and selection via the Lasso: a retrospective (Robert Tibshirani): Comments on the presentation , 2011 .

[16]  LJubisa Stankovic,et al.  A measure of some time-frequency distributions concentration , 2001, Signal Process..

[17]  Ljubiša Stanković,et al.  Adaptive Variable Step Algorithm for Missing Samples Recovery in Sparse Signals , 2013, IET Signal Process..

[18]  Mário A. T. Figueiredo,et al.  Gradient Projection for Sparse Reconstruction: Application to Compressed Sensing and Other Inverse Problems , 2007, IEEE Journal of Selected Topics in Signal Processing.

[19]  Luca Zanni,et al.  Gradient projection methods for quadratic programs and applications in training support vector machines , 2005, Optim. Methods Softw..

[20]  Srdjan Stankovic,et al.  Missing samples analysis in signals for applications to L-estimation and compressive sensing , 2014, Signal Process..

[21]  E. Candès The restricted isometry property and its implications for compressed sensing , 2008 .

[22]  Isidora Stankovic,et al.  Recovery of Images with Missing Pixels using a Gradient Compressive Sensing Algorithm , 2014, ArXiv.

[23]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[24]  I. Daubechies,et al.  An iterative thresholding algorithm for linear inverse problems with a sparsity constraint , 2003, math/0307152.