Super-Resolution Compressed Sensing for Line Spectral Estimation: An Iterative Reweighted Approach

Conventional compressed sensing theory assumes signals have sparse representations in a known dictionary. Nevertheless, in many practical applications such as line spectral estimation, the sparsifying dictionary is usually characterized by a set of unknown parameters in a continuous domain. To apply the conventional compressed sensing technique to such applications, the continuous parameter space has to be discretized to a finite set of grid points, based on which a “nominal dictionary” is constructed for sparse signal recovery. Discretization, however, inevitably incurs errors since the true parameters do not necessarily lie on the discretized grid. This error, also referred to as grid mismatch, leads to deteriorated recovery performance. In this paper, we consider the line spectral estimation problem and propose an iterative reweighted method which jointly estimates the sparse signals and the unknown parameters associated with the true dictionary. The proposed algorithm is developed by iteratively decreasing a surrogate function majorizing a given log-sum objective function, leading to a gradual and interweaved iterative process to refine the unknown parameters and the sparse signal. A simple yet effective scheme is developed for adaptively updating the regularization parameter that controls the tradeoff between the sparsity of the solution and the data fitting error. Theoretical analysis is conducted to justify the proposed method. Simulation results show that the proposed algorithm achieves super resolution and outperforms other state-of-the-art methods in many cases of practical interest.

[1]  Hongbin Li,et al.  Pattern-Coupled Sparse Bayesian Learning for Recovery of Block-Sparse Signals , 2013, IEEE Transactions on Signal Processing.

[2]  Emmanuel J. Candès,et al.  Towards a Mathematical Theory of Super‐resolution , 2012, ArXiv.

[3]  Bhaskar D. Rao,et al.  Sparse solutions to linear inverse problems with multiple measurement vectors , 2005, IEEE Transactions on Signal Processing.

[4]  D. Hunter,et al.  Optimization Transfer Using Surrogate Objective Functions , 2000 .

[5]  David P. Wipf,et al.  Iterative Reweighted 1 and 2 Methods for Finding Sparse Solutions , 2010, IEEE J. Sel. Top. Signal Process..

[6]  Mike E. Davies,et al.  Parametric Dictionary Design for Sparse Coding , 2009, IEEE Transactions on Signal Processing.

[7]  Jun Fang,et al.  Super-Resolution Compressed Sensing: An Iterative Reweighted Algorithm for Joint Parameter Learning and Sparse Signal Recovery , 2014, IEEE Signal Processing Letters.

[8]  Gongguo Tang,et al.  Near minimax line spectral estimation , 2013, 2013 47th Annual Conference on Information Sciences and Systems (CISS).

[9]  Gongguo Tang,et al.  Atomic Norm Denoising With Applications to Line Spectral Estimation , 2012, IEEE Transactions on Signal Processing.

[10]  Yonina C. Eldar,et al.  Direction of Arrival Estimation Using Co-Prime Arrays: A Super Resolution Viewpoint , 2013, IEEE Transactions on Signal Processing.

[11]  Marco F. Duarte,et al.  Spectral compressive sensing , 2013 .

[12]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[13]  Bhaskar D. Rao,et al.  A sparse Bayesian learning algorithm with dictionary parameter estimation , 2014, 2014 IEEE 8th Sensor Array and Multichannel Signal Processing Workshop (SAM).

[14]  Parikshit Shah,et al.  Compressed Sensing Off the Grid , 2012, IEEE Transactions on Information Theory.

[15]  Tapan K. Sarkar,et al.  Matrix pencil method for estimating parameters of exponentially damped/undamped sinusoids in noise , 1990, IEEE Trans. Acoust. Speech Signal Process..

[16]  Lihua Xie,et al.  On Gridless Sparse Methods for Line Spectral Estimation From Complete and Incomplete Data , 2014, IEEE Transactions on Signal Processing.

[17]  Arye Nehorai,et al.  Joint Sparse Recovery Method for Compressed Sensing With Structured Dictionary Mismatches , 2013, IEEE Transactions on Signal Processing.

[18]  Jun Fang,et al.  Exact Reconstruction Analysis of Log-Sum Minimization for Compressed Sensing , 2013, IEEE Signal Processing Letters.

[19]  Thomas Kailath,et al.  ESPRIT-estimation of signal parameters via rotational invariance techniques , 1989, IEEE Trans. Acoust. Speech Signal Process..

[20]  Lawrence Carin,et al.  Bayesian Compressive Sensing , 2008, IEEE Transactions on Signal Processing.

[21]  R. O. Schmidt,et al.  Multiple emitter location and signal Parameter estimation , 1986 .

[22]  A. Robert Calderbank,et al.  Sensitivity to Basis Mismatch in Compressed Sensing , 2011, IEEE Trans. Signal Process..

[23]  Stephen P. Boyd,et al.  Enhancing Sparsity by Reweighted ℓ1 Minimization , 2007, 0711.1612.

[24]  George Eastman House,et al.  Sparse Bayesian Learning and the Relevance Vector Machine , 2001 .

[25]  Benjamin Friedlander,et al.  An Efficient Parametric Technique for Doppler-Delay Estimation , 2012, IEEE Transactions on Signal Processing.

[26]  Neil Genzlinger A. and Q , 2006 .

[27]  Yuejie Chi,et al.  Off-the-Grid Line Spectrum Denoising and Estimation With Multiple Measurement Vectors , 2014, IEEE Transactions on Signal Processing.

[28]  Christian Jutten,et al.  Parametric dictionary learning using steepest descent , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[29]  Yoopyo Hong,et al.  A lower bound for the smallest singular value , 1992 .

[30]  Bhaskar D. Rao,et al.  An affine scaling methodology for best basis selection , 1999, IEEE Trans. Signal Process..

[31]  Wenjing Liao,et al.  Coherence Pattern-Guided Compressive Sensing with Unresolved Grids , 2011, SIAM J. Imaging Sci..

[32]  Gu Dun-he,et al.  A NOTE ON A LOWER BOUND FOR THE SMALLEST SINGULAR VALUE , 1997 .

[33]  Cishen Zhang,et al.  Off-Grid Direction of Arrival Estimation Using Sparse Bayesian Inference , 2011, IEEE Transactions on Signal Processing.

[34]  Emery N. Brown,et al.  Convergence and Stability of Iteratively Re-weighted Least Squares Algorithms , 2014, IEEE Transactions on Signal Processing.

[35]  Emmanuel J. Cand Towards a Mathematical Theory of Super-Resolution , 2012 .

[36]  Li Hua,et al.  A Lower Bound for the Smallest Singular Value , 2009 .

[37]  I. Daubechies,et al.  Iteratively reweighted least squares minimization for sparse recovery , 2008, 0807.0575.

[38]  Justin K. Romberg,et al.  Beyond Nyquist: Efficient Sampling of Sparse Bandlimited Signals , 2009, IEEE Transactions on Information Theory.

[39]  Mark A. Lukas,et al.  Comparing parameter choice methods for regularization of ill-posed problems , 2011, Math. Comput. Simul..

[40]  Bhaskar D. Rao,et al.  Sparse signal reconstruction from limited data using FOCUSS: a re-weighted minimum norm algorithm , 1997, IEEE Trans. Signal Process..

[41]  Yuxin Chen,et al.  Robust Spectral Compressed Sensing via Structured Matrix Completion , 2013, IEEE Transactions on Information Theory.

[42]  Qiang Fu,et al.  Compressed Sensing of Complex Sinusoids: An Approach Based on Dictionary Refinement , 2012, IEEE Transactions on Signal Processing.