ExCoV: Expansion-compression Variance-component based sparse-signal reconstruction from noisy measurements

We present an expansion-compression variance-component based method (EXCOV) for reconstructing sparse or compressible signals from noisy measurements. The measurements follow an underdetermined linear model, with noise covariance matrix known up to a constant. To impose sparse or compressible signal structure, we define high- and low-signal coefficients, where each high-signal coefficient is assigned its own variance, low-signal coefficients are assigned a common variance, and all the variance components are unknown. Our expansion-compression scheme approximately maximizes a generalized maximum likelihood (GML) criterion, providing an approximate GML estimate of the high-signal coefficient set and an empirical Bayesian estimate of the signal coefficients.We apply the proposed method to reconstruct signals from compressive samples, compare it with existing approaches, and demonstrate its performance via numerical simulations.

[1]  Bhaskar D. Rao,et al.  Sparse signal reconstruction from limited data using FOCUSS: a re-weighted minimum norm algorithm , 1997, IEEE Trans. Signal Process..

[2]  D. Donoho,et al.  Counting faces of randomly-projected polytopes when the projection radically lowers dimension , 2006, math/0607364.

[3]  Terence Tao,et al.  The Dantzig selector: Statistical estimation when P is much larger than n , 2005, math/0506081.

[4]  Mike E. Davies,et al.  A simple, efficient and near optimal algorithm for compressed sensing , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[5]  Lawrence Carin,et al.  Bayesian Compressive Sensing , 2008, IEEE Transactions on Signal Processing.

[6]  S. Kay Fundamentals of statistical signal processing: estimation theory , 1993 .

[7]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[8]  Bin Yu,et al.  Model Selection and the Principle of Minimum Description Length , 2001 .

[9]  Mário A. T. Figueiredo,et al.  Gradient Projection for Sparse Reconstruction: Application to Compressed Sensing and Other Inverse Problems , 2007, IEEE Journal of Selected Topics in Signal Processing.

[10]  Deanna Needell,et al.  CoSaMP: Iterative signal recovery from incomplete and inaccurate samples , 2008, ArXiv.

[11]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[12]  Bhaskar D. Rao,et al.  Sparse Bayesian learning for basis selection , 2004, IEEE Transactions on Signal Processing.