Sparse estimation from sign measurements with general sensing matrix perturbation

In this paper, the problem of estimating a sparse deterministic parameter vector from its sign measurements with a general perturbed sensing matrix is considered. Firstly, the best achievable mean square error (MSE) performance is explored by deriving the sparsity constrained Cramér Rao lower bound (CRLB). Secondly, the maximum likelihood (ML) estimator is utilized to estimate the unknown parameter vector. Although the ML estimation problem is non-convex, we find it can be reformulated as a convex optimization problem by re-parametrization and relaxation, which guarantees numerical algorithms to converge to the optimal point. Thirdly, a fixed point continuation (FPC) algorithm is used to solve the relaxed ML estimation problem. Finally, numerical simulations are performed to show that this relaxed method works well, and the ML estimator asymptotically approaches the CRLB as the number of measurements increases.

[1]  Alfred O. Hero,et al.  Lower bounds for parametric estimation with constraints , 1990, IEEE Trans. Inf. Theory.

[2]  Alejandro Ribeiro,et al.  Bandwidth-constrained distributed estimation for wireless sensor Networks-part I: Gaussian case , 2006, IEEE Transactions on Signal Processing.

[3]  J. Magnus,et al.  Matrix Differential Calculus with Applications in Statistics and Econometrics , 1991 .

[4]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[5]  Nikos D. Sidiropoulos,et al.  Connections between sparse estimation and robust statistical learning , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[6]  Yin Zhang,et al.  Fixed-Point Continuation for l1-Minimization: Methodology and Convergence , 2008, SIAM J. Optim..

[7]  Xiaokang Lin,et al.  Maximum Likelihood Estimation From Sign Measurements With Sensing Matrix Perturbation , 2013, IEEE Transactions on Signal Processing.

[8]  Yuantao Gu,et al.  On the Performance Bound of Sparse Estimation With Sensing Matrix Perturbation , 2012, IEEE Transactions on Signal Processing.

[9]  U. Bhattacharya Three Empirical Essays on Child Education Using Data from India , 2011 .

[10]  Yonina C. Eldar,et al.  The Cramér-Rao Bound for Estimating a Sparse Parameter Vector , 2010, IEEE Transactions on Signal Processing.

[11]  Yuantao Gu,et al.  Proof of Convergence and Performance Analysis for Sparse Recovery via Zero-Point Attracting Projection , 2012, IEEE Transactions on Signal Processing.

[12]  Stephen P. Boyd,et al.  Compressed Sensing With Quantized Measurements , 2010, IEEE Signal Processing Letters.

[13]  Ami Wiesel,et al.  Linear Regression With Gaussian Model Uncertainty: Algorithms and Bounds , 2008, IEEE Transactions on Signal Processing.