Sparse linear regression with compressed and low-precision data via concave quadratic programming

We consider the problem of the recovery of a k-sparse vector from compressed linear measurements when data are corrupted by a quantization noise. When the number of measurements is not sufficiently large, different k-sparse solutions may be present in the feasible set, and the classical ℓ1 approach may be unsuccessful. For this motivation, we propose a non-convex quadratic programming method, which exploits prior information on the magnitude of the non-zero parameters. This results in a more efficient support recovery. We provide sufficient conditions for successful recovery and numerical simulations to illustrate the practical feasibility of the proposed method.

[1]  Richard G. Baraniuk,et al.  Democracy in Action: Quantization, Saturation, and Compressive Sensing , 2011 .

[2]  Jiawang Nie,et al.  Optimality conditions and finite convergence of Lasserre’s hierarchy , 2012, Math. Program..

[3]  Torsten Söderström,et al.  Errors-in-variables methods in system identification , 2018, Autom..

[4]  Sophie Fosson,et al.  Online Optimization in Dynamic Environments: A Regret Analysis for Sparse Problems , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[5]  Vito Cerone,et al.  Feasible parameter set for linear models with bounded errors in all variables , 1993, Autom..

[6]  Cishen Zhang,et al.  Robustly Stable Signal Recovery in Compressed Sensing With Structured Matrix Perturbation , 2011, IEEE Transactions on Signal Processing.

[7]  Jiawang Nie,et al.  Certifying convergence of Lasserre’s hierarchy via flat truncation , 2011, Math. Program..

[8]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[9]  Dario Piga,et al.  Set-Membership Error-in-Variables Identification Through Convex Relaxation Techniques , 2012, IEEE Transactions on Automatic Control.

[10]  Holger Rauhut,et al.  A Mathematical Introduction to Compressive Sensing , 2013, Applied and Numerical Harmonic Analysis.

[11]  Sophie Fosson,et al.  Sparsity-promoting sensor selection with energy harvesting constraints , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[12]  Enrico Magli,et al.  Graded Quantization for Multiple Description Coding of Compressive Measurements , 2015, IEEE Transactions on Communications.

[13]  Michael Elad,et al.  On the stability of the basis pursuit in the presence of noise , 2006, Signal Process..

[14]  Tyrone L. Vincent,et al.  Compressive System Identification of LTI and LTV ARX models , 2011, IEEE Conference on Decision and Control and European Control Conference.

[15]  Jean B. Lasserre,et al.  Convergent SDP-Relaxations for Polynomial Optimization with Sparsity , 2006, ICMS.

[16]  Jean B. Lasserre,et al.  Global Optimization with Polynomials and the Problem of Moments , 2000, SIAM J. Optim..

[17]  H. Hjalmarsson,et al.  Sparse Estimation of Rational Dynamical Models , 2012 .

[18]  Mohammad Abuabiah,et al.  Recovery of Binary Sparse Signals From Compressed Linear Measurements via Polynomial Optimization , 2019, IEEE Signal Processing Letters.

[19]  R. Tibshirani.  The Lasso Problem and Uniqueness , 2012, 1206.0313.

[20]  Vito Cerone,et al.  A linear programming approach to sparse linear regression with quantized data , 2019, 2019 American Control Conference (ACC).

[21]  Thomas Strohmer,et al.  General Deviants: An Analysis of Perturbations in Compressed Sensing , 2009, IEEE Journal of Selected Topics in Signal Processing.

[22]  Enrico Magli,et al.  Block-sparsity-based localization in wireless sensor networks , 2015, EURASIP J. Wirel. Commun. Netw..

[23]  Tyrone L. Vincent,et al.  Compressive System Identification in the Linear Time-Invariant framework , 2011, IEEE Conference on Decision and Control and European Control Conference.

[24]  Enrico Magli,et al.  Distributed support detection of jointly sparse signals , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[25]  J. Lofberg,et al.  YALMIP : a toolbox for modeling and optimization in MATLAB , 2004, 2004 IEEE International Conference on Robotics and Automation (IEEE Cat. No.04CH37508).

[26]  Sophie Fosson,et al.  Non-convex approach to binary compressed sensing , 2018, 2018 52nd Asilomar Conference on Signals, Systems, and Computers.