Damping Noise-Folding and Enhanced Support Recovery in Compressed Sensing

The practice of compressed sensing suffers importantly in terms of the efficiency/accuracy trade-off when acquiring noisy signals prior to measurement. It is rather common to find results treating the noise affecting the measurements, avoiding in this way to face the so-called noise-folding phenomenon, related to the noise in the signal, eventually amplified by the measurement procedure. In this paper, we present two new decoding procedures, combining l1-minimization followed by either a regularized selective least p-powers or an iterative hard thresholding, which not only are able to reduce this component of the original noise, but also have enhanced properties in terms of support identification with respect to the sole l1-minimization or iteratively re-weighted l1-minimization. We prove such features, providing relatively simple and precise theoretical guarantees. We additionally confirm and support the theoretical results by extensive numerical simulations, which give a statistics of the robustness of the new decoding procedures with respect to more classical methods based on l1-minimization.

[1]  Terence Tao,et al.  The Dantzig selector: Statistical estimation when P is much larger than n , 2005, math/0506081.

[2]  Robert D. Nowak,et al.  Sequentially designed compressed sensing , 2012, 2012 IEEE Statistical Signal Processing Workshop (SSP).

[3]  Richard G. Baraniuk,et al.  The Pros and Cons of Compressive Sensing for Wideband Signal Acquisition: Noise Folding versus Dynamic Range , 2011, IEEE Transactions on Signal Processing.

[4]  Deanna Needell,et al.  Signal Recovery From Incomplete and Inaccurate Measurements Via Regularized Orthogonal Matching Pursuit , 2007, IEEE Journal of Selected Topics in Signal Processing.

[5]  Stephen P. Boyd,et al.  Enhancing Sparsity by Reweighted ℓ1 Minimization , 2007, 0711.1612.

[6]  Holger Rauhut,et al.  Compressive Sensing with structured random matrices , 2012 .

[7]  J. Tropp,et al.  CoSaMP: Iterative signal recovery from incomplete and inaccurate samples , 2008, Commun. ACM.

[8]  Deanna Needell,et al.  Noisy signal recovery via iterative reweighted L1-minimization , 2009, 2009 Conference Record of the Forty-Third Asilomar Conference on Signals, Systems and Computers.

[9]  Robert D. Nowak,et al.  Distilled Sensing: Adaptive Sampling for Sparse Detection and Estimation , 2010, IEEE Transactions on Information Theory.

[10]  Weiyu Xu,et al.  Improved sparse recovery thresholds with two-step reweighted ℓ1 minimization , 2010, 2010 IEEE International Symposium on Information Theory.

[11]  Otmar Scherzer,et al.  Handbook of Mathematical Methods in Imaging , 2015, Handbook of Mathematical Methods in Imaging.

[12]  Deanna Needell,et al.  CoSaMP: Iterative signal recovery from incomplete and inaccurate samples , 2008, ArXiv.

[13]  H. Rauhut.  Compressive Sensing and Structured Random Matrices , 2009 .

[14]  Stephen J. Wright,et al.  Numerical Optimization (Springer Series in Operations Research and Financial Engineering) , 2000 .

[15]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[16]  Massimo Fornasier,et al.  Compressive Sensing , 2015, Handbook of Mathematical Methods in Imaging.

[17]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[18]  Robert D. Nowak,et al.  Compressive distilled sensing: Sparse recovery using adaptivity in compressive measurements , 2009, 2009 Conference Record of the Forty-Third Asilomar Conference on Signals, Systems and Computers.

[19]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[20]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[21]  Rachel Ward,et al.  On the Complexity of Mumford–Shah-Type Regularization, Viewed as a Relaxed Sparsity Constraint , 2010, IEEE Transactions on Image Processing.

[22]  Massimo Fornasier,et al.  Compressive Sensing and Structured Random Matrices , 2010 .

[23]  Holger Rauhut,et al.  A Mathematical Introduction to Compressive Sensing , 2013, Applied and Numerical Harmonic Analysis.

[24]  R. DeVore,et al.  A Simple Proof of the Restricted Isometry Property for Random Matrices , 2008 .

[25]  Richard G. Baraniuk,et al.  The Pros and Cons of Compressive Sensing for Wideband Signal Acquisition: Noise Folding vs. Dynamic Range , 2011, ArXiv.

[26]  Richard Baraniuk,et al.  APPLICATION OF COMPRESSIVE SENSING TO THE DESIGN OF WIDEBAND SIGNAL ACQUISITION RECEIVERS , 2009 .

[27]  Stephen P. Boyd,et al.  Graph Implementations for Nonsmooth Convex Programs , 2008, Recent Advances in Learning and Control.

[28]  Massimo Fornasier,et al.  Linearly Constrained Nonsmooth and Nonconvex Minimization , 2012, SIAM J. Optim..

[29]  Holger Rauhut,et al.  Remote Sensing via ℓ1-Minimization , 2012, Found. Comput. Math..

[30]  Hans Kjeldsen,et al.  Solar-like Oscillations , 2003, Publications of the Astronomical Society of Australia.

[31]  P. Wojtaszczyk,et al.  Stability and Instance Optimality for Gaussian Measurements in Compressed Sensing , 2010, Found. Comput. Math..

[32]  Gerhard Fettweis,et al.  Analyzing the signal-to-noise ratio of direct sampling receivers , 2013, 2013 IEEE International Conference on Communications (ICC).

[33]  Massimo Fornasier,et al.  Theoretical Foundations and Numerical Methods for Sparse Recovery , 2010, Radon Series on Computational and Applied Mathematics.

[34]  T. Blumensath,et al.  Iterative Thresholding for Sparse Approximations , 2008 .

[35]  R. DeVore,et al.  Compressed sensing and best k-term approximation , 2008 .

[36]  Massimo Fornasier,et al.  Iterative Thresholding Meets Free-Discontinuity Problems , 2009, Found. Comput. Math..

[37]  Deanna Needell,et al.  Uniform Uncertainty Principle and Signal Recovery via Regularized Orthogonal Matching Pursuit , 2007, Found. Comput. Math..

[38]  Weiyu Xu,et al.  Compressed sensing of approximately sparse signals , 2008, 2008 IEEE International Symposium on Information Theory.

[39]  Magali Deleuil,et al.  Non-radial oscillation modes with long lifetimes in giant stars , 2009, Nature.

[40]  R.G. Baraniuk,et al.  Compressive Sensing [Lecture Notes] , 2007, IEEE Signal Processing Magazine.

[41]  Yonina C. Eldar,et al.  Noise Folding in Compressed Sensing , 2011, IEEE Signal Processing Letters.

[42]  Stéphane Mallat,et al.  A Wavelet Tour of Signal Processing - The Sparse Way, 3rd Edition , 2008 .

[43]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[44]  慧 廣瀬.  A Mathematical Introduction to Compressive Sensing , 2015 .