Theory of Compressive Sensing via ℓ1-Minimization: a Non-RIP Analysis and Extensions

Compressive sensing (CS) is an emerging methodology in computational signal processing that has recently attracted intensive research activities. At present, the basic CS theory includes recoverability and stability: the former quantifies the central fact that a sparse signal of length n can be exactly recovered from far fewer than n measurements via ℓ1-minimization or other recovery techniques, while the latter specifies the stability of a recovery technique in the presence of measurement errors and inexact sparsity. So far, most analyses in CS rely heavily on the Restricted Isometry Property (RIP) for matrices.In this paper, we present an alternative, non-RIP analysis for CS via ℓ1-minimization. Our purpose is three-fold: (a) to introduce an elementary and RIP-free treatment of the basic CS theory; (b) to extend the current recoverability and stability results so that prior knowledge can be utilized to enhance recovery via ℓ1-minimization; and (c) to substantiate a property called uniform recoverability of ℓ1-minimization; that is, for almost all random measurement matrices recoverability is asymptotically identical. With the aid of two classic results, the non-RIP approach enables us to quickly derive from scratch all basic results for the extended theory.

[1]  M. Lustig,et al.  Compressed Sensing MRI , 2008, IEEE Signal Processing Magazine.

[2]  Michael Elad,et al.  On the stability of the basis pursuit in the presence of noise , 2006, Signal Process..

[3]  V. Milman,et al.  Asymptotic Theory Of Finite Dimensional Normed Spaces , 1986 .

[4]  D. Donoho,et al.  Counting faces of randomly-projected polytopes when the projection radically lowers dimension , 2006, math/0607364.

[5]  F. Santosa,et al.  Linear inversion of ban limit reflection seismograms , 1986 .

[6]  M. Rudelson,et al.  Geometric approach to error-correcting codes and reconstruction of signals , 2005, math/0502299.

[7]  Deanna Needell,et al.  Signal Recovery From Incomplete and Inaccurate Measurements Via Regularized Orthogonal Matching Pursuit , 2007, IEEE Journal of Selected Topics in Signal Processing.

[8]  Yin Zhang,et al.  A Simple Proof for Recoverability of `1-Minimization , 2005 .

[9]  Vitali Milman,et al.  Note on the Geometric-Arithmetic Mean Inequality , 2003 .

[10]  V. Temlyakov,et al.  A remark on Compressed Sensing , 2007 .

[11]  R. DeVore,et al.  Compressed sensing and best k-term approximation , 2008 .

[12]  Anatoly Eydelzon,et al.  A Study on Conditions for Sparse Solution Recovery in Compressive Sensing , 2007 .

[13]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[14]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[15]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[16]  Gideon Schechtman,et al.  Geometric aspects of functional analysis : Israel Seminar 2006-2010 , 2012 .

[17]  Andrej Yu. Garnaev,et al.  On widths of the Euclidean Ball , 1984 .

[18]  Deanna Needell,et al.  CoSaMP: Iterative signal recovery from incomplete and inaccurate samples , 2008, ArXiv.

[19]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[20]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[21]  D. Donoho,et al.  Sparse nonnegative solution of underdetermined linear equations by linear programming. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[22]  S. Vavasis Derivation of Compressive Sensing Theorems from the Spherical Section property , 2009 .

[23]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[24]  Michael Elad,et al.  Optimally sparse representation in general (nonorthogonal) dictionaries via ℓ1 minimization , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[25]  Yaakov Tsaig,et al.  Extensions of compressed sensing , 2006, Signal Process..

[26]  E. Candès The restricted isometry property and its implications for compressed sensing , 2008 .

[27]  V. Girko A Refinement of the Central Limit Theorem for Random Determinants , 1998 .

[28]  Yaakov Tsaig,et al.  Breakdown of equivalence between the minimal l1-norm solution and the sparsest solution , 2006, Signal Process..

[29]  Vi︠a︡cheslav Leonidovich Girko,et al.  Theory of random determinants , 1990 .

[30]  E.J. Candes Compressive Sampling , 2022 .

[31]  Emmanuel J. Cand The Restricted Isometry Property and Its Implications for Compressed Sensing , 2008 .

[32]  R. DeVore,et al.  A Simple Proof of the Restricted Isometry Property for Random Matrices , 2008 .

[33]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..