Explicit constructions of RIP matrices and related problems

We give a new explicit construction ofn×N matrices satisfying the Restricted Isometry Property (RIP). Namely, for some e > 0, largeN , and anyn satisfyingN1−e ≤ n ≤ N , we construct RIP matrices of order k ≥ n1/2+e and constant δ = n−e. This overcomes the natural barrier k = O(n1/2) for proofs based on small coherence, which are used in all previous explicit constructions of RIP matrices. Key ingredients in our proof are new estimates for sumsets in product sets and for exponential sums with the products of sets possessing special additive structure. We also give a construction of sets of n complex numbers whose kth moments are uniformly small for 1 ≤ k ≤ N (Turan’s power sum problem), which improves upon known explicit constructions when (logN)1+o(1) ≤ n ≤ (logN)4+o(1). This latter construction produces elementary explicit examples of n×N matrices that satisfy the RIP and whose columns constitute a new spherical code; for those problems the parameters closely match those of existing constructions in the range (logN )1+o(1) ≤ n ≤ (logN)5/2+o(1).

[1]  On some power sum problems of Montgomery and Turan , 2007, 0706.4131.

[2]  M. Rudelson,et al.  On sparse reconstruction from Fourier and Gaussian measurements , 2008 .

[3]  Jean Bourgain,et al.  Multilinear Exponential Sums in Prime Fields Under Optimal Entropy Condition on the Sources , 2009 .

[4]  Piotr Indyk,et al.  Combining geometry and combinatorics: A unified approach to sparse signal recovery , 2008, 2008 46th Annual Allerton Conference on Communication, Control, and Computing.

[5]  W. B. Johnson,et al.  Extensions of Lipschitz mappings into Hilbert space , 1984 .

[6]  Paul Erdös,et al.  A probabilistic approach to problems of Diophantine approximation , 1957 .

[7]  E. Livshitz On efficiency of Orthogonal Matching Pursuit , 2010, 1004.3946.

[8]  E. Wright,et al.  An Introduction to the Theory of Numbers , 1939 .

[9]  S. Muthukrishnan,et al.  Approximation of functions over redundant dictionaries using coherence , 2003, SODA '03.

[10]  A. Prékopa Logarithmic concave measures with applications to stochastic programming , 1971 .

[11]  Entao Liu,et al.  Orthogonal Super Greedy Algorithm and Applications in Compressed Sensing ∗ , 2010 .

[12]  Béla Bollobás,et al.  Sums in the grid , 1996, Discret. Math..

[13]  N. Katz An estimate for character sums , 1989 .

[14]  Terence Tao,et al.  Additive combinatorics , 2007, Cambridge studies in advanced mathematics.

[15]  E. T. An Introduction to the Theory of Numbers , 1946, Nature.

[16]  Vladimir N. Temlyakov,et al.  On the size of incoherent systems , 2011, J. Approx. Theory.

[17]  Jean Bourgain,et al.  On a variant of sum-product estimates and explicit exponential sum bounds in prime fields , 2009, Mathematical Proceedings of the Cambridge Philosophical Society.

[18]  E. Szemerédi,et al.  Construction of a thin set with small fourier coefficients , 1990 .

[19]  R. Hadani,et al.  The statistical restricted isometry property and the Wigner semicircle distribution of incoherent dictionaries , 2008, ArXiv.

[20]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[21]  Noga Alon,et al.  Simple construction of almost k-wise independent random variables , 1990, Proceedings [1990] 31st Annual Symposium on Foundations of Computer Science.

[22]  E. D. Gluskin The octahedron is badly approximated by random subspaces , 1986 .

[23]  Michael Elad,et al.  On Lebesgue-type inequalities for greedy approximation , 2007, J. Approx. Theory.

[24]  R. DeVore,et al.  A Simple Proof of the Restricted Isometry Property for Random Matrices , 2008 .

[25]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[26]  Douglas R. Woodall A theorem on cubes , 1977 .

[27]  L. Carlitz DISTRIBUTION OF PRIMITIVE ROOTS IN A FINITE FIELD , 1953 .

[28]  Venkatesan Guruswami,et al.  List decoding algorithms for certain concatenated codes , 2000, STOC '00.

[29]  L. Sofman Diameters of octahedra , 1969 .

[30]  J. Andersson On the solutions to a power sum problem , 2006, math/0609621.

[31]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[32]  Endre Szemerédi,et al.  Constructing Small Sets that are Uniform in Arithmetic Progressions , 1993, Combinatorics, Probability and Computing.

[33]  Paul Turán,et al.  On a new method of analysis and its applications , 1984 .

[34]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[35]  B. S. Kašin,et al.  DIAMETERS OF SOME FINITE-DIMENSIONAL SETS AND CLASSES OF SMOOTH FUNCTIONS , 1977 .

[36]  E. Candès The restricted isometry property and its implications for compressed sensing , 2008 .

[37]  S. B. Stechkin Some extremal properties of trigonometric sums , 1994 .

[38]  Explicit solutions to certain inf max problems from Turán power sum theory , 2006, math/0607238.

[39]  J. Rosser,et al.  Approximate formulas for some functions of prime numbers , 1962 .

[40]  Ronald A. DeVore,et al.  Deterministic constructions of compressed sensing matrices , 2007, J. Complex..

[41]  Michael Rosen,et al.  A classical introduction to modern number theory , 1982, Graduate texts in mathematics.

[42]  Amnon Ta-Shma,et al.  Constructing Small-Bias Sets from Algebraic-Geometric Codes , 2009, 2009 50th Annual IEEE Symposium on Foundations of Computer Science.

[43]  Deanna Needell,et al.  Uniform Uncertainty Principle and Signal Recovery via Regularized Orthogonal Matching Pursuit , 2007, Found. Comput. Math..

[44]  H. Montgomery Ten lectures on the interface between analytic number theory and harmonic analysis , 1994 .

[45]  S. Mendelson,et al.  Reconstruction and Subgaussian Operators in Asymptotic Geometric Analysis , 2007 .

[46]  J. Bourgain,et al.  Exponential sum estimates over a subgroup in an arbitrary finite field , 2011 .