Almost Euclidean subspaces of ℓ1N VIA expander codes

AbstractWe give an explicit (in particular, deterministic polynomial time) construction of subspaces X⊆ℝN of dimension (1−o(1))N such that for every x∈X, $$ (\log N)^{ - O(\log \log \log N)} \sqrt N \left\| x \right\|_2 \leqslant \left\| x \right\|_1 \leqslant \sqrt N \left\| x \right\|_2 $$. If we are allowed to use N1/log logN ⩽ No(1) random bits and dim(X) ⩾ (1−η)N for any fixed constant η, the lower bound can be further improved to $$ (\log N)^{ - O(1)} \sqrt N \left\| x \right\|_2 $$.Through known connections between such Euclidean sections of ℓ1 and compressed sensing matrices, our result also gives explicit compressed sensing matrices for low compression factors for which basis pursuit is guaranteed to recover sparse signals. Our construction makes use of unbalanced bipartite graphs to impose local linear constraints on vectors in the subspace, and our analysis relies on expansion properties of the graph. This is inspired by similar constructions of error-correcting codes.

[1]  J. Bourgain,et al.  Estimates for the number of sums and products and for exponential sums over subgroups in fields of prime order , 2003 .

[2]  Enkatesan G Uruswami Unbalanced expanders and randomness extractors from Parvaresh-Vardy codes , 2008 .

[3]  Robert Michael Tanner,et al.  A recursive approach to low complexity codes , 1981, IEEE Trans. Inf. Theory.

[4]  Venkatesan Guruswami,et al.  Euclidean Sections of with Sublinear Randomness and Error-Correction over the Reals , 2008, APPROX-RANDOM.

[5]  Robert G. Gallager,et al.  Low-density parity-check codes , 1962, IRE Trans. Inf. Theory.

[6]  D. Donoho,et al.  Uncertainty principles and signal recovery , 1989 .

[7]  Terence Tao,et al.  Additive combinatorics , 2007, Cambridge studies in advanced mathematics.

[8]  Terence Tao,et al.  A sum-product estimate in finite fields, and applications , 2003, math/0301343.

[9]  T. Figiel,et al.  The dimension of almost spherical sections of convex bodies , 1976 .

[10]  G. Schechtman,et al.  Chapter 19 Finite dimensional subspaces of L p , 2001 .

[11]  S. Szarek Convexity, complexity, and high dimensions , 2006 .

[12]  Daniel A. Spielman,et al.  Expander codes , 1994, Proceedings 35th Annual Symposium on Foundations of Computer Science.

[13]  I. Miheev,et al.  Trigonometric series with gaps , 1983 .

[14]  Piotr Indyk,et al.  Uncertainty principles, extractors, and explicit embeddings of l2 into l1 , 2007, STOC '07.

[15]  Piotr Indyk,et al.  Stable distributions, pseudorandom generators, embeddings, and data stream computation , 2006, JACM.

[16]  C. Schütt Entropy numbers of diagonal operators between symmetric Banach spaces , 1984 .

[17]  O. Antoine,et al.  Theory of Error-correcting Codes , 2022 .

[18]  V. Milman Topics in Asymptotic Geometric Analysis , 2000 .

[19]  Ronald A. DeVore,et al.  Deterministic constructions of compressed sensing matrices , 2007, J. Complex..

[20]  D. R. Lewis Finite dimensional subspaces of $L_{p}$ , 1978 .

[21]  V. Milman,et al.  Logarithmic reduction of the level of randomness in some probabilistic geometric constructions , 2006 .

[22]  J. Seidel,et al.  QUADRATIC FORMS OVER GF(2) , 1973 .

[23]  G. Schechtman Random embeddings of Euclidean spaces in sequence spaces , 1981 .

[24]  Guy Kindler,et al.  Simulating independence: new constructions of condensers, ramsey graphs, dispersers, and extractors , 2005, STOC '05.

[25]  V. Temlyakov,et al.  A remark on Compressed Sensing , 2007 .

[26]  M. Murty Ramanujan Graphs , 1965 .

[27]  Avi Wigderson,et al.  Extracting randomness using few independent sources , 2004, 45th Annual IEEE Symposium on Foundations of Computer Science.

[28]  Paul Erdös,et al.  A Theorem of Sylvester and Schur , 1934 .

[29]  Jaikumar Radhakrishnan,et al.  Bounds for Dispersers, Extractors, and Depth-Two Superconcentrators , 2000, SIAM J. Discret. Math..

[30]  Avi Wigderson,et al.  Randomness conductors and constant-degree lossless expanders , 2002, STOC '02.

[31]  Anthony M. Kerdock,et al.  A Class of Low-Rate Nonlinear Binary Codes , 1972, Inf. Control..

[32]  Philip D. Plowright,et al.  Convexity , 2019, Optimization for Chemical and Biochemical Engineering.

[33]  Piotr Indyk Explicit constructions for compressed sensing of sparse signals , 2008, SODA '08.

[34]  Shachar Lovett,et al.  Almost Euclidean sections of the N-dimensional cross-polytope using O(N) random bits , 2007, Electron. Colloquium Comput. Complex..

[35]  N. Linial,et al.  Expander Graphs and their Applications , 2006 .

[36]  Noga Alon,et al.  Explicit construction of linear sized tolerant networks , 1988, Discret. Math..