Euclidean Sections of with Sublinear Randomness and Error-Correction over the Reals

It is well-known that $\mathbb R^N$ has subspaces of dimension proportional to Non which the i¾? 1 and i¾? 2 norms are uniformly equivalent, but it is unknown how to construct them explicitly. We show that, for any i¾?> 0, such a subspace can be generated using only Ni¾?random bits. This improves over previous constructions of Artstein-Avidan and Milman, and of Lovett and Sodin, which require O(NlogN), and O(N) random bits, respectively. Such subspaces are known to also yield error-correcting codes over the reals and compressed sensing matrices. Our subspaces are defined by the kernel of a relatively sparse matrix (with at most Ni¾?non-zero entries per row), and thus enable compressed sensing in near-linear O(N1 + i¾?) time. As in the work of Guruswami, Lee, and Razborov, our construction is the continuous analog of a Tanner code, and makes use of expander graphs to impose a collection of local linear constraints on vectors in the subspace. Our analysis is able to achieve uniformequivalence of the i¾? 1 and i¾? 2 norms (independent of the dimension). It has parallels to iterative decoding of Tanner codes, and leads to an analogous near-linear time algorithm for error-correction over reals.

[1]  Daniel A. Spielman,et al.  Expander codes , 1994, Proceedings 35th Annual Symposium on Foundations of Computer Science.

[2]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[3]  T. Figiel,et al.  The dimension of almost spherical sections of convex bodies , 1976 .

[4]  Venkatesan Guruswami,et al.  Linear-time encodable/decodable codes with near-optimal rate , 2005, IEEE Transactions on Information Theory.

[5]  G. Schechtman,et al.  Chapter 19 Finite dimensional subspaces of L p , 2001 .

[6]  M. Murty Ramanujan Graphs , 1965 .

[7]  Robert Michael Tanner,et al.  A recursive approach to low complexity codes , 1981, IEEE Trans. Inf. Theory.

[8]  Matemática,et al.  Society for Industrial and Applied Mathematics , 2010 .

[9]  Weiyu Xu,et al.  Efficient Compressive Sensing with Deterministic Guarantees Using Expander Graphs , 2007, 2007 IEEE Information Theory Workshop.

[10]  Shachar Lovett,et al.  Almost Euclidean sections of the N-dimensional cross-polytope using O(N) random bits , 2007, Electron. Colloquium Comput. Complex..

[11]  N. Linial,et al.  Expander Graphs and their Applications , 2006 .

[12]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[13]  D. R. Lewis Finite dimensional subspaces of $L_{p}$ , 1978 .

[14]  Piotr Indyk,et al.  Stable distributions, pseudorandom generators, embeddings, and data stream computation , 2006, JACM.

[15]  V. Temlyakov,et al.  A remark on Compressed Sensing , 2007 .

[16]  James R. Lee,et al.  Almost Euclidean subspaces of $\ell_1^N$ via expander codes. , 2007 .

[17]  V. Milman,et al.  Logarithmic reduction of the level of randomness in some probabilistic geometric constructions , 2006 .

[18]  Piotr Indyk,et al.  Uncertainty principles, extractors, and explicit embeddings of l2 into l1 , 2007, STOC '07.

[19]  S. Szarek Convexity, complexity, and high dimensions , 2006 .

[20]  V. Milman Topics in Asymptotic Geometric Analysis , 2000 .

[21]  C. Schütt Entropy numbers of diagonal operators between symmetric Banach spaces , 1984 .

[22]  J. Lindenstrauss,et al.  Handbook of geometry of Banach spaces , 2001 .

[23]  James R. Lee,et al.  Almost Euclidean subspaces of e N 1 via expander codes , 2008, SODA 2008.

[24]  Venkatesan Guruswami,et al.  Almost Euclidean subspaces of ℓ1N VIA expander codes , 2007, SODA '08.