Kakeya Sets, New Mergers and Old Extractors

A merger is a probabilistic procedure which extracts the randomness out of any (arbitrarily correlated) set of random variables, as long as one of them is uniform. Our main result is an efficient, simple, optimal (to constant factors) merger, which, for k random vairables on n bits each, uses a O(log(nk)) seed, and whose error is 1/nk. Our merger can be viewed as a derandomized version of the merger of Lu, Reingold, Vadhan and Wigderson (2003). Its analysis generalizes the recent resolutionof the Kakeya problem in finite fields of Dvir (2008). Following the plan set forth by Ta-Shma (1996), who defined mergers as part of this plan, our merger provides the last "missing link" to a simple and modular construction of extractors for all entropies, which is optimal to constant factorsin all parameters. This complements the elegant construction of optimal extractor by Guruswami, Vadhan and Umans (2007). We also give simple extensions of our merger in two directions. First, we generalize it to handle the case where no source is uniform - in that case the merger will extract the entropy present in the most random of the given sources. Second, we observe that the merger works just as well in the computational setting, when the sources are efficiently samplable, and computational notions of entropy replace the information theoretic ones.

[1]  Zeev Dvir,et al.  An Improved Analysis of Linear Mergers , 2007, computational complexity.

[2]  Zeev Dvir,et al.  On the size of Kakeya sets in finite fields , 2008, 0803.2336.

[3]  Jean Bourgain,et al.  On the Dimension of Kakeya Sets and Related Maximal Inequalities , 1999 .

[4]  Christopher Umans,et al.  Simple extractors for all min-entropies and a new pseudorandom generator , 2005, JACM.

[5]  Terence Tao,et al.  Recent progress on the Kakeya conjecture , 2000 .

[6]  Avi Wigderson,et al.  Extracting Randomness via Repeated Condensing , 2006, SIAM J. Comput..

[7]  Keith McKenzie Rogers,et al.  The Finite Field Kakeya Problem , 2001, Am. Math. Mon..

[8]  Terence Tao,et al.  Restriction and Kakeya phenomena for finite fields , 2002 .

[9]  Terence Tao,et al.  The Kakeya set and maximal conjectures for algebraic varieties over finite fields , 2009, 0903.1879.

[10]  Avi Wigderson,et al.  Tiny Families of Functions with Random Properties: A Quality-Size Trade-off for Hashing , 1997, Electron. Colloquium Comput. Complex..

[11]  Ronen Shaltiel,et al.  Recent Developments in Explicit Constructions of Extractors , 2002, Bull. EATCS.

[12]  Terence Tao,et al.  From rotating needles to stability of waves; emerging connections between combinatorics, analysis and PDE , 2000 .

[13]  Enkatesan G Uruswami Unbalanced expanders and randomness extractors from Parvaresh-Vardy codes , 2008 .

[14]  Leonid A. Levin,et al.  A Pseudorandom Generator from any One-way Function , 1999, SIAM J. Comput..

[15]  Madhu Sudan,et al.  Extensions to the Method of Multiplicities, with Applications to Kakeya Sets and Mergers , 2009, 2009 50th Annual IEEE Symposium on Foundations of Computer Science.

[16]  Thomas Wolff,et al.  Recent work connected with the Kakeya problem , 2007 .

[17]  Avi Wigderson,et al.  Computational Analogues of Entropy , 2003, RANDOM-APPROX.

[18]  Oded Goldreich,et al.  Unbiased Bits from Sources of Weak Randomness and Probabilistic Communication Complexity , 1988, SIAM J. Comput..

[19]  Alexander Vardy,et al.  Correcting errors beyond the Guruswami-Sudan radius in polynomial time , 2005, 46th Annual IEEE Symposium on Foundations of Computer Science (FOCS'05).

[20]  Charles Fefferman,et al.  The Multiplier Problem for the Ball , 1971 .

[21]  Avi Wigderson,et al.  Extractors: optimal up to constant factors , 2003, STOC '03.

[22]  A. Besicovitch On Kakeya's problem and a similar one , 1928 .