On derandomizing algorithms that err extremely rarely

Does derandomization of probabilistic algorithms become easier when the number of "bad" random inputs is extremely small? In relation to the above question, we put forward the following quantified derandomization challenge: For a class of circuits C (e.g., P/poly or AC0, AC0[2]) and a bounding function B: N → N (e.g., B(n) = nlog n or B(n) = exp(n0.99))), given an n-input circuit C from C that evaluates to 1 on all but at most B(n) of its inputs, find (in deterministic polynomial-time) an input x such that C(x) = 1. Indeed, the standard derandomization challenge for the class C corresponds to the case of B(n) = 2n/2 (or to B(n) = 2n/3 for the two-sided version case). Our main results regarding the new quantified challenge are: 1. Solving the quantified derandomization challenge for the class AC0 and every sub-exponential bounding function (e.g., B(n) = exp(n0.999)). 2. Showing that solving the quantified derandomization challenge for the class AC0[2] and any sub-exponential bounding function (e.g., B(n) = exp(n0.001)), implies solving the standard derandomization challenge for the class AC0[2] (i.e., for B(n) = 2n/2). Analogous results are obtained also for stronger (Black-box) forms of efficient derandomization like hitting-set generators. We also obtain results for other classes of computational devices including log-space algorithms and Arithmetic circuits. For the latter we present a deterministic polynomial-time hitting set generator for the class of n-variate polynomials of degree d over GF(2) that evaluate to 0 on at most an O(2-d) fraction of their inputs. In general, the quantified derandomization problem raises a variety of seemingly unexplored questions about many randomized complexity classes, and may offer a tractable approach to unconditional derandomization for some of them.

[1]  Oded Goldreich,et al.  On the power of two-point based sampling , 1989, J. Complex..

[2]  Andrew Chi-Chih Yao,et al.  Theory and Applications of Trapdoor Functions (Extended Abstract) , 1982, FOCS.

[3]  Gheorghe Paun,et al.  Current Trends in Theoretical Computer Science: The Challenge of the New Century , 2004 .

[4]  Michael Sipser,et al.  Expanders, Randomness, or Time versus Space , 1988, J. Comput. Syst. Sci..

[5]  Noam Nisan,et al.  Hardness vs Randomness , 1994, J. Comput. Syst. Sci..

[6]  A. Yao Separating the polynomial-time hierarchy by oracles , 1985 .

[7]  Emanuele Viola The Sum of d Small-Bias Generators Fools Polynomials of Degree d , 2008, Computational Complexity Conference.

[8]  Luca Trevisan,et al.  Extractors and pseudorandom generators , 2001, JACM.

[9]  Emanuele Viola,et al.  The complexity of constructing pseudorandom generators from hard functions , 2005, computational complexity.

[10]  Russell Impagliazzo,et al.  Reducing the complexity of reductions , 1997, STOC '97.

[11]  Johan Håstad,et al.  Almost optimal lower bounds for small depth circuits , 1986, STOC '86.

[12]  Omer Reingold,et al.  DNF sparsification and a faster deterministic counting algorithm , 2012, 2012 IEEE 27th Conference on Computational Complexity.

[13]  Moni Naor,et al.  Small-bias probability spaces: efficient constructions and applications , 1990, STOC '90.

[14]  Luca Trevisan,et al.  A Derandomized Switching Lemma and an Improved Derandomization of AC0 , 2013, 2013 IEEE Conference on Computational Complexity.

[15]  Miklós Ajtai,et al.  Approximate Counting with Uniform Constant-Depth Circuits , 1990, Advances In Computational Complexity Theory.

[16]  Oded Goldreich,et al.  Computational complexity: a conceptual perspective , 2008, SIGA.

[17]  Avi Wigderson,et al.  Deterministic simulation of probabilistic constant depth circuits , 1985, 26th Annual Symposium on Foundations of Computer Science (sfcs 1985).

[18]  Thomas Steinke,et al.  Pseudorandomness for Regular Branching Programs via Fourier Analysis , 2013, APPROX-RANDOM.

[19]  L. Fortnow Recent Developments in Explicit Constructions of Extractors , 2002 .

[20]  Sanjeev Arora,et al.  Computational Complexity: A Modern Approach , 2009 .

[21]  Noam Nisan,et al.  Pseudorandom generators for space-bounded computations , 1990, STOC '90.

[22]  Luca Trevisan,et al.  Better Pseudorandom Generators from Milder Pseudorandom Restrictions , 2012, 2012 IEEE 53rd Annual Symposium on Foundations of Computer Science.

[23]  Noam Nisan,et al.  Efficient approximation of product distributions , 1998, Random Struct. Algorithms.

[24]  Emanuele Viola,et al.  On Approximate Majority and Probabilistic Time , 2007, Twenty-Second Annual IEEE Conference on Computational Complexity (CCC'07).

[25]  Stasys Jukna,et al.  Boolean Function Complexity Advances and Frontiers , 2012, Bull. EATCS.

[26]  Noga Alon,et al.  Simple construction of almost k-wise independent random variables , 1990, Proceedings [1990] 31st Annual Symposium on Foundations of Computer Science.

[27]  Noga Alon,et al.  A Fast and Simple Randomized Parallel Algorithm for the Maximal Independent Set Problem , 1985, J. Algorithms.

[28]  László Babai,et al.  Trading group theory for randomness , 1985, STOC '85.

[29]  Russell Impagliazzo,et al.  A satisfiability algorithm for AC0 , 2011, SODA.

[30]  Madhur Tulsiani,et al.  Improved Pseudorandom Generators for Depth 2 Circuits , 2010, APPROX-RANDOM.

[31]  Noam Nisan,et al.  Pseudorandom generators for space-bounded computation , 1992, Comb..

[32]  Russell Impagliazzo,et al.  Derandomizing Polynomial Identity Tests Means Proving Circuit Lower Bounds , 2003, STOC '03.

[33]  Clemens Lautemann,et al.  BPP and the Polynomial Hierarchy , 1983, Inf. Process. Lett..

[34]  Noam Nisan,et al.  Pseudorandom bits for constant depth circuits , 1991, Comb..

[35]  Avi Wigderson,et al.  Simplified Derandomization of BPP Using a Hitting Set Generator , 2000, Studies in Complexity and Cryptography.

[36]  Oded Goldreich,et al.  Three XOR-Lemmas - An Exposition , 1995, Electron. Colloquium Comput. Complex..

[37]  Noam Nisan,et al.  Randomness is Linear in Space , 1996, J. Comput. Syst. Sci..

[38]  David Zuckerman Randomness-optimal oblivious sampling , 1997, Random Struct. Algorithms.

[39]  Miklós Ajtai,et al.  ∑11-Formulae on finite structures , 1983, Ann. Pure Appl. Log..

[40]  Noam Nisan Rl <= Sc , 1994, Comput. Complex..

[41]  Russell Impagliazzo,et al.  A satisfiability algorithm for AC0 , 2012, ACM-SIAM Symposium on Discrete Algorithms.

[42]  Manuel Blum,et al.  How to generate cryptographically strong sequences of pseudo random bits , 1982, 23rd Annual Symposium on Foundations of Computer Science (sfcs 1982).

[43]  Andrew Chi-Chih Yao,et al.  Theory and application of trapdoor functions , 1982, 23rd Annual Symposium on Foundations of Computer Science (sfcs 1982).

[44]  Salil P. Vadhan,et al.  Computational Complexity , 2005, Encyclopedia of Cryptography and Security.

[45]  Silvio Micali,et al.  The knowledge complexity of interactive proof-systems , 1985, STOC '85.

[46]  P. Beame A switching lemma primer , 1994 .