Complexity of Hard-Core Set Proofs

We study a fundamental result of Impagliazzo (FOCS’95) known as the hard-core set lemma. Consider any function $${f:\{0,1\}^n\to\{0,1\}}$$ which is “mildly hard”, in the sense that any circuit of size s must disagree with f on at least a δ fraction of inputs. Then, the hard-core set lemma says that f must have a hard-core set H of density δ on which it is “extremely hard”, in the sense that any circuit of size $${s'=O(s/(\frac{1}{\epsilon^2}\log(\frac{1}{\epsilon\delta})))}$$ must disagree with f on at least $${(1-\epsilon)/2}$$ fraction of inputs from H.There are three issues of the lemma which we would like to address: the loss of circuit size, the need of non-uniformity, and its inapplicability to a low-level complexity class. We introduce two models of hard-core set proofs, a strongly black-box one and a weakly black-box one, and show that those issues are unavoidable in such models.First, we show that using any strongly black-box proof, one can only prove the hardness of a hard-core set for smaller circuits of size at most $${s'=O(s/(\frac{1}{\epsilon^2}\log\frac{1}{\delta}))}$$ . Next, we show that any weakly black-box proof must be inherently non-uniform—to have a hard-core set for a class G of functions, we need to start from the assumption that f is hard against a non-uniform complexity class with $${\Omega(\frac{1}{\epsilon}\log|G|)}$$ bits of advice. Finally, we show that weakly black-box proofs in general cannot be realized in a low-level complexity class such as AC0[p]—the assumption that f is hard for AC0[p] is not sufficient to guarantee the existence of a hard-core set.

[1]  Luca Trevisan,et al.  Pseudorandom generators without the XOR lemma , 1999, Proceedings. Fourteenth Annual IEEE Conference on Computational Complexity (Formerly: Structure in Complexity Theory Conference) (Cat.No.99CB36317).

[2]  Jun Tarui Degree complexity of Boolean functions and its applications to relativized separations , 1991, [1991] Proceedings of the Sixth Annual Structure in Complexity Theory Conference.

[3]  Boaz Barak,et al.  The uniform hardcore lemma via approximate Bregman projections , 2009, SODA.

[4]  Alexander A. Razborov,et al.  Majority gates vs. general weighted threshold gates , 2005, computational complexity.

[5]  Roman Smolensky,et al.  Algebraic methods in the theory of lower bounds for Boolean circuit complexity , 1987, STOC.

[6]  Y. Freund Boosting a Weak Learning Algorithm by Majority to Be Published in Information and Computation , 1995 .

[7]  Emanuele Viola,et al.  Using Nondeterminism to Amplify Hardness , 2006, SIAM J. Comput..

[8]  Emanuele Viola,et al.  Using nondeterminism to amplify hardness , 2004, STOC '04.

[9]  Alexander A. Razborov,et al.  Majority gates vs. general weighted threshold gates , 1992, [1992] Proceedings of the Seventh Annual Structure in Complexity Theory Conference.

[10]  L. Moser,et al.  AN EXTREMAL PROBLEM IN GRAPH THEORY , 2001 .

[11]  Ryan O'Donnell,et al.  Hardness amplification within NP , 2002, STOC '02.

[12]  S. Vadhan,et al.  The complexity of hardness amplification and derandomization , 2006 .

[13]  Rocco A. Servedio,et al.  Boosting and Hard-Core Set Construction , 2003, Machine Learning.

[14]  Ryan O'Donnell,et al.  Hardness amplification within NP , 2002, Proceedings 17th IEEE Annual Conference on Computational Complexity.

[15]  Chi-Jen Lu,et al.  On the Complexity of Hard-Core Set Constructions , 2007, ICALP.

[16]  Noam Nisan,et al.  BPP has subexponential time simulations unless EXPTIME has publishable proofs , 1991, [1991] Proceedings of the Sixth Annual Structure in Complexity Theory Conference.

[17]  P. Erdös On an extremal problem in graph theory , 1970 .

[18]  Luca Trevisan,et al.  List-decoding using the XOR lemma , 2003, 44th Annual IEEE Symposium on Foundations of Computer Science, 2003. Proceedings..

[19]  Avi Wigderson,et al.  P = BPP if E requires exponential circuits: derandomizing the XOR lemma , 1997, STOC '97.

[20]  Thomas Holenstein,et al.  Key agreement from weak bit agreement , 2005, STOC '05.

[21]  Chi-Jen Lu,et al.  On the Complexity of Hardness Amplification , 2005, IEEE Transactions on Information Theory.

[22]  Andrew Chi-Chih Yao,et al.  Theory and application of trapdoor functions , 1982, 23rd Annual Symposium on Foundations of Computer Science (sfcs 1982).

[23]  G. Pisier Remarques sur un résultat non publié de B. Maurey , 1981 .

[24]  Emanuele Viola,et al.  Hardness amplification proofs require majority , 2008, SIAM J. Comput..

[25]  Yoav Freund,et al.  Boosting a weak learning algorithm by majority , 1995, COLT '90.

[26]  Luca Trevisan,et al.  On uniform amplification of hardness in NP , 2005, STOC '05.

[27]  Noga Alon,et al.  The Probabilistic Method , 2015, Fundamentals of Ramsey Theory.

[28]  Russell Impagliazzo,et al.  Hard-core distributions for somewhat hard problems , 1995, Proceedings of IEEE 36th Annual Foundations of Computer Science.

[29]  Pavel Pudlák,et al.  Threshold circuits of bounded depth , 1987, 28th Annual Symposium on Foundations of Computer Science (sfcs 1987).