Degree and Sensitivity: tails of two distributions

The sensitivity of a Boolean function f is the maximum, over all inputs x, of the number of sensitive coordinates of x (namely the number of Hamming neighbors of x with different f-value). The well-known sensitivity conjecture of Nisan (see also Nisan and Szegedy) states that every sensitivity-s Boolean function can be computed by a polynomial over the reals of degree poly(s). The best known upper bounds on degree, however, are exponential rather than polynomial in s. Our main result is an approximate version of the conjecture: every Boolean function with sensitivity s can be e-approximated (in e2) by a polynomial whose degree is s · polylog(1/e). This is the first improvement on the folklore bound of s/e. We prove this via a new "switching lemma for low-sensitivity functions" which establishes that a random restriction of a low-sensitivity function is very likely to have low decision tree depth. This is analogous to the well-known switching lemma for AC0 circuits. Our proof analyzes the combinatorial structure of the graph Gf of sensitive edges of a Boolean function f. Understanding the structure of this graph is of independent interest as a means of understanding Boolean functions. We propose several new complexity measures for Boolean functions based on this graph, including tree sensitivity and component dimension, which may be viewed as relaxations of worst-case sensitivity, and we introduce some new techniques, such as proper walks and shifting, to analyze these measures. We use these notions to show that the graph of a function of full degree must be sufficiently complex, and that random restrictions of low-sensitivity functions are unlikely to lead to such complex graphs. We postulate a robust analogue of the sensitivity conjecture: if most inputs to a Boolean function f have low sensitivity, then most of the Fourier mass of f is concentrated on small subsets. We prove a lower bound on tree sensitivity in terms of decision tree depth, and show that a polynomial strengthening of this lower bound implies the robust conjecture. We feel that studying the graph Gf is interesting in its own right, and we hope that some of the notions and techniques we introduce in this work will be of use in its further study.

[1]  Gábor Tardos,et al.  Query complexity, or why is it difficult to separateNPA∩coNPA fromPA by random oraclesA? , 1989, Comb..

[2]  H. Buhrman,et al.  Complexity measures and decision tree complexity: a survey , 2002, Theor. Comput. Sci..

[3]  Avishay Tal,et al.  Tight bounds on The Fourier Spectrum of AC0 , 2017, Electron. Colloquium Comput. Complex..

[4]  Noam Nisan,et al.  On the degree of boolean functions as real polynomials , 1992, STOC '92.

[5]  G. Kalai,et al.  Every monotone graph property has a sharp threshold , 1996 .

[6]  Rocco A. Servedio,et al.  Learning intersections and thresholds of halfspaces , 2002, The 43rd Annual IEEE Symposium on Foundations of Computer Science, 2002. Proceedings..

[7]  Hans Ulrich Simon A Tight Omega(log log n)-Bound on the Time for Parallel RAM's to Compute Nondegenerated Boolean Functions , 1982, Inf. Control..

[8]  Claire Mathieu,et al.  Sensitivity, block sensitivity, and l-block sensitivity of boolean functions , 2004, Inf. Comput..

[9]  MansourYishay,et al.  Constant depth circuits, Fourier transform, and learnability , 1993 .

[10]  Péter Csikvári,et al.  Graph Homomorphisms between Trees , 2013, Electron. J. Comb..

[11]  Avishay Tal Shrinkage of De Morgan Formulae from Quantum Query Complexity , 2014, Electron. Colloquium Comput. Complex..

[12]  J. Håstad Computational limitations of small-depth circuits , 1987 .

[13]  Juris Hartmanis,et al.  One-Way Functions and the Nonisomorphism of NP-Complete Sets , 1991, Theor. Comput. Sci..

[14]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Alexander Sidorenko A partially ordered set of functionals corresponding to graphs , 1994, Discret. Math..

[16]  Andris Ambainis,et al.  Sensitivity Versus Certificate Complexity of Boolean Functions , 2016, CSR.

[17]  Pavel Pudlák,et al.  Satisfiability Coding Lemma , 1997, Proceedings 38th Annual Symposium on Foundations of Computer Science.

[18]  Andris Ambainis,et al.  A Tight Lower Bound on Certificate Complexity in Terms of Block Sensitivity and Sensitivity , 2014, MFCS.

[19]  Manuel Blum,et al.  Generic oracles and oracle classes , 1987, 28th Annual Symposium on Foundations of Computer Science (sfcs 1987).

[20]  P. Beame A switching lemma primer , 1994 .

[21]  David A. Levin,et al.  Counting Walks and Graph Homomorphisms via Markov Chains and Importance Sampling , 2017, Am. Math. Mon..

[22]  A. Razborov Bounded Arithmetic and Lower Bounds in Boolean Complexity , 1995 .

[23]  Andris Ambainis,et al.  Size of Sets with Small Sensitivity: A Generalization of Simon's Lemma , 2014, TAMC.

[24]  Noam Nisan,et al.  CREW PRAMS and decision trees , 1989, STOC '89.

[25]  Nathan Linial,et al.  The influence of variables on Boolean functions , 1988, [Proceedings 1988] 29th Annual Symposium on Foundations of Computer Science.

[26]  Noam Nisan,et al.  Constant depth circuits, Fourier transform, and learnability , 1989, 30th Annual Symposium on Foundations of Computer Science.

[27]  Satyanarayana V. Lokam,et al.  Upper bounds on Fourier entropy , 2015, Theor. Comput. Sci..

[28]  Noam Nisan CREW PRAMs and Decision Trees , 1991, SIAM J. Comput..

[29]  Andris Ambainis,et al.  Tighter Relations between Sensitivity and Other Complexity Measures , 2014, ICALP.

[30]  Rocco A. Servedio,et al.  Smooth Boolean Functions are Easy: Efficient Algorithms for Low-Sensitivity Functions , 2015, ITCS.

[31]  Ehud Friedgut,et al.  Boolean Functions With Low Average Sensitivity Depend On Few Coordinates , 1998, Comb..

[32]  Noam Nisan,et al.  Constant depth circuits, Fourier transform, and learnability , 1993, JACM.

[33]  Ryan O'Donnell,et al.  The Fourier Entropy-Influence Conjecture for Certain Classes of Boolean Functions , 2011, ICALP.

[34]  Yoshua Bengio,et al.  Scaling learning algorithms towards AI , 2007 .

[35]  Satyanarayana V. Lokam,et al.  Upper Bounds on Fourier Entropy , 2015, COCOON.

[36]  Hans Ulrich Simon A Tight Omega(loglog n)-Bound on the Time for Parallel Ram's to Compute Nondegenerated Boolean Functions , 1983, FCT.