On the minimal fourier degree of symmetric Boolean functions

In this paper we give a new upper bound on the minimal degree of a nonzero Fouriercoefficient in any non-linear symmetric Boolean function. Specifically, we prove that forevery non-linear and symmetric $f:\B^{k}\to\B$ there exists a set $\emptyset\neqS\subset[k]$ such that $|S|=O(\Gamma(k)+\sqrt{k})$, and $\hat{f}(S)\neq0$, where$\Gamma(m)\leq m^{0.525}$ is the largest gap between consecutive prime numbers in$\{1,\ldots,m\}$. As an application we obtain a new analysis of the PAC learningalgorithm for symmetric juntas, under the uniform distribution, of Mossel et al. [JCSS,2004]. Namely, we show that the running time of their algorithm is at most$n^{O(k^{0.525})}\cdot\poly(n,2^{k},\log(1/\delta))$ where $n$ is the number ofvariables, $k$ is the size of the junta (i.e. number of relevant variables) and $\delta$is the error probability. In particular, for $k\geq\log(n)^{1/(1-0.525)}\approx\log(n)^{2.1}$ our analysis matches the lower bound $2^k$ (up to polynomial factors).\sloppy Our bound on the degree greatly improves the previous result of Kolountzakis etal. [Combinatorica, 2009] who proved that $|S|=O(k/\log k)$.

[1]  Noam Nisan,et al.  On the degree of boolean functions as real polynomials , 1992, STOC '92.

[2]  Harald Cramér,et al.  On the order of magnitude of the difference between consecutive prime numbers , 1936 .

[3]  Noga Alon,et al.  Simple Construction of Almost k-wise Independent Random Variables , 1992, Random Struct. Algorithms.

[4]  James L. Massey,et al.  A spectral characterization of correlation-immune combining functions , 1988, IEEE Trans. Inf. Theory.

[5]  Avishay Tal,et al.  On the degree of univariate polynomials over the integers , 2012, ITCS '12.

[6]  J. Pintz,et al.  The Difference Between Consecutive Primes , 1996 .

[7]  J. Pintz,et al.  The Difference Between Consecutive Primes, II , 2001 .

[8]  Ryan O'Donnell,et al.  Learning functions of k relevant variables , 2004, J. Comput. Syst. Sci..

[9]  Joachim von zur Gathen,et al.  Polynomials with two values , 1997, Comb..

[10]  Gregory Valiant,et al.  Finding Correlations in Subquadratic Time, with Applications to Learning Parities and Juntas , 2012, 2012 IEEE 53rd Annual Symposium on Foundations of Computer Science.

[11]  Nisheeth K. Vishnoi,et al.  On the Fourier spectrum of symmetric Boolean functions , 2005, 20th Annual IEEE Conference on Computational Complexity (CCC'05).

[12]  Leslie G. Valiant,et al.  A theory of the learnable , 1984, CACM.

[13]  Thomas Siegenthaler,et al.  Correlation-immunity of nonlinear combining functions for cryptographic applications , 1984, IEEE Trans. Inf. Theory.

[14]  Donald E. Knuth,et al.  The Art of Computer Programming: Volume 3: Sorting and Searching , 1998 .

[15]  Pat Langley,et al.  Selection of Relevant Features and Examples in Machine Learning , 1997, Artif. Intell..

[16]  Avrim Blum,et al.  Relevant Examples and Relevant Features: Thoughts from Computational Learning Theory , 1994 .

[17]  Noga Alon,et al.  Simple construction of almost k-wise independent random variables , 1990, Proceedings [1990] 31st Annual Symposium on Foundations of Computer Science.