On the Structure of Boolean Functions with Small Spectral Norm

AbstractIn this paper we prove results regarding Boolean functions with small spectral norm (the spectral norm of f is $${\|\hat{f}\|_1 = \sum_{\alpha}|\hat{f}(\alpha)|}$$‖f^‖1=∑α|f^(α)|). Specifically, we prove the following results for functions $${f : \{0, 1\}^n \to \{0, 1\}}$$f:{0,1}n→{0,1} with $${\|\hat{f}\|_1 = A}$$‖f^‖1=A. 1.There is an affine subspace V of co-dimension at most A2 such that $${f|_V}$$f|V is constant.2.f can be computed by a parity decision tree of size at most $${2^{A^2} n^{2A}}$$2A2n2A. (A parity decision tree is a decision tree whose nodes are labeled with arbitrary linear functions.) 3.f can be computed by a De Morgan formula of size $${O(2^{A^2} n^{2A + 2})}$$O(2A2n2A+2) and by a De Morgan formula of depth $${O(A^2 + \log(n) \cdot A)}$$O(A2+log(n)·A).4.If in addition f has at most s nonzero Fourier coefficients, then f can be computed by a parity decision tree of depth at most $${A^2 \log s}$$A2logs.5.For every $${\epsilon > 0}$$ϵ>0 there is a parity decision tree of depth $${O(A^2 + \log(1/\epsilon))}$$O(A2+log(1/ϵ)) and size $${2^{O(A^2)} \cdot \min \{1/\epsilon^2, \log(1/\epsilon)^{2A}\}}$$2O(A2)·min{1/ϵ2,log(1/ϵ)2A} that $${\epsilon}$$ϵ-approximates f. Furthermore, this tree can be learned (in the uniform distribution model), with probability $${1 - \delta}$$1-δ, using $${{\tt poly}(n, {\rm exp}(A^2), 1/\epsilon, \log(1/\delta))}$$poly(n,exp(A2),1/ϵ,log(1/δ)) membership queries. All the results above (except 3) also hold (with a slight change in parameters) for functions $${f : \mathbb{Z}_p^n \to \{0, 1\}}$$f:Zpn→{0,1}.

[1]  Ehud Friedgut,et al.  Boolean Functions With Low Average Sensitivity Depend On Few Coordinates , 1998, Comb..

[2]  Noam Nisan,et al.  Constant depth circuits, Fourier transform, and learnability , 1993, JACM.

[3]  T. Sanders,et al.  Boolean Functions with small Spectral Norm , 2006, math/0605524.

[4]  Shachar Lovett,et al.  Communication is bounded by root of rank , 2013, STOC.

[5]  Ryan O'Donnell,et al.  Analysis of Boolean Functions , 2014, ArXiv.

[6]  Mihir Bellare,et al.  Linearity testing in characteristic two , 1995, Proceedings of IEEE 36th Annual Foundations of Computer Science.

[7]  Shengyu Zhang,et al.  Fourier Sparsity, Spectral Norm, and the Log-Rank Conjecture , 2013, 2013 IEEE 54th Annual Symposium on Foundations of Computer Science.

[8]  Ryan O'Donnell,et al.  Testing Fourier Dimensionality and Sparsity , 2009, ICALP.

[9]  H. Buhrman,et al.  Complexity measures and decision tree complexity: a survey , 2002, Theor. Comput. Sci..

[10]  Leonid A. Levin,et al.  A hard-core predicate for all one-way functions , 1989, STOC '89.

[11]  T. Sanders,et al.  A quantitative version of the idempotent theorem in harmonic analysis , 2006, math/0611286.

[12]  Gil Kalai,et al.  A Fourier-theoretic perspective on the Condorcet paradox and Arrow's theorem , 2002, Adv. Appl. Math..

[13]  Ashley Montanaro,et al.  On the communication complexity of XOR functions , 2009, ArXiv.

[14]  Eyal Kushilevitz,et al.  Learning decision trees using the Fourier spectrum , 1991, STOC '91.

[15]  Mark Braverman,et al.  The complexity of properly learning simple concept classes , 2008, J. Comput. Syst. Sci..

[16]  Manuel Blum,et al.  Self-testing/correcting with applications to numerical problems , 1990, STOC '90.

[17]  Nathan Linial,et al.  The influence of variables on Boolean functions , 1988, [Proceedings 1988] 29th Annual Symposium on Foundations of Computer Science.

[18]  Mihir Bellare A technique for upper bounding the spectral norm with applications to learning , 1992, COLT '92.

[19]  Zhiqiang Zhang,et al.  On the parity complexity measures of Boolean functions , 2010, Theor. Comput. Sci..

[20]  Johan Håstad,et al.  Some optimal inapproximability results , 2001, JACM.

[21]  Amir Shpilka,et al.  On the structure of boolean functions with small spectral norm , 2013, Electron. Colloquium Comput. Complex..

[22]  Yishay Mansour,et al.  Learning Boolean Functions via the Fourier Transform , 1994 .

[23]  Vince Grolmusz On the Power of Circuits with Gates of Low L1 Norms , 1997, Theor. Comput. Sci..