Approximate Inclusion-Exclusion for Arbitrary Symmetric Functions

Let A1, . . . , An be events in a probability space. The approximate inclusion-exclusion problem, due to Linial and Nisan (1990), is to estimate P[A1 ∪ · · · ∪ An] given P[ ⋂ i∈S Ai] for |S | 6 k. Kahn et al. (1996) solved this problem optimally for each k. We study the following more general question: estimate P[ f (A1, . . . , An)] given P[ ⋂ i∈S Ai] for |S | 6 k, where f : {0, 1}n → {0, 1} is a given symmetric function. (In the Linial-Nisan problem, f = OR.) We solve this general problem for every f and k, giving an algorithm that runs in polynomial time and achieves an approximation error that is essentially optimal. We prove this optimal error to be 2−Θ̃(k 2/n) for k above a certain threshold, and Θ(1) otherwise. As part of our solution, we analyze, for every nonconstant symmetric f : {0, 1}n → {0, 1} and every ∈ [2−n, 1/3], the least degree deg ( f ) of a polynomial that approximates f pointwise within . Namely, we show that deg ( f ) = Θ̃ ( deg1/3( f ) + √ n log(1/ ) ) , where deg1/3( f ) is well-known for each f . Previously, the answer for vanishing was known only for f = OR (Kahn et al., 1996; Buhrman et al., 1999). We construct the approximating polynomial explicitly for every f and . Our proof departs considerably from Linial and Nisan (1990) and Kahn et al. (1996). Its key ingredient is a classical result from approximation theory, which gives a certain equivalence of approximation and orthogonality in Euclidean space. Our polynomial constructions feature new uses of Chebyshev polynomials. ∗Department of Computer Sciences, The University of Texas at Austin, TX 78712 USA. Email: sherstov@cs.utexas.edu.

[1]  George G. Lorentz,et al.  Constructive Approximation , 1993, Grundlehren der mathematischen Wissenschaften.

[2]  Yaoyun Shi,et al.  Quantum communication complexity of block-composed functions , 2007, Quantum Inf. Comput..

[3]  A. Razborov Quantum communication complexity of symmetric predicates , 2002, quant-ph/0204025.

[4]  Rocco A. Servedio,et al.  Agnostically learning halfspaces , 2005, 46th Annual IEEE Symposium on Foundations of Computer Science (FOCS'05).

[5]  T. J. Rivlin An Introduction to the Approximation of Functions , 2003 .

[6]  A. Eremenko,et al.  Uniform approximation of sgn x by polynomials and entire functions , 2006, math/0604324.

[7]  Alexander A. Sherstov Separating AC0 from depth-2 majority circuits , 2007, STOC '07.

[8]  Radakovič The theory of approximation , 1932 .

[9]  Tatsuie Tsukiji,et al.  Learning DNF by approximating inclusion-exclusion formulae , 1999, Proceedings. Fourteenth Annual IEEE Conference on Computational Complexity (Formerly: Structure in Complexity Theory Conference) (Cat.No.99CB36317).

[10]  Marvin Minsky,et al.  Perceptrons: expanded edition , 1988 .

[11]  Alexander A. Sherstov The pattern matrix method for lower bounds on quantum communication , 2008, STOC '08.

[12]  Scott Aaronson,et al.  Quantum lower bounds for the collision and the element distinctness problems , 2004, JACM.

[13]  James Aspnes,et al.  The expressive power of voting polynomials , 1991, STOC '91.

[14]  V. Tikhomirov,et al.  DUALITY OF CONVEX FUNCTIONS AND EXTREMUM PROBLEMS , 1968 .

[15]  R. Schapire,et al.  Toward efficient agnostic learning , 1992, COLT '92.

[16]  S. Bernstein Sur la meilleure approximation de |x| par des polynomes de degrés donnés , 1914 .

[17]  Alexander A. Sherstov The unbounded-error communication complexity of symmetric functions , 2008, 2008 49th Annual IEEE Symposium on Foundations of Computer Science.

[18]  Ronald de Wolf,et al.  A note on quantum algorithms and the minimal degree of ε-error polynomials for symmetric functions , 2008, Quantum Inf. Comput..

[19]  Ronald de Wolf,et al.  Bounds for small-error and zero-error quantum algorithms , 1999, 40th Annual Symposium on Foundations of Computer Science (Cat. No.99CB37039).

[20]  Noam Nisan,et al.  Approximate Inclusion-Exclusion , 1990, STOC '90.

[21]  Adam R. Klivans,et al.  Learning DNF in time 2 Õ(n 1/3 ) . , 2001, STOC 2001.

[22]  Alexander A. Sherstov,et al.  A Lower Bound for Agnostically Learning Disjunctions , 2007, COLT.

[23]  Harry Buhrman,et al.  On Computation and Communication with Small Bias , 2007, Twenty-Second Annual IEEE Conference on Computational Complexity (CCC'07).

[24]  Ramamohan Paturi,et al.  On the degree of polynomials that approximate symmetric Boolean functions (preliminary version) , 1992, STOC '92.

[25]  Ronald de Wolf,et al.  Quantum lower bounds by polynomials , 2001, JACM.

[26]  A. S A Discrepancy-Based Proof of Razborov ’ s Quantum Lower Bounds , 2007 .