Decision Trees and Influences of Variables Over Product Probability Spaces

A celebrated theorem of Friedgut says that every function f : {0, 1}n → {0, 1} can be approximated by a function g : {0, 1}n → {0, 1} with $\|f-g\|_2^2 \leq \epsilon$, which depends only on eO(If / ε) variables, where If is the sum of the influences of the variables of f. Dinur and Friedgut later showed that this statement also holds if we replace the discrete domain {0, 1}n with the continuous domain [0, 1]n, under the extra assumption that f is increasing. They conjectured that the condition of monotonicity is unnecessary and can be removed. We show that certain constant-depth decision trees provide counter-examples to the Dinur–Friedgut conjecture. This suggests a reformulation of the conjecture in which the function g : [0, 1]n → {0, 1}, instead of depending on a small number of variables, has a decision tree of small depth. In fact we prove this reformulation by showing that the depth of the decision tree of g can be bounded by eO(If / ε2). Furthermore, we consider a second notion of the influence of a variable, and study the functions that have bounded total influence in this sense. We use a theorem of Bourgain to show that these functions have certain properties. We also study the relation between the two different notions of influence.

[1]  N. Linial,et al.  The influence of variables in product spaces , 1992 .

[2]  A. Bonami Étude des coefficients de Fourier des fonctions de $L^p(G)$ , 1970 .

[3]  Subhash Khot,et al.  Vertex cover might be hard to approximate to within 2-/spl epsiv/ , 2003, 18th IEEE Annual Conference on Computational Complexity, 2003. Proceedings..

[4]  Ryan O'Donnell,et al.  Every decision tree has an influential variable , 2005, 46th Annual IEEE Symposium on Foundations of Computer Science (FOCS'05).

[5]  B. M. Fulk MATH , 1992 .

[6]  P. Steerenberg,et al.  Targeting pathophysiological rhythms: prednisone chronotherapy shows sustained efficacy in rheumatoid arthritis. , 2010, Annals of the rheumatic diseases.

[7]  Nathan Linial,et al.  The influence of variables on Boolean functions , 1988, [Proceedings 1988] 29th Annual Symposium on Foundations of Computer Science.

[8]  M. Talagrand Isoperimetry and Integrability of the Sum of Independent Banach-Space Valued Random Variables , 1989 .

[9]  E. Friedgut,et al.  Sharp thresholds of graph properties, and the -sat problem , 1999 .

[10]  Ericka Stricklin-Parker,et al.  Ann , 2005 .

[11]  Ehud Friedgut,et al.  Boolean Functions With Low Average Sensitivity Depend On Few Coordinates , 1998, Comb..

[12]  Ehud Friedgut,et al.  Influences in Product Spaces: KKL and BKKKL Revisited , 2004, Combinatorics, Probability and Computing.

[13]  W. Beckner Inequalities in Fourier analysis , 1975 .

[14]  M. Talagrand On Russo's Approximate Zero-One Law , 1994 .

[15]  S. Safra,et al.  On the hardness of approximating minimum vertex cover , 2005 .

[16]  Hamed Hatami,et al.  A remark on Bourgain's distributional inequality on the Fourier spectrum of Boolean functions , 2006 .

[17]  J. Bourgain On the distribution of the fourier spectrum of Boolean functions , 2002 .

[18]  G. Kalai,et al.  Every monotone graph property has a sharp threshold , 1996 .

[19]  Assaf Naor,et al.  Boolean functions whose Fourier transform is concentrated on the first two levels , 2002, Adv. Appl. Math..

[20]  Noam Nisan,et al.  Constant depth circuits, Fourier transform, and learnability , 1989, 30th Annual Symposium on Foundations of Computer Science.

[21]  L. Russo On the critical percolation probabilities , 1981 .

[22]  Ryan O'Donnell,et al.  Learning monotone decision trees in polynomial time , 2006, 21st Annual IEEE Conference on Computational Complexity (CCC'06).