Improved Bounds on Fourier Entropy and Min-entropy

Given a Boolean function f:{ -1,1} ^{n}→ { -1,1, define the Fourier distribution to be the distribution on subsets of [n], where each S ⊆ [n] is sampled with probability f ˆ (S)2. The Fourier Entropy-influence (FEI) conjecture of Friedgut and Kalai [28] seeks to relate two fundamental measures associated with the Fourier distribution: does there exist a universal constant C > 0 such that H(fˆ2) ≤ C ⋅ Inf (f), where H(fˆ2) is the Shannon entropy of the Fourier distribution of f and Inf(f) is the total influence of f In this article, we present three new contributions toward the FEI conjecture: (1) Our first contribution shows that H(fˆ2) ≤ 2 ⋅ aUC⊕(f), where aUC⊕(f) is the average unambiguous parity-certificate complexity of f. This improves upon several bounds shown by Chakraborty et al. [20]. We further improve this bound for unambiguous DNFs. We also discuss how our work makes Mansour's conjecture for DNFs a natural next step toward resolution of the FEI conjecture.(2) We next consider the weaker Fourier Min-entropy-influence (FMEI) conjecture posed by O'Donnell and others [50, 53], which asks if H ∞ fˆ2) ≤ C ⋅ Inf(f), where H ∞ fˆ2) is the min-entropy of the Fourier distribution. We show H∞(fˆ2) ≤ 2⋅Cmin⊕(f), where Cmin⊕(f) is the minimum parity-certificate complexity of f. We also show that for all ε≥0, we have H∞(fˆ2)≤2 log⁡(∥fˆ∥1,ε/(1−ε)), where ∥fˆ∥1,ε is the approximate spectral norm of f. As a corollary, we verify the FMEI conjecture for the class of read-k DNFs (for constant k).(3) Our third contribution is to better understand implications of the FEI conjecture for the structure of polynomials that 1/3-approximate a Boolean function on the Boolean cube. We pose a conjecture: no flat polynomial(whose non-zero Fourier coefficients have the same magnitude) of degree d and sparsity 2ω(d) can 1/3-approximate a Boolean function. This conjecture is known to be true assuming FEI, and we prove the conjecture unconditionally (i.e., without assuming the FEI conjecture) for a class of polynomials. We discuss an intriguing connection between our conjecture and the constant for the Bohnenblust-Hille inequality, which has been extensively studied in functional analysis.

[1]  Yishay Mansour,et al.  An O(n^(log log n)) Learning Algorithm for DNT under the Uniform Distribution , 1995, J. Comput. Syst. Sci..

[2]  Satyanarayana V. Lokam,et al.  Upper bounds on Fourier entropy , 2015, Theor. Comput. Sci..

[3]  Patrick Traxler,et al.  Variable Influences in Conjunctive Normal Forms , 2009, SAT.

[4]  Omer Reingold,et al.  DNF sparsification and a faster deterministic counting algorithm , 2012, 2012 IEEE 27th Conference on Computational Complexity.

[5]  Mahdi Cheraghchi,et al.  AC0∘MOD2 lower bounds for the Boolean Inner Product , 2018, J. Comput. Syst. Sci..

[6]  A. Montanaro Some applications of hypercontractive inequalities in quantum information theory , 2012, 1208.0161.

[7]  H. F. Bohnenblust,et al.  On the Absolute Convergence of Dirichlet Series , 1931 .

[8]  Emanuele Viola,et al.  Hardness Amplification Proofs Require Majority , 2010, SIAM J. Comput..

[9]  Andreas Defant,et al.  Coordinatewise multiple summing operators in Banach spaces , 2010 .

[10]  Alexander A. Sherstov The Pattern Matrix Method , 2009, SIAM J. Comput..

[11]  Daniel Pellegrino,et al.  IMPROVING THE CONSTANTS FOR THE REAL AND COMPLEX BOHNENBLUST-HILLE INEQUALITY , 2010 .

[12]  Kazuyuki Amano,et al.  Tight Bounds on the Average Sensitivity of k-CNF , 2011, Theory Comput..

[13]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[14]  Alexander A. Sherstov Algorithmic polynomials , 2018, Electron. Colloquium Comput. Complex..

[15]  Ryan O'Donnell,et al.  Analysis of Boolean Functions , 2014, ArXiv.

[16]  J. Bourgain,et al.  Influences of Variables and Threshold Intervals under Group Symmetries , 1997 .

[17]  Shengyu Zhang Efficient quantum protocols for XOR functions , 2014, SODA.

[18]  Yaoyun Shi Lower bounds of quantum black-box complexity and degree of approximating polynomials by influence of Boolean variables , 2000, Inf. Process. Lett..

[19]  N. Alon,et al.  The Probabilistic Method, Second Edition , 2000 .

[20]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[21]  Alon Orlitsky,et al.  A Spectral Lower Bound Techniqye for the Size of Decision Trees and Two Level AND/OR Circuits , 1990, IEEE Trans. Computers.

[22]  Kristian Seip,et al.  The Bohnenblust-Hille inequality for homogeneous polynomials is hypercontractive , 2009, 0904.3540.

[23]  Noam Nisan,et al.  Constant depth circuits, Fourier transform, and learnability , 1993, JACM.

[24]  The Bohr radius of the $n$-dimensional polydisk is equivalent to $\sqrt{\frac{\log n}{n}} , 2013, 1310.2834.

[25]  J. Littlewood ON BOUNDED BILINEAR FORMS IN AN INFINITE NUMBER OF VARIABLES , 1930 .

[26]  Troy Lee,et al.  Lower Bounds in Communication Complexity , 2009, Found. Trends Theor. Comput. Sci..

[27]  D. Pellegrino,et al.  Sharp generalizations of the multilinear Bohnenblust--Hille inequality , 2013, 1306.3362.

[28]  Elchanan Mossel,et al.  A note on the Entropy/Influence conjecture , 2012, Discret. Math..

[29]  Ronald de Wolf,et al.  Quantum lower bounds by polynomials , 2001, JACM.

[30]  L. Gross LOGARITHMIC SOBOLEV INEQUALITIES. , 1975 .

[31]  Troy Lee,et al.  Multipartite entanglement in XOR games , 2013, Quantum Inf. Comput..

[32]  Ronald de Wolf,et al.  A Brief Introduction to Fourier Analysis on the Boolean Cube , 2008, Theory Comput..

[33]  Daniel Pellegrino,et al.  Towards sharp Bohnenblust--Hille constants , 2016, 1604.07595.