Remarks on the Most Informative Function Conjecture at fixed mean

In 2013, Courtade and Kumar posed the following problem: Let $\boldsymbol{x} \sim \{\pm 1\}^n$ be uniformly random, and form $\boldsymbol{y} \sim \{\pm 1\}^n$ by negating each bit of $\boldsymbol{x}$ independently with probability $\alpha$. Is it true that the mutual information $I(f(\boldsymbol{x}) \mathbin{;} \boldsymbol{y})$ is maximized among $f:\{\pm 1\}^n \to \{\pm 1\}$ by $f(x) = x_1$? We do not resolve this problem. Instead, we make a couple of observations about the fixed-mean version of the conjecture. We show that Courtade and Kumar's stronger Lex Conjecture fails for small noise rates. We also prove a continuous version of the conjecture on the sphere and show that it implies the previously-known analogue for Gaussian space.

[1]  Martin Bossert,et al.  Canalizing Boolean Functions Maximize Mutual Information , 2012, IEEE Transactions on Information Theory.

[2]  E. Carlen,et al.  Extremals of functionals with competing symmetries , 1990 .

[3]  J.-M. Goethals,et al.  IEEE international symposium on information theory , 1981 .

[4]  M. Ziegler Volume 152 of Graduate Texts in Mathematics , 1995 .

[5]  Muriel Médard,et al.  An exploration of the role of principal inertia components in information theory , 2014, 2014 IEEE Information Theory Workshop (ITW 2014).

[6]  T. Sanders,et al.  Analysis of Boolean Functions , 2012, ArXiv.

[7]  R. Lathe Phd by thesis , 1988, Nature.

[8]  Thomas A. Courtade,et al.  Which Boolean Functions Maximize Mutual Information on Noisy Inputs? , 2014, IEEE Transactions on Information Theory.

[9]  Venkat Anantharam,et al.  On hypercontractivity and the mutual information between Boolean functions , 2013, 2013 51st Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[10]  Elza Erkip,et al.  The Efficiency of Investment Information , 1998, IEEE Trans. Inf. Theory.

[11]  Philip D. Plowright,et al.  Convexity , 2019, Optimization for Chemical and Biochemical Engineering.

[12]  Ken R. Duffy,et al.  Bounds on inference , 2013, 2013 51st Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[13]  W. Beckner Sobolev inequalities, the Poisson semigroup, and analysis on the sphere Sn. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[14]  C. Borell Geometric bounds on the Ornstein-Uhlenbeck velocity process , 1985 .

[15]  B. A. Taylor,et al.  Spherical rearrangements, subharmonic functions, and $\ast$-functions in $n$-space , 1976 .

[16]  C. Daub,et al.  BMC Systems Biology , 2007 .

[17]  E. Beckenbach,et al.  On subharmonic functions , 1935 .

[18]  V. Chandar,et al.  Most Informative Quantization Functions , 2014 .

[19]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .