Information flow on trees

Consider a tree network $T$, where each edge acts as an independent copy of a given channel $M$, and information is propagated from the root. For which $T$ and $M$ does the configuration obtained at level $n$ of $T$ typically contain significant information on the root variable? This problem arose independently in biology, information theory and statistical physics. For all $b$, we construct a channel for which the variable at the root of the $b$-ary tree is independent of the configuration at level 2 of that tree, yet for sufficiently large $B>b$, the mutual information between the configuration at level $n$ of the $B$-ary tree and the root variable is bounded away from zero. This is related to certain secret-sharing protocols. We improve the upper bounds on information flow for asymmetric binary channels (which correspond to the Ising model with an external field) and for symmetric $q$-ary channels (which correspond to Potts models). Let $\lam_2(M)$ denote the second largest eigenvalue of $M$, in absolute value. A CLT of Kesten and Stigum~(1966) implies that if $b |\lam_2(M)|^2 >1$, then the {\em census} of the variables at any level of the $b$-ary tree, contains significant information on the root variable. We establish a converse: if $b |\lam_2(M)|^2 < 1$, then the census of the variables at level $n$ of the $b$-ary tree is asymptotically independent of the root variable. This contrasts with examples where $b |\lam_2(M)|^2 <1$, yet the {\em configuration} at level $n$ is not asymptotically independent of the root variable.

[1]  Irving S. Reed,et al.  A class of multiple-error-correcting codes and the decoding scheme , 1954, Trans. IRE Prof. Group Inf. Theory.

[2]  H. Kesten,et al.  Additional Limit Theorems for Indecomposable Multidimensional Galton-Watson Processes , 1966 .

[3]  H. Kesten,et al.  Limit theorems for decomposable multi-dimensional Galton-Watson processes , 1967 .

[4]  W. Fitch Toward Defining the Course of Evolution: Minimum Change for a Specific Tree Topology , 1971 .

[5]  F. Spitzer Markov Random Fields on an Infinite Tree , 1975 .

[6]  Y. Higuchi Remarks on the Limiting GIbbs States on a (d+1)-Tree , 1977 .

[7]  J. A. Cavender Taxonomy with confidence , 1978 .

[8]  Adi Shamir,et al.  How to share a secret , 1979, CACM.

[9]  J. Laurie Snell,et al.  Random Walks and Electrical Networks , 1984 .

[10]  R. Lyons Random Walks and Percolation on Trees , 1990 .

[11]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[12]  Russell Lyons,et al.  Random walk in a random environment and rst-passage percolation on trees , 1992 .

[13]  J. Ruiz,et al.  On the purity of the limiting gibbs state for the Ising model on the Bethe lattice , 1995 .

[14]  D. Ioffe On the extremality of the disordered state for the Ising model on the Bethe lattice , 1996 .

[15]  Peter Winkler,et al.  Mixing times , 1997, Microsurveys in Discrete Probability.

[16]  Amir Dembo,et al.  Large Deviations Techniques and Applications , 1998 .

[17]  Elchanan Mossel Recursive reconstruction on periodic trees , 1998 .

[18]  William S. Evans,et al.  On the Maximum Tolerable Noise for Reliable Computation by Formulas , 1998, IEEE Trans. Inf. Theory.

[19]  Graham R. Brightwell,et al.  Graph Homomorphisms and Phase Transitions , 1999, J. Comb. Theory, Ser. B.

[20]  Robin Pemantle,et al.  Robust Phase Transitions for Heisenberg and other Models on General Trees , 1999 .

[21]  Y. Peres,et al.  Broadcasting on trees and the Ising model , 2000 .

[22]  Peter Winkler,et al.  Gibbs Measures and Dismantlable Graphs , 2000, J. Comb. Theory, Ser. B.

[23]  Yuval Peres,et al.  Glauber dynamics on trees and hyperbolic graphs , 2001, Proceedings 2001 IEEE International Conference on Cluster Computing.

[24]  Elchanan Mossel Reconstruction on Trees: Beating the Second Eigenvalue , 2001 .

[25]  Elchanan Mossel,et al.  Glauber dynamics on trees and hyperbolic graphs , 2001, Proceedings 2001 IEEE International Conference on Cluster Computing.

[26]  G. Brightwell,et al.  Random colorings of a cayley tree , 2002 .