Stein’s method for stationary distributions of Markov chains and application to Ising models

We develop a new technique, based on Stein's method, for comparing two stationary distributions of irreducible Markov Chains whose update rules are `close enough'. We apply this technique to compare Ising models on $d$-regular expander graphs to the Curie-Weiss model (complete graph) in terms of pairwise correlations and more generally $k$th order moments. Concretely, we show that $d$-regular Ramanujan graphs approximate the $k$th order moments of the Curie-Weiss model to within average error $k/\sqrt{d}$ (averaged over the size $k$ subsets). The result applies even in the low-temperature regime; we also derive some simpler approximation results for functionals of Ising models that hold only at high enough temperatures.

[1]  E. Ising Beitrag zur Theorie des Ferromagnetismus , 1925 .

[2]  S. Brush History of the Lenz-Ising Model , 1967 .

[3]  Robert B. Griffiths,et al.  Correlations in Ising Ferromagnets. I , 1967 .

[4]  R. Dobrushin Prescribing a System of Random Variables by Conditional Distributions , 1970 .

[5]  C. Stein A bound for the error in the normal approximation to the distribution of a sum of dependent random variables , 1972 .

[6]  Louis H. Y. Chen Poisson Approximation for Dependent Trials , 1975 .

[7]  R. Holley,et al.  Rapid Convergence to Equilibrium of Stochastic Ising Models in the Dobrushin Shlosman Regime , 1987 .

[8]  Hans-Otto Georgii,et al.  Gibbs Measures and Phase Transitions , 1988 .

[9]  D. Greig,et al.  Exact Maximum A Posteriori Estimation for Binary Images , 1989 .

[10]  A. Nilli On the second eigenvalue of a graph , 1991 .

[11]  A. Shwartz,et al.  Handbook of Markov decision processes : methods and applications , 2002 .

[12]  Joel Friedman,et al.  A proof of Alon's second eigenvalue conjecture and related problems , 2004, ArXiv.

[13]  S. Chatterjee Concentration Inequalities With Exchangeable Pairs , 2005 .

[14]  Michael J. Berry,et al.  Weak pairwise correlations imply strongly correlated network states in a neural population , 2005, Nature.

[15]  Thomas P. Hayes A simple condition implying rapid mixing of single-site dynamics on spin systems , 2006, 2006 47th Annual IEEE Symposium on Foundations of Computer Science (FOCS'06).

[16]  Jason Fulman,et al.  Exponential Approximation by Stein's Method and Spectral Graph Theory , 2006 .

[17]  Y. Peres,et al.  Glauber dynamics for the mean-field Ising model: cut-off, critical power law, and metastability , 2007, 0712.0790.

[18]  Elizabeth L. Wilmer,et al.  Markov Chains and Mixing Times , 2008 .

[19]  Alexandre d'Aspremont,et al.  Model Selection Through Sparse Max Likelihood Estimation Model Selection Through Sparse Maximum Likelihood Estimation for Multivariate Gaussian or Binary Data , 2022 .

[20]  Michael I. Jordan,et al.  Graphical Models, Exponential Families, and Variational Inference , 2008, Found. Trends Mach. Learn..

[21]  Jian Ding,et al.  Censored Glauber Dynamics for the Mean Field Ising Model , 2008, 0812.0633.

[22]  Allan Sly,et al.  Computational Transition at the Uniqueness Threshold , 2010, 2010 IEEE 51st Annual Symposium on Foundations of Computer Science.

[23]  Shang-Hua Teng,et al.  Spectral Sparsification of Graphs , 2008, SIAM J. Comput..

[24]  Nathan Ross Fundamentals of Stein's method , 2011, 1109.1880.

[25]  A. Si,et al.  Entropy,Large Deviations,and Statistical Mechanics , 2011 .

[26]  Exponential approximation and Stein's method of exchangeable pairs , 2012, 1207.5073.

[27]  Shang-Hua Teng,et al.  Spectral sparsification of graphs: theory and algorithms , 2013, CACM.

[28]  G. Reinert,et al.  Stein's Method for the Beta Distribution and the Pólya-Eggenberger Urn , 2013, Journal of Applied Probability.

[29]  Stein's method of exchangeable pairs for the Beta distribution and generalizations , 2014 .

[30]  Guy Bresler,et al.  Learning a Tree-Structured Ising Model in Order to Make Predictions , 2016, The Annals of Statistics.

[31]  Y. Peres,et al.  Concentration inequalities for polynomials of contracting Ising models , 2017, 1706.00121.

[32]  Constantinos Daskalakis,et al.  Concentration of Multilinear Functions of the Ising Model with Applications to Network Data , 2017, NIPS.

[33]  Guy Bresler,et al.  Optimal Single Sample Tests for Structured versus Unstructured Network Data , 2018, COLT.

[34]  Constantinos Daskalakis,et al.  Testing Ising Models , 2016, IEEE Transactions on Information Theory.

[35]  G. Reinert,et al.  Approximating stationary distributions of fast mixing Glauber dynamics, with applications to exponential random graphs , 2017, The Annals of Applied Probability.