Simulating Ising and Potts models at critical and cold temperatures using auxiliary Gaussian variables

Ising and Potts models are an important class of discrete probability distributions which originated from Statistical Physics and since then have found applications in several disciplines. Simulation from these models is a well known challenging problem. In this paper, we propose a class of MCMC algorithms to simulate from both Ising and Potts models, by using auxiliary Gaussian random variables. Our algorithms apply to coupling matrices with both positive and negative entries, thus including Spin Glass models such as the SK and Hopfield model. In contrast to existing methods of a similar flavor, our algorithm can take advantage of the low-rank structure of the coupling matrix, and scales linearly with the number of states in a Potts model. We compare our proposed algorithm to existing state of the art algorithms, such as the Swendsen-Wang and Wolff algorithms for Ising and Potts models on graphs, and the Heat Bath for Spin Glass models. Our comparison takes into account a wide range of coupling matrices and temperature regimes, focusing in particular on behavior at or below the critical temperature. For cold systems, augmenting our algorithm with a tempering scheme yields significant improvements.

[1]  Radford M. Neal Probabilistic Inference Using Markov Chain Monte Carlo Methods , 2011 .

[2]  David Duvenaud,et al.  Oops I Took A Gradient: Scalable Sampling for Discrete Distributions , 2021, ICML.

[3]  S. Mukherjee,et al.  Global testing against sparse alternatives under Ising models , 2016, The Annals of Statistics.

[4]  E. Ising Beitrag zur Theorie des Ferromagnetismus , 1925 .

[5]  Hajime Yoshino,et al.  Exchange Monte Carlo Dynamics in the SK Model , 1998 .

[6]  Wang,et al.  Nonuniversal critical dynamics in Monte Carlo simulations. , 1987, Physical review letters.

[7]  Yichuan Zhang,et al.  Continuous Relaxations for Discrete Hamiltonian Monte Carlo , 2012, NIPS.

[8]  K. Binder,et al.  A Guide to Monte Carlo Simulations in Statistical Physics: Monte Carlo studies of biological molecules , 2009 .

[9]  R. B. Potts Some generalized order-disorder transformations , 1952, Mathematical Proceedings of the Cambridge Philosophical Society.

[10]  K. Hukushima,et al.  Exchange Monte Carlo Method and Application to Spin Glass Simulations , 1995, cond-mat/9512035.

[11]  Wolff,et al.  Collective Monte Carlo updating for spin systems. , 1989, Physical review letters.

[12]  Ilya Sutskever,et al.  Parallelizable Sampling of Markov Random Fields , 2010, AISTATS.

[13]  Wang,et al.  Replica Monte Carlo simulation of spin glasses. , 1986, Physical review letters.

[14]  B. Yucesoy Replica exchange Monte Carlo simulations of the ising spin glass: Static and dynamic properties , 2013 .

[15]  G. Grimmett,et al.  The random-cluster model on the complete graph , 1996 .

[16]  Nicolai Schipper Jespersen,et al.  An Introduction to Markov Chain Monte Carlo , 2010 .

[17]  Alan M. Ferrenberg,et al.  Pushing the Limits of Monte Carlo Simulations for the 3d Ising Model , 2017 .

[18]  Paul Cuff,et al.  Glauber Dynamics for the Mean-Field Potts Model , 2012, 1204.4503.

[19]  A. Gelman,et al.  Rank-normalization, folding, and localization: An improved R-hat for assessing convergence Rank-Normalization, Folding, and Localization: An Improved (cid:2) R for Assessing Convergence of MCMC An assessing for assessing An improved (cid:2) R for assessing convergence of MCMC , 2020 .

[20]  H. Katzgraber,et al.  Monte Carlo simulations of spin glasses at low temperatures , 2000, cond-mat/0007113.