Effects of setting temperatures in the parallel tempering Monte Carlo algorithm.

Parallel tempering Monte Carlo has proven to be an efficient method in optimization and sampling applications. Having an optimized temperature set enhances the efficiency of the algorithm through more-frequent replica visits to the temperature limits. The approaches for finding an optimal temperature set can be divided into two main categories. The methods of the first category distribute the replicas such that the swapping ratio between neighboring replicas is constant and independent of the temperature values. The second-category techniques including the feedback-optimized method, on the other hand, aim for a temperature distribution that has higher density at simulation bottlenecks, resulting in temperature-dependent replica-exchange probabilities. In this paper, we compare the performance of various temperature setting methods on both sparse and fully connected spin-glass problems as well as fully connected Wishart problems that have planted solutions. These include two classes of problems that have either continuous or discontinuous phase transitions in the order parameter. Our results demonstrate that there is no performance advantage for the methods that promote nonuniform swapping probabilities on spin-glass problems where the order parameter has a smooth transition between phases at the critical temperature. However, on Wishart problems that have a first-order phase transition at low temperatures, the feedback-optimized method exhibits a time-to-solution speedup of at least a factor of two over the other approaches.

[1]  Toshiyuki Miyazawa,et al.  Physics-Inspired Optimization for Quadratic Unconstrained Problems Using a Digital Annealer , 2018, Front. Phys..

[2]  D. Kofke.  Comment on "The incomplete beta function law for parallel tempering sampling of classical canonical systems" [J. Chem. Phys. 120, 4119 (2004)]. , 2004, The Journal of chemical physics.

[3]  Wang,et al.  Replica Monte Carlo simulation of spin glasses. , 1986, Physical review letters.

[4]  D. Huse,et al.  Optimizing the ensemble for equilibration in broad-histogram Monte Carlo simulations. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[5]  Daniel A. Lidar,et al.  Defining and detecting quantum speedup , 2014, Science.

[6]  W. Marsden.  I and J , 2012 .

[7]  R. Spinney,et al.  The incomplete beta function law for parallel tempering sampling of classical canonical systems , 2014 .

[8]  Wenlong Wang,et al.  Comparing Monte Carlo methods for finding ground states of Ising spin glasses: Population annealing, simulated annealing, and parallel tempering. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[9]  C. Predescu,et al.  On the efficiency of exchange in parallel tempering monte carlo simulations. , 2004, The journal of physical chemistry. B.

[10]  Alejandro Perdomo-Ortiz,et al.  Strengths and weaknesses of weak-strong cluster problems: A detailed overview of state-of-the-art classical heuristics versus quantum approaches , 2016, 1604.01746.

[11]  Finding Low-Temperature States With Parallel Tempering, Simulated Annealing And Simple Monte Carlo , 2002, cond-mat/0209248.

[12]  C. E. Fiore,et al.  First-order phase transitions: a study through the parallel tempering method. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[13]  Matthias Troyer,et al.  Feedback-optimized parallel tempering Monte Carlo , 2006, cond-mat/0602085.

[14]  H. Katzgraber.  Introduction to Monte Carlo Methods , 2009, 0905.1629.

[15]  J. D. de Pablo,et al.  Optimal allocation of replicas in parallel tempering simulations. , 2005, The Journal of chemical physics.

[16]  R. Ellis,et al.  Monte Carlo Methods for Rough Free Energy Landscapes: Population Annealing and Parallel Tempering , 2011, 1104.1138.

[17]  S. Kirkpatrick,et al.  Solvable Model of a Spin-Glass , 1975 .

[18]  J Machta,et al.  Strengths and weaknesses of parallel tempering. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[19]  Firas Hamze,et al.  Robust Parameter Selection for Parallel Tempering , 2010 .

[20]  K. Hukushima,et al.  Exchange Monte Carlo Method and Application to Spin Glass Simulations , 1995, cond-mat/9512035.

[21]  K Hukushima.  Domain-wall free energy of spin-glass models: numerical method and boundary conditions. , 1999, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[22]  David J. C. Mackay,et al.  Introduction to Monte Carlo Methods , 1998, Learning in Graphical Models.

[23]  Zheng Zhu,et al.  borealis—A generalized global update algorithm for Boolean optimization problems , 2016, Optimization Letters.

[24]  Frauke Liers,et al.  Partitioning planar graphs: a fast combinatorial approach for max-cut , 2012, Comput. Optim. Appl..

[25]  Michael W Deem,et al.  Parallel tempering: theory, applications, and new perspectives. , 2005, Physical chemistry chemical physics : PCCP.

[26]  F. Liers,et al.  Exact ground states of large two-dimensional planar Ising spin glasses. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[27]  Firas Hamze,et al.  Wishart planted ensemble: A tunably rugged pairwise Ising model with a first-order phase transition. , 2019, Physical review. E.

[28]  M. Steffen.  A simple method for monotonic interpolation in one dimension. , 1990 .

[29]  Gordon M. Barrow,et al.  Physical chemistry for the life sciences , 1974 .