Feedback-optimized parallel tempering Monte Carlo

We introduce an algorithm for systematically improving the efficiency of parallel tempering Monte Carlo simulations by optimizing the simulated temperature set. Our approach is closely related to a recently introduced adaptive algorithm that optimizes the simulated statistical ensemble in generalized broad-histogram Monte Carlo simulations. Conventionally, a temperature set is chosen in such a way that the acceptance rates for replica swaps between adjacent temperatures are independent of the temperature and large enough to ensure frequent swaps. In this paper, we show that by choosing the temperatures with a modified version of the optimized ensemble feedback method we can minimize the round-trip times between the lowest and highest temperatures which effectively increases the efficiency of the parallel tempering algorithm. In particular, the density of temperatures in the optimized temperature set increases at the 'bottlenecks' of the simulation, such as phase transitions. In turn, the acceptance rates are now temperature dependent in the optimized temperature ensemble. We illustrate the feedback-optimized parallel tempering algorithm by studying the two-dimensional Ising ferromagnet and the two-dimensional fully frustrated Ising model, and briefly discuss possible feedback schemes for systems that require configurational averages, such as spin glasses.

[1]  S. Edwards,et al.  Theory of spin glasses , 1975 .

[2]  K. Binder,et al.  Spin glasses: Experimental facts, theoretical concepts, and open questions , 1986 .

[3]  Wang,et al.  Replica Monte Carlo simulation of spin glasses. , 1986, Physical review letters.

[4]  Young,et al.  Numerical studies of Ising spin glasses in two, three, and four dimensions. , 1988, Physical review. B, Condensed matter.

[5]  B. Berg,et al.  Multicanonical algorithms for first order phase transitions , 1991 .

[6]  Berg,et al.  Multicanonical ensemble: A new approach to simulate first-order phase transitions. , 1992, Physical review letters.

[7]  A. Lyubartsev,et al.  New approach to Monte Carlo calculation of the free energy: Method of expanded ensembles , 1992 .

[8]  G. Parisi,et al.  Simulated tempering: a new Monte Carlo scheme , 1992, hep-lat/9205018.

[9]  K. Hukushima,et al.  Exchange Monte Carlo Method and Application to Spin Glass Simulations , 1995, cond-mat/9512035.

[10]  H. Herrmann,et al.  Broad Histogram Method , 1996, cond-mat/9610041.

[11]  G. Parisi,et al.  Phase structure of the three-dimensional Edwards-Anderson spin glass , 1998 .

[12]  D. Landau,et al.  Efficient, multiple-range random walk algorithm to calculate the density of states. , 2000, Physical review letters.

[13]  D. Landau,et al.  Determining the density of states for classical statistical models: a random walk algorithm to produce a flat histogram. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[14]  David A. Kofke,et al.  ARTICLES On the acceptance probability of replica-exchange Monte Carlo trials , 2002 .

[15]  R. Swendsen,et al.  Transition Matrix Monte Carlo Method , 2001, cond-mat/0104418.

[16]  M. Troyer,et al.  Performance limitations of flat-histogram methods. , 2003, Physical review letters.

[17]  D. Huse,et al.  Optimizing the ensemble for equilibration in broad-histogram Monte Carlo simulations. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[18]  C. Predescu,et al.  The incomplete beta function law for parallel tempering sampling of classical canonical systems. , 2003, The Journal of chemical physics.

[19]  M. Troyer,et al.  Dynamics of the Wang–Landau algorithm and complexity of rare events for the three-dimensional bimodal Ising spin glass , 2004, cond-mat/0405409.

[20]  D. Kofke.  Comment on "The incomplete beta function law for parallel tempering sampling of classical canonical systems" [J. Chem. Phys. 120, 4119 (2004)]. , 2004, The Journal of chemical physics.

[21]  Michael W Deem,et al.  Parallel tempering: theory, applications, and new perspectives. , 2005, Physical chemistry chemical physics : PCCP.

[22]  D. Kofke,et al.  Selection of temperature intervals for parallel-tempering simulations. , 2005, The Journal of chemical physics.

[23]  H. Diep.  Frustrated Spin Systems , 2020 .

[24]  J. Lopes,et al.  Analytical study of tunneling times in flat histogram Monte Carlo , 2005, cond-mat/0504698.

[25]  J. D. de Pablo,et al.  Optimal allocation of replicas in parallel tempering simulations. , 2005, The Journal of chemical physics.

[26]  C. Predescu,et al.  On the efficiency of exchange in parallel tempering monte carlo simulations. , 2004, The journal of physical chemistry. B.

[27]  H. Katzgraber,et al.  Detailed study of universality in three-dimensional Ising spin glasses , 2006 .