A multi-GPU approach for the exchange Monte Carlo method

We present an efficient multi-GPU approach for the Exchange Monte Carlo method designed for the simulation of disordered spin systems. Parallel computation is organized using a two-level scheme, allowing the algorithm to scale its performance in the presence of faster GPUs as well as multiple GPUs. Performance results show that spin-level performance is between one and two orders of magnitude faster than a sequential CPU implementation and ≈ 7 times faster than a parallel multi-core CPU implementation running on 16 cores. Multi-GPU performance scales with almost 99% of efficiency when using two GPUs at size L = 256.

[1]  N Prokof'ev,et al.  Worm algorithms for classical statistical models. , 2001, Physical review letters.

[2]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[3]  Glazier,et al.  Simulation of biological cell sorting using a two-dimensional extended Potts model. , 1992, Physical review letters.

[4]  Gonzalo Navarro,et al.  Parallel family trees for transfer matrices in the Potts model , 2013, Comput. Phys. Commun..

[5]  Wolff,et al.  Collective Monte Carlo updating for spin systems. , 1989, Physical review letters.

[6]  Florent Krzakala,et al.  Phase Transitions in the Coloring of Random Graphs , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[7]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[8]  J. Ramanujam,et al.  Parallel tempering simulation of the three-dimensional Edwards-Anderson model with compact asynchronous multispin coding on GPU , 2013, Comput. Phys. Commun..

[9]  Nancy Hitschfeld-Kahler,et al.  A Survey on Parallel Computing and its Applications in Data-Parallel Problems Using GPU Architectures , 2014 .

[10]  Wang,et al.  Nonuniversal critical dynamics in Monte Carlo simulations. , 1987, Physical review letters.

[11]  Wang,et al.  Replica Monte Carlo simulation of spin glasses. , 1986, Physical review letters.

[12]  Martin Weigel,et al.  Performance potential for simulating spin models on GPU , 2010, J. Comput. Phys..

[13]  K. Hukushima,et al.  Exchange Monte Carlo Method and Application to Spin Glass Simulations , 1995, cond-mat/9512035.

[14]  Nancy Hitschfeld-Kahler,et al.  GPU Maps for the Space of Computation in Triangular Domain Problems , 2014, 2014 IEEE Intl Conf on High Performance Computing and Communications, 2014 IEEE 6th Intl Symp on Cyberspace Safety and Security, 2014 IEEE 11th Intl Conf on Embedded Software and Syst (HPCC,CSS,ICESS).

[15]  Cristopher Moore,et al.  Asymptotic analysis of the stochastic block model for modular networks and its algorithmic applications , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[16]  C. Geyer.  Markov Chain Monte Carlo Maximum Likelihood , 1991 .