Parallel Nested Monte-Carlo search

We address the parallelization of a Monte-Carlo search algorithm. On a cluster of 64 cores we obtain a speedup of 56 for the parallelization of Morpion Solitaire. An algorithm that behaves better than a naive one on heterogeneous clusters is also detailed.

[1]  George Bosilca,et al.  Open MPI: Goals, Concept, and Design of a Next Generation MPI Implementation , 2004, PVM/MPI.

[2]  Tristan Cazenave,et al.  Nested Monte-Carlo Search , 2009, IJCAI.

[3]  Francesca Guerriero,et al.  Parallelization Strategies for Rollout Algorithms , 2005, Comput. Optim. Appl..

[4]  Nicolas Jouandeau,et al.  A Parallel Monte-Carlo Tree Search Algorithm , 2008, Computers and Games.

[5]  Dimitri P. Bertsekas,et al.  Rollout Algorithms for Stochastic Scheduling Problems , 1999, J. Heuristics.

[6]  Erik D. Demaine,et al.  Morpion Solitaire , 2005, Theory of Computing Systems.

[7]  Enrique Alba,et al.  Nature-inspired distributed computing , 2007, Comput. Commun..

[8]  Enrique Alba,et al.  Parallel Metaheuristics: A New Class of Algorithms , 2005 .

[9]  T. Cazenave,et al.  On the Parallelization of UCT , 2007 .

[10]  El-Ghazali Talbi,et al.  A Comparative Study of Parallel Metaheuristics for Protein Structure Prediction on the Computational Grid , 2007, 2007 IEEE International Parallel and Distributed Processing Symposium.

[11]  New Heuristics for Morpion Solitaire , 2007 .

[12]  T. Cazenave.  Reflexive Monte-Carlo Search , 2007 .

[13]  John N. Tsitsiklis,et al.  Rollout Algorithms for Combinatorial Optimization , 1997, J. Heuristics.

[14]  Gerald Tesauro,et al.  On-line Policy Improvement using Monte-Carlo Search , 1996, NIPS.

[15]  Benjamin Van Roy,et al.  Solitaire: Man Versus Machine , 2004, NIPS.

[16]  Ikuo Takeuchi,et al.  Parallel Monte-Carlo Tree Search with Simulation Servers , 2010, 2010 International Conference on Technologies and Applications of Artificial Intelligence.

[17]  Roberto Musmanno,et al.  New Rollout Algorithms for Combinatorial Optimization Problems , 2002, Optim. Methods Softw..

[18]  H. Jaap van den Herik,et al.  Parallel Monte-Carlo Tree Search , 2008, Computers and Games.

[19]  Alan Fern,et al.  Searching Solitaire in Real Time , 2007, J. Int. Comput. Games Assoc..

[20]  Nicola Secomandi,et al.  Analysis of a Rollout Approach to Sequencing Problems with Stochastic Routing Applications , 2003, J. Heuristics.