Grid Coevolution for Adaptive Simulations: Application to the Building of Opening Books in the Game of Go

This paper presents a successful application of parallel (grid) coevolution applied to the building of an opening book (OB) in 9x9 Go. Known sayings around the game of Go are refound by the algorithm, and the resulting program was also able to credibly comment openings in professional games of 9x9 Go. Interestingly, beyond the application to the game of Go, our algorithm can be seen as a "meta"-level for the UCT-algorithm: "UCT applied to UCT" (instead of "UCT applied to a random player" as usual), in order to build an OB. It is generic and could be applied as well for analyzing a given situation of a Markov Decision Process.

[1]  Rémi Coulom,et al.  Efficient Selectivity and Backup Operators in Monte-Carlo Tree Search , 2006, Computers and Games.

[2]  Marc Schoenauer,et al.  Polar IFS+Parisian Genetic Programming=Efficient IFS Inverse Problem Solving , 2000, Genetic Programming and Evolvable Machines.

[3]  Peter Drake,et al.  Coevolving Partial Strategies for the Game of Go , 2008, GEM.

[4]  Frédérick Garcia,et al.  On-Line Search for Solving Markov Decision Processes via Heuristic Sampling , 2004, ECAI.

[5]  Arthur Tay,et al.  Discovering Chinese Chess Strategies through Coevolutionary Approaches , 2007, 2007 IEEE Symposium on Computational Intelligence and Games.

[6]  H. Jaap van den Herik,et al.  Progressive Strategies for Monte-Carlo Tree Search , 2008 .

[7]  Hiroyuki Iida,et al.  Self-playing-based Opening Book Tuning , 2006 .

[8]  Olivier Teytaud,et al.  Lower Bounds for Evolution Strategies Using VC-Dimension , 2008, PPSN.

[9]  David Silver,et al.  Combining online and offline knowledge in UCT , 2007, ICML '07.

[10]  Simon M. Lucas,et al.  Parallel Problem Solving from Nature - PPSN X, 10th International Conference Dortmund, Germany, September 13-17, 2008, Proceedings , 2008, PPSN.

[11]  Michael Buro.  Toward Opening Book Learning , 1999, J. Int. Comput. Games Assoc..

[12]  Ulf Lorenz,et al.  Innovative Opening-Book Handling , 2006, ACG.

[13]  Csaba Szepesvári,et al.  Bandit Based Monte-Carlo Planning , 2006, ECML.

[14]  Sylvain Gelly,et al.  Modifications of UCT and sequence-like simulations for Monte-Carlo Go , 2007, 2007 IEEE Symposium on Computational Intelligence and Games.

[15]  Martin Müller,et al.  Computer Go , 2002, Artif. Intell..

[16]  John Tromp,et al.  Combinatorics of Go , 2006, Computers and Games.

[17]  Neil D. Lawrence,et al.  Missing Data in Kernel PCA , 2006, ECML.