论文信息 - Time Management for Monte-Carlo Tree Search Applied to the Game of Go

Time Management for Monte-Carlo Tree Search Applied to the Game of Go

Monte-Carlo tree search (MCTS) is a new technique that has produced a huge leap forward in the strength of Go-playing programs. An interesting aspect of MCTS that has been rarely studied in the past is the problem of time management. This paper presents the effect on playing strength of a variety of time-management heuristics for 19x19 Go. Results indicate that clever time management can have a very significant effect on playing strength. Experiments demonstrate that the most basic algorithm for sudden-death time controls(dividing the remaining time by a constant) produces a winning rate of 43.2±2.2% against GNU Go 3.8 Level 2, whereas our most efficient time-allocation strategy can reach a winning rate of 60±2.2% without pondering and 67.4±2.1% with pondering.

Shih-Chieh Huang | Shun-Shii Lin | Remi Coulom

[1] David Silver,et al. Combining online and offline knowledge in UCT , 2007, ICML '07.

[2] Rémi Coulom,et al. Efficient Selectivity and Backup Operators in Monte-Carlo Tree Search , 2006, Computers and Games.

[3] H. Jaap van den Herik,et al. Progressive Strategies for Monte-Carlo Tree Search , 2008 .

[4] Akihiro Kishimoto,et al. Monte Carlo Go Has a Way to Go , 2006, AAAI.

[5] Eric B. Baum,et al. A Bayesian Approach to Relevance in Game Playing , 1997, Artif. Intell..

[6] Csaba Szepesvári,et al. Bandit Based Monte-Carlo Planning , 2006, ECML.

[7] Olivier Teytaud,et al. Modification of UCT with Patterns in Monte-Carlo Go , 2006 .

[8] David Silver,et al. Reinforcement learning and simulation-based search in computer go , 2009 .

[9] Rémi Coulom,et al. Computing "Elo Ratings" of Move Patterns in the Game of Go , 2007, J. Int. Comput. Games Assoc..

[10] Shaul Markovitch,et al. LEARNING OF RESOURCE ALLOCATION STRATEGIES FOR GAME PLAYING , 1993, IJCAI.

[11] Vladan Vuckovic,et al. Time Management During a Chess Game , 2009, J. Int. Comput. Games Assoc..

[12] Robert M. Hyatt,et al. Using Time Wisely , 1984, J. Int. Comput. Games Assoc..