An algorithm based on valuation forecasting for game tree search

This study proposes a novel best-first search algorithm, called Valuation Increment Search Algorithm (VIS), which applies the increment of exploratory value change to predict the valuation and guide the selection of the game tree. The proposed method can effectively use node valuation and game tree size information to solve the game tree by fewer exploration steps. The relevant assumptions and search principles of the proposed algorithm are detailed. Moreover, comparative experiments with Alpha–Beta Search (α–β search), Proof-Number Search (PNS) and Monte-Carlo Tree Search (MCTS) in the domain of Dou Dizhu has been performed to verify the performance. Result demonstrate that VIS is superior to α–β search, PNS and MCTS algorithm in solving the game tree and finding the best move for some game scenarios by consuming less time and few memory resources. The improvement effect of the average Increment, magnitude of Increment, and the number of visits to node on the original VIS was validated. Also, a new selection strategy is defined for the improved VIS algorithm combined with these factors. The experimental comparison results show that improved VIS has a better performance in solving game tree with less nodes generated and expanded than original VIS.

[1]  H. Jaap van den Herik,et al.  PDS-PN: A New Proof-Number Search Algorithm , 2002, Computers and Games.

[2]  Demis Hassabis,et al.  Mastering the game of Go without human knowledge , 2017, Nature.

[3]  J. Neumann,et al.  Theory of Games and Economic Behavior: 60th Anniversary Commemorative Edition , 2020 .

[4]  Judea Pearl,et al.  The solution for the branching factor of the alpha-beta pruning algorithm and its optimality , 1982, CACM.

[5]  Stefano Di Palma,et al.  Traditional Wisdom and Monte Carlo Tree Search Face-to-Face in the Card Game Scopone , 2018, IEEE Transactions on Games.

[6]  Changming Xu,et al.  Enhancements of proof number search in connect6 , 2009, 2009 Chinese Control and Decision Conference.

[7]  Igor Jurisica,et al.  Construction of New Medicines via Game Proof Search , 2012, AAAI.

[8]  Aldeida Aleti,et al.  Can Monte-Carlo Tree Search learn to sacrifice? , 2016, J. Heuristics.

[9]  Nils J. Nilsson,et al.  Principles of Artificial Intelligence , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Akihiro Kishimoto,et al.  Game-Tree Search Using Proof Numbers: The First Twenty Years , 2012, J. Int. Comput. Games Assoc..

[11]  Jonathan Schaeffer,et al.  Checkers Is Solved , 2007, Science.

[12]  Hiroyuki Iida,et al.  The PN*-search algorithm: Application to tsume-shogi , 2001, Artif. Intell..

[13]  J. McDermott Principles of artificial intelligence: Nils J. Nilsson, Tioga Publishing Co., Palo Alto, CA, 1980, 476 pages, $24.50, ISBN 0-935382-01 , 1980 .

[14]  Julian Togelius,et al.  Modifying MCTS for Human-Like General Video Game Playing , 2016, IJCAI.

[15]  Chris McConnell,et al.  B Probability Based Search , 1996, Artif. Intell..

[16]  Akihiro Kishimoto,et al.  DF-PN in Go: An Application to the One-Eye Problem , 2003, ACG.

[17]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[18]  Seyedali Mirjalili,et al.  Comparison of recent optimization algorithms for design optimization of a cam-follower mechanism , 2020, Knowl. Based Syst..

[19]  Claude E. Shannon,et al.  Programming a computer for playing chess , 1950 .

[20]  Nantiwat Pholdee,et al.  Hybrid real-code population-based incremental learning and differential evolution for many-objective optimisation of an automotive floor-frame , 2017, International Journal of Vehicle Design.

[21]  Simon M. Lucas,et al.  A Survey of Monte Carlo Tree Search Methods , 2012, IEEE Transactions on Computational Intelligence and AI in Games.

[22]  Claude E. Shannon,et al.  XXII. Programming a Computer for Playing Chess 1 , 1950 .

[23]  H. Jaap van den Herik,et al.  Games solved: Now and in the future , 2002, Artif. Intell..

[24]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[25]  Saeed Sharifian,et al.  Tree-Based Optimization: A Meta-Algorithm for Metaheuristic Optimization , 2018, ArXiv.

[26]  Uiterwijk,et al.  The pn2-search algorithm , 1999 .

[27]  Allen Newell,et al.  Chess-Playing Programs and the Problem of Complexity , 1958, IBM J. Res. Dev..

[28]  H. Jaap van den Herik,et al.  Randomized Parallel Proof-Number Search , 2009, ACG.

[29]  Julian Togelius,et al.  Artificial Intelligence and Games , 2018, Springer International Publishing.

[30]  H. Jaap van den Herik,et al.  Proof-Number Search and Its Variants , 2008, Oppositional Concepts in Computational Intelligence.

[31]  H. Jaap van den Herik,et al.  Proof-Number Search , 1994, Artif. Intell..

[32]  Pieter Spronck,et al.  Monte-Carlo Tree Search: A New Framework for Game AI , 2008, AIIDE.

[33]  Donald E. Knuth,et al.  The Solution for the Branching Factor of the Alpha-Beta Pruning Algorithm , 1981, ICALP.

[34]  Drew McDermott,et al.  Introduction to artificial intelligence , 1986, Addison-Wesley series in computer science.