Novel threat-based AI strategies that incorporate adaptive data structures for multi-player board games

This paper considers the problem of designing novel techniques for multi-player game playing, in a range of board games and configurations. Compared to the well-known case of two-player game playing, multi-player game playing is a more complex problem with unique requirements. To address the unique challenges of this domain, we examine the potential of employing techniques inspired by Adaptive Data Structures (ADSs) to rank opponents based on their relative threats, and using this information to achieve gains in move ordering and tree pruning. We name our new technique the Threat-ADS heuristic. We examine the Threat-ADS’ performance within a range of game models, employing a number of different, well-understood update mechanisms for ADSs. We then extend our analysis to specifically consider intermediate board states, which are more interesting than the initial board state, as we do not assume the availability of “Opening book” moves, and where substantial variation can exist, in terms of available moves and threatening opponents. We expand this analysis to include an exploration of the Threat-ADS heuristic’s performance in deeper ply game trees, to confirm that it maintains its benefits even when lookahead is greater, and with an expanded examination of how the number of players present in the game impacts the performance of the Threat-ADS heuristic. We find that in nearly all environments, the Threat-ADS heuristic is able to produce meaningful, statistically significant improvements in tree pruning, demonstrating that it serves as a very reliable move ordering heuristic for multi-player game playing under a wide range of configurations, thus motivating the use of ADS-based techniques within the field of game playing.

[1]  Gaston H. Gonnet,et al.  Toward self-organizing linear search , 1979, 20th Annual Symposium on Foundations of Computer Science (sfcs 1979).

[2]  B. John Oommen,et al.  On Enhancing Recent Multi-player Game Playing Strategies Using a Spectrum of Adaptive Data Structures , 2013, 2013 Conference on Technologies and Applications of Artificial Intelligence.

[3]  Nathan R. Sturtevant,et al.  A Comparison of Algorithms for Multi-player Games , 2002, Computers and Games.

[4]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[5]  B. John Oommen,et al.  Deterministic Learning Automata Solutions to the Equipartitioning Problem , 1988, IEEE Trans. Computers.

[6]  Seth Pettie,et al.  Splay trees, Davenport-Schinzel sequences, and the deque conjecture , 2007, SODA '08.

[7]  Julian Francis Miller,et al.  The Importance of Topology Evolution in NeuroEvolution: A Case Study Using Cartesian Genetic Programming of Artificial Neural Networks , 2013, SGAI Conf..

[8]  Daniel S. Hirschberg,et al.  Self-organizing linear search , 1985, CSUR.

[9]  Vladimir Estivill-Castro Move-to-end is best for double-linked lists , 1992, Proceedings ICCI `92: Fourth International Conference on Computing and Information.

[10]  Keki B. Irani,et al.  An Algorithmic Solution of N-Person Games , 1986, AAAI.

[11]  Nathan R. Sturtevant,et al.  Robust game play against unknown opponents , 2006, AAMAS '06.

[12]  Jonathan Schaeffer,et al.  A Gamut of Games , 2001, AI Mag..

[13]  Richard E. Korf,et al.  Contents , 1979, Brain and Development.

[14]  Claude E. Shannon,et al.  Programming a computer for playing chess , 1950 .

[15]  B. John Oommen,et al.  Enhancing History-Based Move Ordering in Game Playing Using Adaptive Data Structures , 2015, ICCCI.

[16]  Nathan R. Sturtevant,et al.  Prob-Maxn: Playing N-Player Games with Opponent Models , 2006, AAAI.

[17]  Pieter Spronck,et al.  Monte-Carlo Tree Search in Settlers of Catan , 2009, ACG.

[18]  Mark H. M. Winands,et al.  Best Reply Search for Multiplayer Games , 2011, IEEE Transactions on Computational Intelligence and AI in Games.

[19]  Judit Bar-Ilan,et al.  Comparing Typical Opening Move Choices Made by Humans and Chess Engines , 2007, Comput. J..

[20]  Ronald L. Rivest,et al.  Introduction to Algorithms , 1990 .

[21]  Jonathan Schaeffer,et al.  The History Heuristic and Alpha-Beta Search Enhancements in Practice , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  R. Coe,et al.  It's the Effect Size, Stupid What effect size is and why it is important , 2012 .

[23]  Robert E. Tarjan,et al.  Amortized efficiency of list update and paging rules , 1985, CACM.

[24]  Susanne Albers,et al.  Self-Organizing Data Structures , 1996, Online Algorithms.

[25]  B. John Oommen,et al.  On Applying Adaptive Data Structures to Multi-Player Game Playing , 2013, SGAI Conf..

[26]  Sarit Kraus,et al.  Mixing search strategies for multi-player games , 2009, IJCAI 2009.

[27]  Claude E. Shannon,et al.  XXII. Programming a Computer for Playing Chess 1 , 1950 .

[28]  B. John Oommen,et al.  Novel AI Strategies for Multi-Player Games at Intermediate Board States , 2015, IEA/AIE.

[29]  Paul W. Rendell A Universal Turing Machine in Conway's Game of Life , 2011, 2011 International Conference on High Performance Computing & Simulation.

[30]  Ronald L. Rivest,et al.  On self-organizing sequential search heuristics , 1976, CACM.