Game Player Strategy Pattern Recognition and How UCT Algorithms Apply Pre-knowledge of Player's Strategy to Improve Opponent AI

Player strategy pattern recognition (PSPR) is to apply pattern recognition and its approach to identification of player's strategy during the gameplay. Correctly identified player's strategy, which is called knowledge, could be used to improve game opponent AI which can be implemented by KB-UCT (knowledge-based upper confidence bound for trees). KB-UCT improves adaptability of game AI, the challenge level of the gameplay, and the performance of the opponent AI; as a result the entertainment of game is promoted. In this paper, the prey and predator game genre of dead end game is used as a test-bed. During the PSPR, classification algorithm of KNN (k-nearest neighbor) is chosen to analyze off-line data from the simulated gamers who are choosing different strategies. Based on the information from PSPR, the game AI is promoted through application of KB-UCT, in this case, domain knowledge is used for UCT tree pruning; as a result the performance of the opponent AI is enhanced.

[1]  Csaba Szepesvári,et al.  Bandit Based Monte-Carlo Planning , 2006, ECML.

[2]  Simon M. Lucas Computational intelligence and games: Challenges and opportunities , 2008, Int. J. Autom. Comput..

[3]  Nicolò Cesa-Bianchi,et al.  Gambling in a rigged casino: The adversarial multi-armed bandit problem , 1995, Proceedings of IEEE 36th Annual Foundations of Computer Science.

[4]  Georgios N. Yannakakis AI in computer games : generating interesting interactive opponents by the use of evolutionary computation , 2005 .

[5]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[6]  Jing Li,et al.  Game Player Strategy Pattern Recognition by Using Radial Basis Function , 2008, 2008 International Conference on Computer Science and Software Engineering.

[7]  Ian H. Witten,et al.  Data mining - practical machine learning tools and techniques, Second Edition , 2005, The Morgan Kaufmann series in data management systems.

[8]  John Levine,et al.  An evolutionary approach for interactive computer games , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[9]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[10]  Peter Auer,et al.  Finite-time Analysis of the Multiarmed Bandit Problem , 2002, Machine Learning.