To Create Intelligent Adaptive Game Opponent by Using Monte-Carlo for the Game of Pac-Man

Adaptive Game AI improves adaptability of opponent AI with the challenge level of the gameplay; as a result the entertainment of game is augmented. Opponent game AI is usually implemented by scripted rules in video games. However MCT (Monte-Carlo for Trees), a most updated algorithm which perform excellent in computer go can also be used to achieve excellent result to control non-player characters (NPCs) in video games. In this paper, the prey and predator game genre of Pac-Man is used as a test-bed, the basic principle of MCT is presented, and the effectiveness of its application to game AI development is demonstrated. Furthermore, in order to reduce the computation intensiveness of Monte-Carlo, ANN (Artificial Neural Network) is used to produce the intelligence of game opponent with the data collected from Monte-Carlo method. The effectiveness and efficiency of the process is proved.

[1]  Georgios N. Yannakakis.  AI in computer games : generating interesting interactive opponents by the use of evolutionary computation , 2005 .

[2]  Darryl Charles,et al.  Data-Driven Decision Theory for Player Analysis in Pacman , 2006 .

[3]  Yi Wang,et al.  Game Player Strategy Pattern Recognition and How UCT Algorithms Apply Pre-knowledge of Player's Strategy to Improve Opponent AI , 2008, 2008 International Conference on Computational Intelligence for Modelling Control & Automation.

[4]  Simon M. Lucas.  Computational intelligence and games: Challenges and opportunities , 2008, Int. J. Autom. Comput..

[5]  Yi Wang,et al.  To Create Adaptive Game Opponent by Using UCT , 2008, 2008 International Conference on Computational Intelligence for Modelling Control & Automation.

[6]  Richard S. Sutton,et al.  Reinforcement Learning , 1992, Handbook of Machine Learning.

[7]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[8]  Junping Du,et al.  To create neuro-controlled game opponent from UCT-created data , 2009, GEC '09.

[9]  Darryl Charles,et al.  Analyzing player behavior in Pacman using feature-driven decision theoretic predictive modeling , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[10]  John Levine,et al.  An evolutionary approach for interactive computer games , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[11]  Gabriel Kronberger,et al.  Bandit-Based Monte-Carlo Planning for the Single-Machine Total Weighted Tardiness Scheduling Problem , 2007, EUROCAST.