Case Indexing Using PSO and ANN in Real Time Strategy Games

This paper proposes a case indexing method using particle swarm optimization (PSO) and artificial neural network (ANN) in a defense-style real time strategy (RTS) game. PSO is employed to optimize the placement of cannons to defend the enemy attack. The execution time of PSO (> 100 seconds) is unsatisfied for RTS game. The result of PSO is used as a case indexing of past experience to train ANN. After the training (approximately 30 seconds), ANN can obtain the best cannon placement within 0.05 second. Experimental results demonstrated that this case indexing method using PSO and ANN efficiently speeded up the whole process to satisfy the requirement in RTS game.

[1]  Kenneth D. Forbus,et al.  How qualitative spatial reasoning can improve strategy game AIs , 2002, IEEE Intelligent Systems.

[2]  David M. Bourg,et al.  AI for Game Developers , 2004 .

[3]  Alan Heirich,et al.  Proceedings of the 2007 ACM SIGGRAPH Symposium on Video Games, Sandbox 2007, San Diego, California, USA, August 4-5, 2007 , 2007, Sandbox@SIGGRAPH.

[4]  Donald E. Grierson,et al.  Comparison among five evolutionary-based optimization algorithms , 2005, Adv. Eng. Informatics.

[5]  Sushil J. Louis,et al.  Playing to learn: case-injected genetic algorithms for learning to play computer games , 2005, IEEE Transactions on Evolutionary Computation.

[6]  Andries Petrus Engelbrecht,et al.  Training Bao Game-Playing Agents using Coevolutionary Particle Swarm Optimization , 2006, 2006 IEEE Symposium on Computational Intelligence and Games.

[7]  Andries Petrus Engelbrecht,et al.  Fundamentals of Computational Swarm Intelligence , 2005 .

[8]  Simon C. K. Shiu,et al.  Foundations of Soft Case-Based Reasoning: Pal/Soft Case-Based Reasoning , 2004 .

[9]  Christoph Salge,et al.  Using genetically optimized artificial intelligence to improve gameplaying fun for strategical games , 2008, Sandbox '08.

[10]  Andries Petrus Engelbrecht,et al.  Comparing Particle Swarm Optimisation and Genetic Algorithms for Nonlinear Mapping , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[11]  Andries Petrus Engelbrecht,et al.  Comparing PSO structures to learn the game of checkers from zero knowledge , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[12]  S. Pal,et al.  Foundations of Soft Case-Based Reasoning: Pal/Soft Case-Based Reasoning , 2004 .

[13]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[14]  Chuen-Tsai Sun,et al.  Building a player strategy model by analyzing replays of real-time strategy games , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[15]  James Kennedy,et al.  Particle swarm optimization , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[16]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[17]  Yifan He,et al.  A Comparison among Three Neural Networks for Text Classification , 2006, 2006 8th international Conference on Signal Processing.

[18]  Simon C. K. Shiu,et al.  Application and Comparison of Particle Swarm Optimization and Genetic Algorithm in Strategy Defense Game , 2009, 2009 Fifth International Conference on Natural Computation.

[19]  Sushil J. Louis,et al.  Using a genetic algorithm to tune first-person shooter bots , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[20]  Weixing Lin,et al.  Comparison between PSO and GA for Parameters Optimization of PID Controller , 2006, 2006 International Conference on Mechatronics and Automation.

[21]  Ashraf M. Abdelbar,et al.  Applying Co-Evolutionary Particle Swam Optimization to the Egyptian Board Game Seega , 2003 .