Optimizing player behavior in a real-time strategy game using evolutionary algorithms

This paper describes an Evolutionary Algorithm for evolving the decision engine of a bot designed to play the Planet Wars game. This game, which has been chosen for the Google Artificial Intelligence Challenge in 2010, requires that the artificial player is able to deal with multiple objectives, while achieving a certain degree of adaptability in order to defeat different opponents in different scenarios. The decision engine of the bot is based on a set of rules that have been defined after an empirical study. Then, an Evolutionary Algorithm is used for tuning the set of constants, weights and probabilities that define the rules, and, therefore, the global behavior of the bot. The paper describes the Evolutionary Algorithm and the results attained by the decision engine when competing with other bots. The proposed bot defeated a baseline bot in most of the playing environments and obtained a ranking position in top-20% of the Google Artificial Intelligence competition.

[1]  Santiago Ontañón,et al.  Case-Based Planning and Execution for Real-Time Strategy Games , 2007, ICCBR.

[2]  David B. Fogel,et al.  Evolution-ary Computation 1: Basic Algorithms and Operators , 2000 .

[3]  Martinez Moises,et al.  Pac-mAnt: Optimization based on ant colonies applied to developing an agent for Ms. Pac-Man , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[4]  Clare Bates Congdon,et al.  Agent Smith: Towards an evolutionary rule-based agent for interactive dynamic games , 2009, 2009 IEEE Congress on Evolutionary Computation.

[5]  Penelope Sweetser.  Emergence in Games , 2007 .

[6]  A. E. Eiben,et al.  Parameter tuning for configuring and analyzing evolutionary algorithms , 2011, Swarm Evol. Comput..

[7]  Juan Julián Merelo Guervós,et al.  Evolving the cooperative behaviour in Unreal™ bots , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[8]  Sushil J. Louis,et al.  Coevolving team tactics for a real-time strategy game , 2010, IEEE Congress on Evolutionary Computation.

[9]  Francisco Herrera,et al.  A taxonomy for the crossover operator for real‐coded genetic algorithms: An experimental study , 2003, Int. J. Intell. Syst..

[10]  Zbigniew Michalewicz,et al.  Genetic algorithms + data structures = evolution programs (3rd ed.) , 1996 .

[11]  Weblog Wikipedia,et al.  In Wikipedia the Free Encyclopedia , 2005 .

[12]  Michael Buro,et al.  Call for AI Research in RTS Games , 2004 .

[13]  Sung-Bae Cho,et al.  Optimal strategy selection of non-player character on real time strategy game using a speciated evolutionary algorithm , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[14]  Nicola Beume,et al.  Intelligent anti-grouping in real-time strategy games , 2008, 2008 IEEE Symposium On Computational Intelligence and Games.

[15]  C. Miles.  Co-evolving Real-Time Strategy Game Playing Influence Map Trees With Genetic Algorithms , 2022 .

[16]  David W. Aha,et al.  Automatically Generating Game Tactics through Evolutionary Learning , 2006, AI Mag..

[17]  Eric O. Postma,et al.  Improved opponent intelligence trough offline learning , 2003, Int. J. Intell. Games Simul..

[18]  Peter Ross,et al.  Dynamic Strategies in a Real-Time Strategy Game , 2003, GECCO.

[19]  Zbigniew Michalewicz,et al.  Evolutionary Computation 2 : Advanced Algorithms and Operators , 2000 .

[20]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[21]  Stefan J. Johansson,et al.  A Multi-Agent Potential Field-based Bot for a Full RTS Game Scenario , 2009, AIIDE.

[22]  Colm O'Riordan,et al.  Evolving robust strategies for an abstract real-time strategy game , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[23]  Simon M. Lucas.  Computational intelligence and games: Challenges and opportunities , 2008, Int. J. Autom. Comput..

[24]  Pieter Spronck,et al.  IMPROVING OPPONENT INTELLIGENCE THROUGH OFFLINE EVOLUTIONARY LEARNING , 2003 .

[25]  Daniel Livingstone,et al.  Coevolution in Hierarchical AI for Strategy Games , 2005, CIG.

[26]  Vicente Milanés Montero,et al.  A modular parametric architecture for the TORCS racing engine , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[27]  John E. Laird,et al.  Using a Computer Game to Develop Advanced AI , 2001, Computer.

[28]  Sung-Bae Cho,et al.  Evolving Reactive NPCs for the Real-Time Simulation Game , 2005, CIG.

[29]  Julian Togelius,et al.  Super mario evolution , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[30]  Jeannie Novak,et al.  Game development essentials : game artificial intelligence , 2008 .

[31]  Anna I. Esparcia-Alcázar,et al.  Controlling bots in a First Person Shooter game using genetic algorithms , 2010, IEEE Congress on Evolutionary Computation.