EVOLVING A TEAM IN A FIRST-PERSON SHOOTER GAME BY USING A GENETIC ALGORITHM

Evolving game agents in a first-person shooter game is important to game developers and players. Choosing a proper set of parameters in a multiplayer game is not a straightforward process because consideration must be given to a large number of parameters, and therefore requires effort and thorough knowledge of the game. Thus, numerous artificial intelligence (AI) techniques are applied in the designing of game characters’ behaviors. This study applied a genetic algorithm to evolve a team in the mode of One Flag CTF in Quake III Arena to behave intelligently. The source code of the team AI is modified, and the progress of the game is represented as a finite state machine. A fitness function is used to evaluate the effect of a team's tactics in certain circumstances during the game. The team as a whole evolves intelligently, and consequently, effective strategies are discovered and applied in various situations. The experimental results have demonstrated that the proposed evolution method is capable of evolving a team's behaviors and optimizing the commands in a shooter game. The evolution strategy enhances the original game AI and assists game designers in tuning the parameters more effectively. In addition, this adaptive capability increases the variety of a game and makes gameplay more interesting and challenging.

[1]  A.P. Engelbrecht,et al.  Learning to play games using a PSO-based competitive learning approach , 2004, IEEE Transactions on Evolutionary Computation.

[2]  Sushil J. Louis,et al.  Using a genetic algorithm to tune first-person shooter bots , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[3]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[4]  Moshe Sipper,et al.  Designing an Evolutionary Strategizing Machine for Game Playing and Beyond , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[5]  David M. Bourg,et al.  AI for Game Developers , 2004 .

[6]  Brian Mac Namee,et al.  Research Directions for AI in Computer Games , 2001 .

[7]  Colm O'Riordan,et al.  Effects of Shared Perception on the Evolution of Squad Behaviors , 2009, IEEE Transactions on Computational Intelligence and AI in Games.

[8]  Sushil J. Louis,et al.  Playing to learn: case-injected genetic algorithms for learning to play computer games , 2005, IEEE Transactions on Evolutionary Computation.

[9]  José Valente de Oliveira,et al.  Particle swarm optimization applied to the chess game , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[10]  Hector Muñoz-Avila,et al.  RETALIATE: Learning Winning Policies in First-Person Shooter Games , 2007, AAAI.

[11]  Mohammed El-Abd,et al.  A Taxonomy of Cooperative Particle Swarm Optimizers , 2008 .

[12]  Colm O'Riordan,et al.  Evolving team behaviours in environments of varying difficulty , 2007, Artificial Intelligence Review.

[13]  Andries Petrus Engelbrecht,et al.  Coevolving Probabilistic Game Playing Agents using Particle Swarm Optimization Algorithm , 2005, CIG.

[14]  Robert McCartney,et al.  Generating war game strategies using a genetic algorithm , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[15]  Ching-Tsorng Tsai,et al.  AN EVOLUTIONARY STRATEGY FOR A COMPUTER TEAM GAME , 2011, Comput. Intell..

[16]  Alexander Nareyek,et al.  AI in Computer Games , 2004, ACM Queue.

[17]  David W. Aha,et al.  Knowledge acquisition for adaptive game AI , 2007, Sci. Comput. Program..

[18]  Andries Petrus Engelbrecht,et al.  Fundamentals of Computational Swarm Intelligence , 2005 .