Effects of Shared Perception on the Evolution of Squad Behaviors

As the nonplayable characters (NPCs) of squad-based shooter computer games share a common goal, they should work together in teams and display cooperative behaviors that are tactically sound. Our research examines genetic programming (GP) as a technique to automatically develop effective squad behaviors for shooter games. GP has been used to evolve teams capable of defeating a single powerf.ul enemy agent in a number of environments without the use of any explicit team communication. This paper is an extension of our paper presented at the 2008 Conference on Artificial Intelligence and Interactive Digital Entertainment (AIIDE'08). Its aim is to explore the effects of shared perception on the evolution of effective squad behaviors. Thus, NPCs are given the ability to explicitly communicate their perceived information during evolution. The results show that the explicit communication of perceived information between team members enables an improvement in average team effectiveness.

[1]  Kenneth O. Stanley and Bobby D. Bryant and Risto Miikkulainen,et al.  Real-Time Evolution in the NERO Video Game (Winner of CIG 2005 Best Paper Award) , 2005, CIG.

[2]  Colm O'Riordan,et al.  Evolving team behaviours in environments of varying difficulty , 2007, Artificial Intelligence Review.

[3]  Michael LaLena,et al.  Teamwork in genetic programming , 1997 .

[4]  Colm O'Riordan,et al.  A phenotypic analysis of GP-evolved team behaviours , 2007, GECCO '07.

[5]  Marc J. V. Ponsen,et al.  Improving Adaptive Game Ai with Evolutionary Learning , 2004 .

[6]  Sandip Sen,et al.  Computing effective communication policies in multiagent systems , 2007, AAMAS '07.

[7]  Bradley J. Best,et al.  Spatial Plans , Communication , and Teamwork in Synthetic MOUT Agents , 2003 .

[8]  Sandip Sen,et al.  Evolving a Team , 1995 .

[9]  Sandip Sen,et al.  Strongly Typed Genetic Programming in Evolving Cooperation Strategies , 1995, ICGA.

[10]  Alex J. Champandard.  AI Game Development: Synthetic Creatures with Learning and Reactive Behaviors , 2003 .

[11]  Christian Bauckhage,et al.  Imitation learning at all levels of game-AI , 2004 .

[12]  Michael Barlow,et al.  Factors in Team Performance in a Virtual Squad Environment , 2004 .

[13]  Sushil J. Louis,et al.  Using a genetic algorithm to tune first-person shooter bots , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[14]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[15]  Craig W. Reynolds.  An evolved, vision-based behavioral model of coordinated group motion , 1993 .

[16]  Eric V. Siegel,et al.  Genetically optimizing the speed of programs evolved to play tetris , 1996 .

[17]  Colm O'Riordan,et al.  Effects of Communication on the Evolution of Squad Behaviours , 2008, AIIDE.

[18]  Peter J. Angeline,et al.  Competitive Environments Evolve Better Solutions for Complex Tasks , 1993, ICGA.

[19]  L. Darrell Whitley,et al.  Evolving cooperative strategies for UAV teams , 2005, GECCO '05.

[20]  Sandip Sen,et al.  Evolving Beharioral Strategies in Predators and Prey , 1995, Adaption and Learning in Multi-Agent Systems.

[21]  Lee Spector,et al.  Evolving teamwork and coordination with genetic programming , 1996 .

[22]  David J. Montana,et al.  Strongly Typed Genetic Programming , 1995, Evolutionary Computation.

[23]  Mat Buckland,et al.  Programming Game AI by Example , 2004 .

[24]  Eric O. Postma,et al.  TEAM: The Team-Oriented Evolutionary Adaptability Mechanism , 2004, ICEC.

[25]  James A. Hendler,et al.  Co-evolving Soccer Softbot Team Coordination with Genetic Programming , 1997, RoboCup.

[26]  Hector Muñoz-Avila,et al.  RETALIATE: Learning Winning Policies in First-Person Shooter Games , 2007, AAAI.