Visual control in quake II with a cyclic controller

A cyclic controller is evolved in the first person shooter computer game Quake II, to learn to attack a randomly moving enemy in a simple room by using only visual inputs. The chromosome of a genetic algorithm represents a cyclical controller that reads grayscale information from the gameplay screen to determine how far to jump forward in the program and what actions to perform. The cyclic controller learns to effectively find and shoot the enemy, and outperforms our previously published neural network solution for the same problem.

[1]  Dario Floreano,et al.  Coevolution of active vision and feature selection , 2004, Biological Cybernetics.

[2]  Daniel Thalmann,et al.  A vision-based approach to behavioural animation , 1990, Comput. Animat. Virtual Worlds.

[3]  Risto Miikkulainen,et al.  Evolving a real-world vehicle warning system , 2006, GECCO.

[4]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[5]  Daniel A. Ashlock.  Grid-Robot Drivers: an Evolutionary Multi-agent Virtual Robotics Task , 2006, 2006 IEEE Symposium on Computational Intelligence and Games.

[6]  Ross Graham,et al.  Neural Pathways for Real-Time Dynamic Computer Games , 2005 .

[7]  Victor Ciesielski,et al.  Linear genetic programming , 2008, Genetic Programming and Evolvable Machines.

[8]  Risto Miikkulainen,et al.  Incremental Evolution of Complex General Behavior , 1997, Adapt. Behav..

[9]  Christian Bauckhage,et al.  Learning Human-Like Opponent Behavior for Interactive Computer Games , 2003, DAGM-Symposium.

[10]  Wolfgang Banzhaf,et al.  A comparison of linear genetic programming and neural networks in medical data mining , 2001, IEEE Trans. Evol. Comput..

[11]  Bobby D. Bryant,et al.  Neuro-visual control in the Quake II game engine , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[12]  Steve C. Maddock,et al.  Using Synthetic Vision for Autonomous Non-Player Characters , 2003, Inteligencia Artif..

[13]  Shumeet Baluja,et al.  Evolution of an artificial neural network based autonomous land vehicle controller , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[14]  Gary B. Parker,et al.  Using a Queue Genetic Algorithm to Evolve Xpilot Control Strategies on a Distributed System , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[15]  A. Watt,et al.  ARTÍCULO Using Synthetic Vision for Autonomous Non-Player Characters in Computer Games , 2003 .

[16]  Dean Pomerleau,et al.  Efficient Training of Artificial Neural Networks for Autonomous Navigation , 1991, Neural Computation.

[17]  Christian Bauckhage,et al.  Learning Human-Like Movement Behavior for Computer Games , 2004 .