Self-synthesized controllers for tower defense game using genetic programming

In this paper, we describe the results of implementing Genetic Programming (GP) using two different Artificial Neural Networks (ANN) topologies in a customized Tower Defense (TD) games. The ANNs used are (1) Feed-forward Neural Network (FFNN) and (2) Elman-Recurrent Neural Network (ERNN). TD game is one of the strategy game genres. Players are required to build towers in order to prevent the creeps from reaching their bases. Lives will be deducted if any creeps manage to reach the base. In this research, a map will be designed. The AI method used will self-synthesize and analyze the level of difficulty of the designed map. The GP acts as a tuner of the weights in ANNs. The ANNs will act as players to block the creeps from reaching the base. The map will then be evaluated by the ANNs in the testing phase. Our findings showed that GP works well with ERNN compared to GP with FFNN.

[1]  Chang Kee Tong,et al.  The Evolution of Gamebots for 3D First Person Shooter (FPS) , 2011, 2011 Sixth International Conference on Bio-Inspired Computing: Theories and Applications.

[2]  Chin Kim On,et al.  An Evolutionary Multi-objective Optimization Approach to Computer Go Controller Synthesis , 2012, PRICAI.

[3]  Julian Togelius,et al.  Evolving controllers for simulated car racing , 2005, 2005 IEEE Congress on Evolutionary Computation.

[4]  Chang Kee Tong,et al.  Evolving Neural Controllers Using GA for Warcraft 3-Real Time Strategy Game , 2011, 2011 Sixth International Conference on Bio-Inspired Computing: Theories and Applications.

[5]  Janez Bester,et al.  Introduction to the Artificial Neural Networks , 2011 .

[6]  Jason Teo,et al.  Pareto Ensembles for Evolutionary Synthesis of Neurocontrollers in a 2D Maze-Based Video Game , 2013 .

[7]  Susan L. Epstein.  Game Playing: The Next Moves , 1999, AAAI/IAAI.

[8]  Moshe Sipper,et al.  GP-EndChess: Using Genetic Programming to Evolve Chess Endgame Players , 2005, EuroGP.

[9]  Chang Kee Tong,et al.  Automatic generation of real time strategy tournament units using differential evolution , 2011, 2011 IEEE Conference on Sustainable Utilization and Development in Engineering and Technology (STUDENT).

[10]  David B. Fogel,et al.  Evolving neural networks to play checkers without relying on expert knowledge , 1999, IEEE Trans. Neural Networks.

[11]  C.A.L. Bailer-Jones,et al.  An introduction to artificial neural networks , 2001 .

[12]  Matthew Walker.  Introduction to Genetic Programming , 2001 .

[13]  Risto Miikkulainen,et al.  Discovering Complex Othello Strategies through Evolutionary Neural Networks , 1995, Connect. Sci..

[14]  Huayang Xie,et al.  An Analysis of Selection in Genetic Programming , 2009 .

[15]  Gary Montague,et al.  Genetic programming: an introduction and survey of applications , 1997 .

[16]  Michael Hitchens.  B.J.'s family: a survey of First Person Shooters and their avatars , 2011, Game Stud..

[17]  Chang Kee Tong,et al.  Game AI generation using evolutionary multi-objective optimization , 2012, 2012 IEEE Congress on Evolutionary Computation.

[18]  Daniele Loiacono,et al.  Learning to overtake in TORCS using simple reinforcement learning , 2010, IEEE Congress on Evolutionary Computation.

[19]  Moshe Sipper,et al.  GP-Robocode: Using Genetic Programming to Evolve Robocode Players , 2005, EuroGP.

[20]  W S McCulloch,et al.  A logical calculus of the ideas immanent in nervous activity , 1990, The Philosophy of Artificial Intelligence.

[21]  Simon M. Lucas,et al.  Ms Pac-Man versus Ghost Team CEC 2011 competition , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[22]  Moshe Sipper,et al.  Attaining Human-Competitive Game Playing with Genetic Programming , 2006, ACRI.

[23]  David R. Munroe.  Genetic programming: the ratio of crossover to mutation as a function of time , 2004 .

[24]  Moshe Sipper,et al.  Using GP-Gammon: Using Genetic Programming to Evolve Backgammon Players , 2005, EuroGP.

[25]  D. B. Fogel,et al.  Using evolutionary programing to create neural networks that are capable of playing tic-tac-toe , 1993, IEEE International Conference on Neural Networks.