Ieee Transactions on Computational Intelligence and Ai in Games the 2014 General Video Game Playing Competition

This paper presents the framework, rules, games, controllers, and results of the first General Video Game Playing Competition, held at the IEEE Conference on Computational Intelligence and Games in 2014. The competition proposes the challenge of creating controllers for general video game play, where a single agent must be able to play many different games, some of them unknown to the participants at the time of submitting their entries. This test can be seen as an approximation of general artificial intelligence, as the amount of game-dependent heuristics needs to be severely limited. The games employed are stochastic real-time scenarios (where the time budget to provide the next action is measured in milliseconds) with different winning conditions, scoring mechanisms, sprite types, and available actions for the player. It is a responsibility of the agents to discover the mechanics of each game, the requirements to obtain a high score and the requisites to finally achieve victory. This paper describes all controllers submitted to the competition, with an in-depth description of four of them by their authors, including the winner and the runner-up entries of the contest. The paper also analyzes the performance of the different approaches submitted, and finally proposes future tracks for the competition.

[1]  Simon M. Lucas,et al.  Ms Pac-Man versus Ghost Team CEC 2011 competition , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[2]  Simon M. Lucas,et al.  A simple tree search method for playing Ms. Pac-Man , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[3]  Tom Schaul,et al.  A video game description language for model-based or interactive learning , 2013, 2013 IEEE Conference on Computational Inteligence in Games (CIG).

[4]  Santiago Ontañón,et al.  A Survey of Real-Time Strategy Game AI Research and Competition in StarCraft , 2013, IEEE Transactions on Computational Intelligence and AI in Games.

[5]  Julian Togelius,et al.  The 2009 Simulated Car Racing Championship , 2010, IEEE Transactions on Computational Intelligence and AI in Games.

[6]  Michael L. Littman,et al.  Bandit-Based Planning and Learning in Continuous-Action Markov Decision Processes , 2012, ICAPS.

[7]  Hiroyuki Iida,et al.  The Brain and Mind Sports Olympiad , 2013, J. Int. Comput. Games Assoc..

[8]  Simon M. Lucas,et al.  The physical travelling salesman problem: WCCI 2012 competition , 2012, 2012 IEEE Congress on Evolutionary Computation.

[9]  Frédéric Maire,et al.  Evolutionary Game Design , 2011, IEEE Transactions on Computational Intelligence and AI in Games.

[10]  Julian Togelius,et al.  A Card Game Description Language , 2013, EvoApplications.

[11]  Julian Togelius,et al.  An experiment in automatic game design , 2008, 2008 IEEE Symposium On Computational Intelligence and Games.

[12]  Peter Auer,et al.  Finite-time Analysis of the Multiarmed Bandit Problem , 2002, Machine Learning.

[13]  D. Fox Harrell,et al.  An approach to general videogame evaluation and automatic generation using a description language , 2014, 2014 IEEE Conference on Computational Intelligence and Games.

[14]  Michael R. Genesereth,et al.  General Game Playing: Overview of the AAAI Competition , 2005, AI Mag..

[15]  H. Berliner Computer chess , 1978, Nature.

[16]  Julian Togelius,et al.  Rules and Mechanics , 2016 .

[17]  Marc G. Bellemare,et al.  The Arcade Learning Environment: An Evaluation Platform for General Agents (Extended Abstract) , 2012, IJCAI.

[18]  Philip Hingston,et al.  A new design for a Turing Test for Bots , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[19]  Inman Harvey,et al.  The Microbial Genetic Algorithm , 2009, ECAL.

[20]  Csaba Szepesvári,et al.  Bandit Based Monte-Carlo Planning , 2006, ECML.

[21]  Julian Togelius,et al.  Measuring Intelligence through Games , 2011, ArXiv.

[22]  Steve Coles Chess , 1973, SGAR.

[23]  Julian Togelius,et al.  The Mario AI Championship , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[24]  Julian Togelius,et al.  The Mario AI Championship 2009-2012 , 2013, AI Mag..

[25]  Simon M. Lucas,et al.  A Survey of Monte Carlo Tree Search Methods , 2012, IEEE Transactions on Computational Intelligence and AI in Games.

[26]  Julian Togelius,et al.  Towards a Video Game Description Language , 2013, Artificial and Computational Intelligence in Games.

[27]  Doina Precup,et al.  Between MDPs and Semi-MDPs: A Framework for Temporal Abstraction in Reinforcement Learning , 1999, Artif. Intell..

[28]  Gary B. Parker,et al.  Evolving Parameters for Xpilot Combat Agents , 2007, 2007 IEEE Symposium on Computational Intelligence and Games.

[29]  Simon M. Lucas,et al.  Predicting Dominance Rankings for Score-Based Games , 2016, IEEE Transactions on Computational Intelligence and AI in Games.

[30]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[31]  Julian Togelius,et al.  Exploring a large space of small games , 2014, 2014 IEEE Conference on Computational Intelligence and Games.