Ludii as a Competition Platform

Ludii is a general game system being developed as part of the ERC-funded Digital Ludeme Project (DLP). While its primary aim is to model, play, and analyse the full range of traditional strategy games, Ludii also has the potential to support a wide range of AI research topics and competitions. This paper describes some of the future competitions and challenges that we intend to run using the Ludii system, highlighting some of its most important aspects that can potentially lead to many algorithm improvements and new avenues of research. We compare and contrast our proposed competition motivations, goals and frameworks against those of existing general game playing competitions, addressing the strengths and weaknesses of each platform.

[1]  Julian Togelius,et al.  Ieee Transactions on Computational Intelligence and Ai in Games the 2014 General Video Game Playing Competition , 2022 .

[2]  Demis Hassabis,et al.  Mastering the game of Go without human knowledge , 2017, Nature.

[3]  Julian Togelius,et al.  Guest Editorial: General Games , 2014, IEEE Trans. Comput. Intell. AI Games.

[4]  S. Barry Cooper,et al.  Digital Computers Applied to Games , 2013 .

[5]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[6]  Dennis J. N. J. Soemers,et al.  An Empirical Evaluation of Two General Game Systems: Ludii and RBG , 2019, 2019 IEEE Conference on Games (CoG).

[7]  Simon M. Lucas,et al.  General Video Game for 2 players: Framework and competition , 2016, 2016 8th Computer Science and Electronic Engineering (CEEC).

[8]  Simon M. Lucas,et al.  Ms Pac-Man versus Ghost Team CEC 2011 competition , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[9]  Sanaz Mostaghim,et al.  Procedural level generation with answer set programming for general Video Game playing , 2015, 2015 7th Computer Science and Electronic Engineering Conference (CEEC).

[10]  Demis Hassabis,et al.  A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play , 2018, Science.

[11]  Peng Zhang,et al.  The 2017 AIBIRDS Competition , 2018, ArXiv.

[12]  Digital Computers Applied to Games. Faster Than Thought , 2011 .

[13]  Neil Burch,et al.  Heads-up limit hold’em poker is solved , 2015, Science.

[14]  Tom Schaul,et al.  A video game description language for model-based or interactive learning , 2013, 2013 IEEE Conference on Computational Inteligence in Games (CIG).

[15]  Julian Togelius,et al.  How to Run a Successful Game-Based AI Competition , 2016, IEEE Transactions on Computational Intelligence and AI in Games.

[16]  Controlling Unreal Tournament 2004 Bots with the Logic-based Action Language GOLOG , 2005, AIIDE.

[17]  Julian Togelius,et al.  AI Researchers, Video Games are your Friends! , 2015, IJCCI.

[18]  Julian Togelius,et al.  General Video Game AI: Competition, Challenges and Opportunities , 2016, AAAI.

[19]  Joel Lehman and Risto Miikkulainen.  General Video Game Playing as a Benchmark for Human-Competitive AI , 2015 .

[20]  Jochen Renz,et al.  Deceptive angry birds: towards smarter game-playing agents , 2018, FDG.

[21]  Marlos C. Machado,et al.  Revisiting the Arcade Learning Environment: Evaluation Protocols and Open Problems for General Agents , 2017, J. Artif. Intell. Res..

[22]  Alexandru Iosup,et al.  Procedural content generation for games: A survey , 2013, TOMCCAP.

[23]  Julian Togelius,et al.  Deceptive Games , 2018, EvoApplications.

[24]  Gerald Tesauro,et al.  Temporal Difference Learning and TD-Gammon , 1995, J. Int. Comput. Games Assoc..

[25]  Michael Thielscher,et al.  GDL-III: A Description Language for Epistemic General Game Playing , 2017, IJCAI.

[26]  Omar Syed,et al.  ARIMAA - A NEW GAME DESIGNED TO BE DIFFICULT FOR COMPUTERS , 2003 .

[27]  Simon M. Lucas,et al.  Introducing real world physics and macro-actions to general video game ai , 2017, 2017 IEEE Conference on Computational Intelligence and Games (CIG).

[28]  Julian Togelius,et al.  Towards automatic personalised content creation for racing games , 2007, 2007 IEEE Symposium on Computational Intelligence and Games.

[29]  Marc G. Bellemare,et al.  The Arcade Learning Environment: An Evaluation Platform for General Agents , 2012, J. Artif. Intell. Res..

[30]  Jacek Mandziuk,et al.  Towards Cognitively Plausible Game Playing Systems , 2011, IEEE Computational Intelligence Magazine.

[31]  Julian Togelius,et al.  General Video Game AI: A Multitrack Framework for Evaluating Agents, Games, and Content Generation Algorithms , 2018, IEEE Transactions on Games.

[32]  Santiago Ontañón,et al.  A Survey of Real-Time Strategy Game AI Research and Competition in StarCraft , 2013, IEEE Transactions on Computational Intelligence and AI in Games.

[33]  Julian Togelius,et al.  Search-Based Procedural Content Generation: A Taxonomy and Survey , 2011, IEEE Transactions on Computational Intelligence and AI in Games.

[34]  Risto Miikkulainen,et al.  General Video Game Playing , 2013, Artificial and Computational Intelligence in Games.

[35]  Dennis J. N. J. Soemers,et al.  An Overview of the Ludii General Game System , 2019, 2019 IEEE Conference on Games (CoG).

[36]  Noam Brown,et al.  Superhuman AI for heads-up no-limit poker: Libratus beats top professionals , 2018, Science.

[37]  Julian Togelius,et al.  General Video Game Level Generation , 2016, GECCO.

[38]  Stephan Schiffel,et al.  Representing and Reasoning About the Rules of General Games With Imperfect Information , 2014, J. Artif. Intell. Res..

[39]  Wiering,et al.  Learning to Play Draughts using temporal difference learning with neural networks and databases , 2004 .

[40]  Cameron Browne,et al.  A Class Grammar for General Games , 2016, Computers and Games.

[41]  Julian Togelius,et al.  The Mario AI Benchmark and Competitions , 2012, IEEE Transactions on Computational Intelligence and AI in Games.

[42]  Simon M. Lucas,et al.  The 2016 Two-Player GVGAI Competition , 2018, IEEE Transactions on Games.

[43]  Kyung-Joong Kim,et al.  Recent Advances in General Game Playing , 2015, TheScientificWorldJournal.

[44]  Dennis J. N. J. Soemers,et al.  Ludii - The Ludemic General Game System , 2019, ECAI.

[45]  Julian Togelius,et al.  AtDELFI: automatically designing legible, full instructions for games , 2018, FDG.

[46]  Keshav P. Dahal,et al.  Symbolic Reasoning for Hearthstone , 2018, IEEE Transactions on Games.

[47]  Julian Togelius,et al.  Towards generating arcade game rules with VGDL , 2015, 2015 IEEE Conference on Computational Intelligence and Games (CIG).

[48]  Julian Togelius,et al.  General video game rule generation , 2017, 2017 IEEE Conference on Computational Intelligence and Games (CIG).

[49]  Michael R. Genesereth,et al.  General Game Playing: Overview of the AAAI Competition , 2005, AI Mag..

[50]  Ian D. Watson,et al.  Computer poker: A review , 2011, Artif. Intell..

[51]  Cameron Browne,et al.  Modern Techniques for Ancient Games , 2018, 2018 IEEE Conference on Computational Intelligence and Games (CIG).

[52]  Wojciech Jaskowski,et al.  ViZDoom: A Doom-based AI research platform for visual reinforcement learning , 2016, 2016 IEEE Conference on Computational Intelligence and Games (CIG).

[53]  Michael R. Genesereth,et al.  The International General Game Playing Competition , 2013, AI Mag..

[54]  Matthew C. Gombolay,et al.  ProLoNets: Neural-encoding Human Experts' Domain Knowledge to Warm Start Reinforcement Learning , 2019, ArXiv.

[55]  Chris Martens,et al.  An intentional AI for hanabi , 2017, 2017 IEEE Conference on Computational Intelligence and Games (CIG).