Tribes: A New Turn-Based Strategy Game for AI Research

This paper introduces Tribes, a new turn-based strategy game framework. Tribes is a multi-player, multi-agent, stochastic and partially observable game that involves strategic and tactical combat decisions. A good playing strategy requires the management of a technology tree, build orders and economy. The framework provides a Forward Model, which can be used by Statistical Forward Planning methods. This paper describes the framework and the opportunities for Game AI research it brings. We further provide an analysis on the action space of this game, as well as benchmarking a series of agents (rule based, one step look-ahead, Monte Carlo, Monte Carlo Tree Search, and Rolling Horizon Evolution) to study their relative playing strength. Results show that although some of these agents can play at a decent level, they are still far from human playing strength.

[1]  Simon M. Lucas,et al.  Efficient Heuristic Policy Optimisation for a Challenging Strategic Card Game , 2020, EvoApplications.

[2]  Julian Togelius,et al.  Online Evolution for Multi-action Adversarial Games , 2016, EvoApplications.

[3]  H. Jaap van den Herik,et al.  Progressive Strategies for Monte-Carlo Tree Search , 2008 .

[4]  I. Watson,et al.  Optimization in Strategy Games : Using Genetic Algorithms to Optimize City Development in FreeCiv , 2009 .

[5]  Simon M. Lucas,et al.  A Survey of Monte Carlo Tree Search Methods , 2012, IEEE Transactions on Computational Intelligence and AI in Games.

[6]  Simon M. Lucas,et al.  Analysis of Vanilla Rolling Horizon Evolution Parameters in General Video Game Playing , 2017, EvoApplications.

[7]  Julian Togelius,et al.  Blood Bowl: A New Board Game Challenge and Competition for AI , 2019, 2019 IEEE Conference on Games (CoG).

[8]  Demis Hassabis,et al.  Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm , 2017, ArXiv.

[9]  Simon M. Lucas,et al.  Rolling horizon evolution versus tree search for navigation in single-player real-time games , 2013, GECCO '13.

[10]  Santiago Ontañón,et al.  A Survey of Real-Time Strategy Game AI Research and Competition in StarCraft , 2013, IEEE Transactions on Computational Intelligence and AI in Games.

[11]  Ian D. Watson,et al.  Using reinforcement learning for city site selection in the turn-based strategy game Civilization IV , 2008, 2008 IEEE Symposium On Computational Intelligence and Games.

[12]  FreeCiv Learner : A Machine Learning Project Utilizing Genetic Algorithms , 2007 .

[13]  Santiago Ontañón,et al.  The First microRTS Artificial Intelligence Competition , 2018, AI Mag..

[14]  Julian Togelius,et al.  Playing Multiaction Adversarial Games: Online Evolutionary Planning Versus Tree Search , 2018, IEEE Transactions on Games.

[15]  Peter I. Cowling,et al.  Evolutionary MCTS for Multi-Action Adversarial Games , 2018, 2018 IEEE Conference on Computational Intelligence and Games (CIG).

[16]  Sylvain Gelly,et al.  Exploration exploitation in Go: UCT for Monte-Carlo Go , 2006, NIPS 2006.