Exploring the hearthstone deck space

A significant issue in game balancing is understanding the game itself. For simple games end-to-end optimization approaches can help explore the game's design space, but for more complex games it is necessary to isolate and explore its parts. Hearthstone, Blizzard's popular two-player turn-taking adversarial card game, has two distinct game-playing challenges: choosing when and how to play cards, and selecting which cards a player can access during the game (deckbuilding). Focusing on deckbuilding, four experiments are conducted to computationally explore the design of Hearthstone. They address the difficulty of constructing good decks, the specificity and generality of decks, and the transitivity of decks. Results suggest it is possible to find decks with an Evolution Strategy (ES) that convincingly beat other decks available in the game, but that they also exhibit some generality (i.e. they perform well against unknown decks). Interestingly, a second ES experiment is performed where decks are evolved against opponents playing the originally evolved decks. Since the originally evolved decks beat the starter decks, and the twice evolved decks beat the originally evolved decks, some degree of transitivity of the deck space is shown. While only a preliminary study with restrictive conditions, this paper paves the way for future work computationally identifying properties of cards important for different gameplay strategies and helping players build decks to fit their personal playstyles without the need for in-depth domain knowledge.

[1]  Juan Julián Merelo Guervós,et al.  Evolutionary deckbuilding in hearthstone , 2016, 2016 IEEE Conference on Computational Intelligence and Games (CIG).

[2]  Julian Togelius,et al.  AI-based playtesting of contemporary board games , 2017, FDG.

[3]  Michael Buro,et al.  Improving hearthstone AI by learning high-level rollout policies and bucketing chance node events , 2017, 2017 IEEE Conference on Computational Intelligence and Games (CIG).

[4]  Jan Jakubik Evaluation of hearthstone game states with neural networks and sparse autoencoding , 2017, 2017 Federated Conference on Computer Science and Information Systems (FedCSIS).

[5]  Andrzej Janusz,et al.  Helping AI to Play Hearthstone: AAIA'17 Data Mining Challenge , 2017, 2017 Federated Conference on Computer Science and Information Systems (FedCSIS).

[6]  Keshav P. Dahal,et al.  Symbolic Reasoning for Hearthstone , 2018, IEEE Transactions on Games.

[7]  Julian Togelius,et al.  Procedural Personas as Critics for Dungeon Generation , 2015, EvoApplications.

[8]  Amy K. Hoover,et al.  AI-assisted analysis of player strategy across level progressions in a puzzle game , 2017, FDG.

[9]  Mark O. Riedl,et al.  Monte-Carlo Tree Search for Simulation-based Strategy Analysis , 2019, ArXiv.

[10]  Francisco S. Melo,et al.  Monte Carlo tree search experiments in hearthstone , 2017, 2017 IEEE Conference on Computational Intelligence and Games (CIG).

[11]  Douglas G. Altman,et al.  Practical statistics for medical research , 1990 .

[12]  Sverre Johann Bjørke,et al.  Deckbuilding in Magic: The Gathering Using a Genetic Algorithm , 2017 .

[13]  Julian Togelius,et al.  Search-Based Procedural Content Generation: A Taxonomy and Survey , 2011, IEEE Transactions on Computational Intelligence and AI in Games.

[14]  Zoran Popovic,et al.  Evaluating Competitive Game Balance with Restricted Play , 2012, AIIDE.

[15]  Julian Togelius,et al.  Evolving card sets towards balancing dominion , 2012, 2012 IEEE Congress on Evolutionary Computation.

[16]  Julian Togelius,et al.  General Video Game Evaluation Using Relative Algorithm Performance Profiles , 2015, EvoApplications.

[17]  Günter Rudolph,et al.  Contemporary Evolution Strategies , 1995, ECAL.

[18]  Joris Dormans,et al.  Simulating Mechanics to Study Emergence in Games , 2011, IDP@AIIDE.

[19]  Günter Rudolph,et al.  Demonstrating the Feasibility of Automatic Game Balancing , 2016, GECCO.

[20]  J. Togelius,et al.  Discovering Unique Game Variants , 2015 .

[21]  Joe Marks,et al.  Automatic Design of Balanced Board Games , 2007, AIIDE.