Bootstrapping Conditional GANs for Video Game Level Generation

Generative Adversarial Networks (GANs) have shown impressive results for image generation. However, GANs face challenges in generating contents with certain types of constraints, such as game levels. Specifically, it is difficult to generate levels that have aesthetic appeal and are playable at the same time. Additionally, because training data usually is limited, it is challenging to generate unique levels with current GANs. In this paper, we propose a new GAN architecture named Conditional Embedding Self-Attention Generative Adversarial Net-work (CESAGAN) and a new bootstrapping training procedure. The CESAGAN is a modification of the self-attention GAN that incorporates an embedding feature vector input to condition the training of the discriminator and generator. This allows the network to model non-local dependency between game objects, and to count objects. Additionally, to reduce the number of levels necessary to train the GAN, we propose a bootstrapping mechanism in which playable generated levels are added to the training set. The results demonstrate that the new approach does not only generate a larger number of levels that are playable but also generates fewer duplicate levels compared to a standard GAN.

[1]  Julian Togelius,et al.  DeepMasterPrints: Generating MasterPrints for Dictionary Attacks via Latent Variable Evolution* , 2017, 2018 IEEE 9th International Conference on Biometrics Theory, Applications and Systems (BTAS).

[2]  Jacob Abernethy,et al.  On Convergence and Stability of GANs , 2018 .

[3]  Santiago Ontañón,et al.  Controllable Procedural Content Generation via Constrained Multi-Dimensional Markov Chain Sampling , 2016, IJCAI.

[4]  Jürgen Schmidhuber,et al.  Finding temporal structure in music: blues improvisation with LSTM recurrent networks , 2002, Proceedings of the 12th IEEE Workshop on Neural Networks for Signal Processing.

[5]  Julian Togelius,et al.  Ieee Transactions on Computational Intelligence and Ai in Games the 2014 General Video Game Playing Competition , 2022 .

[6]  Julian Togelius,et al.  Predicting Resource Locations in Game Maps Using Deep Convolutional Neural Networks , 2021, Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment.

[7]  Julian Togelius,et al.  DeepMasterPrint: Generating Fingerprints for Presentation Attacks , 2017, ArXiv.

[8]  Mirella Lapata,et al.  Long Short-Term Memory-Networks for Machine Reading , 2016, EMNLP.

[9]  Edoardo Giacomello,et al.  DOOM Level Generation Using Generative Adversarial Networks , 2018, 2018 IEEE Games, Entertainment, Media Conference (GEM).

[10]  Julian Togelius,et al.  General Video Game AI: Competition, Challenges and Opportunities , 2016, AAAI.

[11]  Julian Togelius,et al.  Towards a Video Game Description Language , 2013, Artificial and Computational Intelligence in Games.

[12]  Cheng Guo,et al.  Entity Embeddings of Categorical Variables , 2016, ArXiv.

[13]  Julian Togelius,et al.  Search-Based Procedural Content Generation: A Taxonomy and Survey , 2011, IEEE Transactions on Computational Intelligence and AI in Games.

[14]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[15]  Simon M. Lucas,et al.  Evolving mario levels in the latent space of a deep convolutional generative adversarial network , 2018, GECCO.

[16]  Julian Togelius,et al.  General video game rule generation , 2017, 2017 IEEE Conference on Computational Intelligence and Games (CIG).

[17]  Rubén Rodríguez Torrado,et al.  On The Stochastic Response Surface Methodology For The Determination Of The Development Plan Of An Oil & Gas Field , 2013 .

[18]  Michael Mateas,et al.  Mystical Tutor: A Magic: The Gathering Design Assistant via Denoising Sequence-to-Sequence Learning , 2021, AIIDE.

[19]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[20]  Claudio Fabiano Motta Toledo,et al.  A search-based approach for generating Angry Birds levels , 2014, 2014 IEEE Conference on Computational Intelligence and Games.

[21]  Marc G. Bellemare,et al.  The Arcade Learning Environment: An Evaluation Platform for General Agents , 2012, J. Artif. Intell. Res..

[22]  Julian Togelius,et al.  Patterns and procedural content generation: revisiting Mario in world 1 level 1 , 2012, DPG '12.

[23]  Dustin Tran,et al.  Image Transformer , 2018, ICML.

[24]  Simon Osindero,et al.  Conditional Generative Adversarial Nets , 2014, ArXiv.

[25]  Michael Mateas,et al.  Super Mario as a String: Platformer Level Generation Via LSTMs , 2016, DiGRA/FDG.

[26]  Julian Togelius,et al.  AtDELFI: automatically designing legible, full instructions for games , 2018, FDG.

[27]  Wojciech Zaremba,et al.  Improved Techniques for Training GANs , 2016, NIPS.

[28]  Julian Togelius,et al.  Linear levels through n-grams , 2014, MindTrek.

[29]  Joshua Taylor,et al.  Procedural Generation of Sokoban Levels , 2011 .

[30]  David J. Fleet,et al.  Hamming Distance Metric Learning , 2012, NIPS.

[31]  Julian Togelius,et al.  Automated Playtesting With Procedural Personas Through MCTS With Evolved Heuristics , 2018, IEEE Transactions on Games.

[32]  Ahmed Khalifa,et al.  Automatic Puzzle Level Generation: A General Approach using a Description Language , 2015 .

[33]  Simon M. Lucas,et al.  The 2016 Two-Player GVGAI Competition , 2018, IEEE Transactions on Games.

[34]  Han Zhang,et al.  Self-Attention Generative Adversarial Networks , 2018, ICML.

[35]  Eric Xing,et al.  Deep Generative Models with Learnable Knowledge Constraints , 2018, NeurIPS.

[36]  Jae Hyun Lim,et al.  Geometric GAN , 2017, ArXiv.

[37]  Julian Togelius,et al.  Procedural Content Generation via Machine Learning (PCGML) , 2017, IEEE Transactions on Games.

[38]  Julian Togelius,et al.  General Video Game AI: A Multitrack Framework for Evaluating Agents, Games, and Content Generation Algorithms , 2018, IEEE Transactions on Games.

[39]  Julian Togelius,et al.  Procedural Content Generation in Games , 2016, Computational Synthesis and Creative Systems.

[40]  Julian Togelius,et al.  General Video Game Level Generation , 2016, GECCO.

[41]  Jaakko Lehtinen,et al.  Progressive Growing of GANs for Improved Quality, Stability, and Variation , 2017, ICLR.