Generating Interactive Worlds with Text

Procedurally generating cohesive and interesting game environments is challenging and time-consuming. In order for the relationships between the game elements to be natural, common-sense has to be encoded into arrangement of the elements. In this work, we investigate a machine learning approach for world creation using content from the multi-player text adventure game environment LIGHT. We introduce neural network based models to compositionally arrange locations, characters, and objects into a coherent whole. In addition to creating worlds based on existing elements, our models can generate new game content. Humans can also leverage our models to interactively aid in worldbuilding. We show that the game environments created with our approach are cohesive, diverse, and preferred by human evaluators compared to other machine learning based world construction algorithms.

[1]  Yejin Choi,et al.  Generating Topical Poetry , 2016, EMNLP.

[2]  Ashutosh Modi,et al.  Domain Authoring Assistant for Intelligent Virtual Agent , 2019, AAMAS.

[3]  Julian Togelius,et al.  General Video Game Level Generation , 2016, GECCO.

[4]  Jochen Renz,et al.  Procedural Generation of Levels for Angry Birds Style Physics Games , 2021, AIIDE.

[5]  Matthew J. Hausknecht,et al.  TextWorld: A Learning Environment for Text-based Games , 2018, CGW@IJCAI.

[6]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[7]  Jan Kautz,et al.  High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[8]  Mike Preuss,et al.  Orchestrating Game Generation , 2019, IEEE Transactions on Games.

[9]  Jason Weston,et al.  Translating Embeddings for Modeling Multi-relational Data , 2013, NIPS.

[10]  Angela Fan,et al.  Controllable Abstractive Summarization , 2017, NMT@ACL.

[11]  Markus H. Gross,et al.  CARDINAL: Computer Assisted Authoring of Movie Scripts , 2018, IUI.

[12]  Jason Weston,et al.  What makes a good conversation? How controllable attributes affect human judgments , 2019, NAACL.

[13]  Ryan Cotterell,et al.  Gender Bias in Contextualized Word Embeddings , 2019, NAACL.

[14]  Joel Lehman,et al.  Combining Search-Based Procedural Content Generation and Social Gaming in the Petalz Video Game , 2012, AIIDE.

[15]  Jason Weston,et al.  Learning to Speak and Act in a Fantasy Text Adventure Game , 2019, EMNLP.

[16]  Jason Weston,et al.  StarSpace: Embed All The Things! , 2017, AAAI.

[17]  Julian Togelius,et al.  Constructive generation methods for dungeons and levels , 2016 .

[18]  Yann Dauphin,et al.  Hierarchical Neural Story Generation , 2018, ACL.

[19]  Jaakko Lehtinen,et al.  Progressive Growing of GANs for Improved Quality, Stability, and Variation , 2017, ICLR.

[20]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[21]  Mark O. Riedl,et al.  GenerationMania: Learning to Semantically Choreograph , 2018, AIIDE Workshops.

[22]  Jason Weston,et al.  Real-time Inference in Multi-sentence Tasks with Deep Pretrained Transformers , 2019, ArXiv.

[23]  Clara Fernández Vara Creating Dreamlike Game Worlds Through Procedural Content Generation , 2014 .

[24]  Julian Togelius,et al.  Murder Mystery Generation from Open Data , 2016, ICCC.

[25]  Gaëtan Hadjeres,et al.  Deep Learning Techniques for Music Generation - A Survey , 2017, ArXiv.

[26]  Julian Togelius,et al.  Computational Game Creativity , 2014, ICCC.

[27]  Mark O. Riedl,et al.  Playing Text-Adventure Games with Graph-Based Deep Reinforcement Learning , 2018, NAACL.

[28]  Richard S. Zemel,et al.  Understanding the Origins of Bias in Word Embeddings , 2018, ICML.

[29]  Yann LeCun,et al.  DeSIGN: Design Inspiration from Generative Networks , 2018, ECCV Workshops.

[30]  R.A.M. Van der Linden,et al.  Designing Procedurally Generated Levels , 2013, AI in the Game Design Process @ AIIDE.

[31]  Rico Sennrich,et al.  Neural Machine Translation of Rare Words with Subword Units , 2015, ACL.

[32]  Matthew Guzdial,et al.  Automated Game Design via Conceptual Expansion , 2018, AIIDE.

[33]  Leon A. Gatys,et al.  Image Style Transfer Using Convolutional Neural Networks , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Sanja Fidler,et al.  Be Your Own Prada: Fashion Synthesis with Structural Coherence , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).