Toward Automated Quest Generation in Text-Adventure Games

Interactive fictions, or text-adventures, are games in which a player interacts with a world entirely through textual descriptions and text actions. Text-adventure games are typically structured as puzzles or quests wherein the player must execute certain actions in a certain order to succeed. In this paper, we consider the problem of procedurally generating a quest, defined as a series of actions required to progress towards a goal, in a text-adventure game. Quest generation in text environments is challenging because they must be semantically coherent. We present and evaluate two quest generation techniques: (1) a Markov model, and (2) a neural generative model. We specifically look at generating quests about cooking and train our models on recipe data. We evaluate our techniques with human participant studies looking at perceived creativity and coherence.

[1]  Yejin Choi,et al.  The Curious Case of Neural Text Degeneration , 2019, ICLR.

[2]  Boyang Li,et al.  Crowdsourcing Open Interactive Narrative , 2015, FDG.

[3]  Christopher D. Manning,et al.  Leveraging Linguistic Structure For Open Domain Information Extraction , 2015, ACL.

[4]  Matthew J. Hausknecht,et al.  NAIL: A General Interactive Fiction Agent , 2019, ArXiv.

[5]  Jianfeng Gao,et al.  Deep Reinforcement Learning with a Natural Language Action Space , 2015, ACL.

[6]  Jason Weston,et al.  Towards Understanding Situated Natural Language , 2010, AISTATS.

[7]  Ilya Sutskever,et al.  Language Models are Unsupervised Multitask Learners , 2019 .

[8]  Mark O. Riedl,et al.  Crowdsourcing Narrative Intelligence , 2012 .

[9]  Brian Magerko,et al.  Formally modeling pretend object play , 2011, C&C '11.

[10]  Jason Weston,et al.  Generating Interactive Worlds with Text , 2019, AAAI.

[11]  T. Veale,et al.  Computation and Blending , 2001 .

[12]  Mohan D. Pant,et al.  A Method for Simulating Nonnormal Distributions with Specified L-Skew, L-Kurtosis, and L-Correlation , 2012 .

[13]  Matthew J. Hausknecht,et al.  Graph Constrained Reinforcement Learning for Natural Language Action Spaces , 2020, ICLR.

[14]  Jason Weston,et al.  Mastering the Dungeon: Grounded Language Learning by Mechanical Turker Descent , 2017, ICLR.

[15]  Shie Mannor,et al.  Learning How Not to Act in Text-based Games , 2018, ICLR.

[16]  Jason Weston,et al.  Learning to Speak and Act in a Fantasy Text Adventure Game , 2019, EMNLP.

[17]  Regina Barzilay,et al.  Language Understanding for Text-based Games using Deep Reinforcement Learning , 2015, EMNLP.

[18]  Mark O. Riedl,et al.  Playing Text-Adventure Games with Graph-Based Deep Reinforcement Learning , 2018, NAACL.

[19]  Brian Magerko,et al.  A Conceptual Blending Approach to the Generation of Cognitive Scripts for Interactive Narrative , 2013, Intelligent Narrative Technologies.

[20]  Mark O. Riedl,et al.  Toward supporting stories with procedurally generated game worlds , 2011, 2011 IEEE Conference on Computational Intelligence and Games (CIG'11).

[21]  Mark O. Riedl,et al.  Transfer in Deep Reinforcement Learning Using Knowledge Graphs , 2019, EMNLP.

[22]  J. Bruner.  The Narrative Construction of Reality , 1991, Critical Inquiry.

[23]  Margaret A. Boden,et al.  Creativity in a nutshell , 2007, Think.

[24]  Xinyu Wang,et al.  Predicting Generated Story Quality with Quantitative Measures , 2018, AIIDE.

[25]  Ronen Tamari,et al.  Playing by the Book: An Interactive Game Approach for Action Graph Extraction from Text , 2018 .

[26]  Allen I. Fleishman.  A method for simulating non-normal distributions , 1978 .

[27]  Mark O. Riedl,et al.  Bringing Stories Alive: Generating Interactive Fiction Worlds , 2020, AIIDE.

[28]  David Wingate,et al.  What Can You Do with a Rock? Affordance Extraction via Word Embeddings , 2017, IJCAI.

[29]  Judith R. Johnston,et al.  Narratives: Twenty‐Five Years Later , 2008 .

[30]  Matthew J. Hausknecht,et al.  Interactive Fiction Games: A Colossal Adventure , 2020, AAAI.

[31]  Brian Magerko,et al.  An Overview of Computational Co-creative Pretend Play with a Human , 2014 .

[32]  Marc-Alexandre Côté,et al.  Towards Solving Text-based Games by Producing Adaptive Action Spaces , 2018, ArXiv.

[33]  Matthew J. Hausknecht,et al.  TextWorld: A Learning Environment for Text-based Games , 2018, CGW@IJCAI.

[34]  Georgios N. Yannakakis,et al.  Suggesting New Plot Elements for an Interactive Story , 2011, Intelligent Narrative Technologies.