Generating Content for Scenario-Based Serious-Games Using CrowdSourcing

Scenario-based serious-games have become an important tool for teaching new skills and capabilities. An important factor in the development of such systems is reducing the time and cost overheads in manually creating content for these scenarios. To address this challenge, we present Scenario-Gen, an automatic method for generating content about everyday activities through combining computer science techniques with the crowd. ScenarioGen uses the crowd in three different ways: to capture a database of scenarios of everyday activities, to generate a database of likely replacements for specific events within that scenario, and to evaluate the resulting scenarios. We evaluated ScenarioGen in 6 different content domains and found that it was consistently rated as coherent and consistent as the originally captured content. We also compared ScenarioGen's content to that created by traditional planning techniques. We found that both methods were equally effective in generating coherent and consistent scenarios, yet ScenarioGen's content was found to be more varied and easier to create.

[1]  Adrian Kügel,et al.  Improved Exact Solver for the Weighted MAX-SAT Problem , 2010, POS@SAT.

[2]  Tarja Susi,et al.  Serious Games : An Overview , 2007 .

[3]  Gerard Salton,et al.  Automatic Text Processing: The Transformation, Analysis, and Retrieval of Information by Computer , 1989 .

[4]  Boyang Li,et al.  Automated Scenario Adaptation in Support of Intelligent Tutoring Systems , 2011, FLAIRS Conference.

[5]  Joachim Biskup,et al.  Preprocessing for controlled query evaluation with availability policy , 2008, J. Comput. Secur..

[6]  Aad Slootmaker,et al.  EMERGO: A methodology and toolkit for developing serious games in higher education , 2008 .

[7]  Boyang Li,et al.  Story Generation with Crowdsourced Plot Graphs , 2013, AAAI.

[8]  James R. Meehan,et al.  TALE-SPIN, An Interactive Program that Writes Stories , 1977, IJCAI.

[9]  M. Rorvig Images of Similarity: A Visual Exploration of Optimal Similarity Metrics and Scaling Properties of TREC Topic-Document Sets , 1999, J. Am. Soc. Inf. Sci..

[10]  Michael D. Lee,et al.  An Empirical Evaluation of Models of Text Document Similarity , 2005 .

[11]  Hua Ai,et al.  A Case Base Planning Approach for Dialogue Generation in Digital Movie Design , 2011, ICCBR.

[12]  Dana S. Nau,et al.  SHOP2: An HTN Planning System , 2003, J. Artif. Intell. Res..

[13]  Joseph Bates,et al.  Guiding interactive drama , 1997 .

[14]  Stephen G. Ware,et al.  CPOCL: A Narrative Planner Supporting Conflict , 2011, AIIDE.

[15]  M Damashek,et al.  Gauging Similarity with n-Grams: Language-Independent Categorization of Text , 1995, Science.

[16]  H. Chad Lane,et al.  Virtual Humans with Secrets: Learning to Detect Verbal Cues to Deception , 2010, Intelligent Tutoring Systems.

[17]  Andrew Stern,et al.  Believable Agents and Intelligent Story Adaptation for Interactive Storytelling , 2006, TIDSE.

[18]  Albert Gatt,et al.  SimpleNLG: A Realisation Engine for Practical Applications , 2009, ENLG.

[19]  Mark O. Riedl,et al.  Automated scenario generation: toward tailored and optimized military training in virtual environments , 2012, FDG.

[20]  Alexandru Iosup,et al.  Procedural content generation for games: A survey , 2013, TOMCCAP.

[21]  Ron Artstein,et al.  An Integrated Authoring Tool for Tactical Questioning Dialogue Systems , 2009 .

[22]  Andrew Stern,et al.  Mixing Story and Simulation in Interactive Narrative , 2006, AIIDE.

[23]  Boyang Li,et al.  Learning Sociocultural Knowledge via Crowdsourced Examples , 2012, HCOMP@AAAI.

[24]  S. Turner Minstrel: a computer model of creativity and storytelling , 1993 .

[25]  Panagiotis G. Ipeirotis,et al.  Running Experiments on Amazon Mechanical Turk , 2010, Judgment and Decision Making.

[26]  A. Tversky Features of Similarity , 1977 .

[27]  Marc Cavazza,et al.  Character-Based Interactive Storytelling , 2002, IEEE Intell. Syst..