Using the Crowd to Generate Content for Scenario-Based Serious-Games

In the last decade, scenario-based serious-games have become a main tool for learning new skills and capabilities. An important factor in the development of such systems is the overhead in time, cost and human resources to manually create the content for these scenarios. We focus on how to create content for scenarios in medical, military, commerce and gaming applications where maintaining the integrity and coherence of the content is integral for the system's success. To do so, we present an automatic method for generating content about everyday activities through combining computer science techniques with the crowd. We use the crowd in three basic ways: to capture a database of scenarios of everyday activities, to generate a database of likely replacements for specific events within that scenario, and to evaluate the resulting scenarios. We found that the generated scenarios were rated as reliable and consistent by the crowd when compared to the scenarios that were originally captured. We also compared the generated scenarios to those created by traditional planning techniques. We found that both methods were equally effective in generated reliable and consistent scenarios, yet the main advantages of our approach is that the content we generate is more varied and much easier to create. We have begun integrating this approach within a scenario-based training application for novice investigators within the law enforcement departments to improve their questioning skills.

[1]  Marc Cavazza,et al.  Character-Based Interactive Storytelling , 2002, IEEE Intell. Syst..

[2]  Joachim Biskup,et al.  Controlled query evaluation for enforcing confidentiality in complete information systems , 2004, International Journal of Information Security.

[3]  S. Turner Minstrel: a computer model of creativity and storytelling , 1993 .

[4]  Boyang Li,et al.  Automated Scenario Adaptation in Support of Intelligent Tutoring Systems , 2011, FLAIRS Conference.

[5]  Robert Michael Young,et al.  Narrative Planning: Balancing Plot and Character , 2010, J. Artif. Intell. Res..

[6]  Norman I. Badler,et al.  Technologies for Interactive Digital Storytelling and Entertainment , 2004, Lecture Notes in Computer Science.

[7]  H. Chad Lane,et al.  Virtual Humans with Secrets: Learning to Detect Verbal Cues to Deception , 2010, Intelligent Tutoring Systems.

[8]  Andrew Stern,et al.  Believable Agents and Intelligent Story Adaptation for Interactive Storytelling , 2006, TIDSE.

[9]  Joachim Biskup,et al.  Preprocessing for controlled query evaluation with availability policy , 2008, J. Comput. Secur..

[10]  James R. Meehan,et al.  TALE-SPIN, An Interactive Program that Writes Stories , 1977, IJCAI.

[11]  Adrian Kügel,et al.  Improved Exact Solver for the Weighted MAX-SAT Problem , 2010, POS@SAT.

[12]  Hua Ai,et al.  A Case Base Planning Approach for Dialogue Generation in Digital Movie Design , 2011, ICCBR.

[13]  Dana S. Nau,et al.  SHOP2: An HTN Planning System , 2003, J. Artif. Intell. Res..

[14]  M. Schijven,et al.  Systematic review of serious games for medical education and surgical skills training , 2012, The British journal of surgery.

[15]  Tarja Susi,et al.  Serious Games : An Overview , 2007 .

[16]  Stephen G. Ware,et al.  CPOCL: A Narrative Planner Supporting Conflict , 2011, AIIDE.

[17]  Panagiotis G. Ipeirotis,et al.  Running Experiments on Amazon Mechanical Turk , 2010, Judgment and Decision Making.

[18]  Aad Slootmaker,et al.  EMERGO: A methodology and toolkit for developing serious games in higher education , 2008 .

[19]  A. F. Adams,et al.  The Survey , 2021, Dyslexia in Higher Education.

[20]  Joseph Bates,et al.  Guiding interactive drama , 1997 .

[21]  Ron Artstein,et al.  An Integrated Authoring Tool for Tactical Questioning Dialogue Systems , 2009 .

[22]  Leopoldo E. Bertossi,et al.  Consistent query answering in databases , 2006, SGMD.

[23]  Alexandru Iosup,et al.  Procedural content generation for games: A survey , 2013, TOMCCAP.

[24]  Aniket Kittur,et al.  Crowdsourcing user studies with Mechanical Turk , 2008, CHI.

[25]  Albert Gatt,et al.  SimpleNLG: A Realisation Engine for Practical Applications , 2009, ENLG.

[26]  Mark O. Riedl,et al.  Automated scenario generation: toward tailored and optimized military training in virtual environments , 2012, FDG.