Recognizing Player Goals in Open-Ended Digital Games with Markov Logic Networks

In digital games goal recognition centers on identifying the concrete objectives that a player is attempting identifying the concrete objectives that a player is attempting to achieve given a domain model and a sequence of actions in a virtual environment. Goal-recognition models in open-ended digital games introduce opportunities for adapting gameplay events based on the choices of individual players, as well as interpreting player behaviors during post hoc data mining analyses. However, goal recognition in open-ended games poses significant computational challenges, including inherent uncertainty, exploratory actions, and ill-defined goals. This chapter reports on an investigation of Markov logic networks (MLNs) for recognizing player goals in open-ended digital game environments with exploratory actions. The goal-recognition model was trained on a corpus collected from player interactions with an open-ended game-based learning environment known as C rystal I sland . We present experimental results, in which the goal-recognition model was compared to n -gram models. The findings suggest the proposed goal-recognition model yields significant accuracy gains beyond the n -gram models for predicting player goals in an open-ended digital game.

[1]  Gita Reese Sukthankar,et al.  A Real-Time Opponent Modeling System for Rush Football , 2011, IJCAI.

[2]  A. G. Amitha Perera,et al.  Video Activity Recognition in the Real World , 2008, AAAI.

[3]  Jeff Orkin,et al.  The Restaurant Game: Learning Social Behavior and Language from Thousands of Players Online , 2008, J. Game Dev..

[4]  W. Lewis Johnson,et al.  Serious Use of a Serious Game for Language Learning , 2007, AIED.

[5]  Nathan R. Sturtevant A Sparse Grid Representation for Dynamic Three-Dimensional Worlds , 2011, AIIDE.

[6]  Froduald Kabanza,et al.  Opponent Behaviour Recognition for Real-Time Strategy Games , 2010, Plan, Activity, and Intent Recognition.

[7]  Kevin Gold,et al.  Training Goal Recognition Online from Low-Level Inputs in an Action-Adventure Game , 2010, AIIDE.

[8]  Michael P. Wellman,et al.  Probabilistic State-Dependent Grammars for Plan Recognition , 2000, UAI.

[9]  Georgios N. Yannakakis Game AI revisited , 2012, CF '12.

[10]  Sebastian Riedel Improving the Accuracy and Efficiency of MAP Inference for Markov Logic , 2008, UAI.

[11]  Sandra Carberry,et al.  Techniques for Plan Recognition , 2001, User Modeling and User-Adapted Interaction.

[12]  Ryan Shaun Joazeiro de Baker,et al.  Off-task behavior in the cognitive tutor classroom: when students "game the system" , 2004, CHI.

[13]  Ben Taskar,et al.  Introduction to Statistical Relational Learning (Adaptive Computation and Machine Learning) , 2007 .

[14]  Rohit J. Kate and Raymond J. Mooney Probabilistic Abduction using Markov Logic Networks , 2009 .

[15]  Robert P. Goldman,et al.  A probabilistic plan recognition algorithm based on plan tree grammars , 2009, Artif. Intell..

[16]  K. Squire Open-Ended Video Games: A Model for Developing Learning for the Interactive Age , 2007 .

[17]  Hector Geffner,et al.  Probabilistic Plan Recognition Using Off-the-Shelf Classical Planners , 2010, AAAI.

[18]  Robert P. Goldman,et al.  A Bayesian Model of Plan Recognition , 1993, Artif. Intell..

[19]  Eric Horvitz,et al.  The Lumière Project: Bayesian User Modeling for Inferring the Goals and Needs of Software Users , 1998, UAI.

[20]  Jonathan P. Rowe,et al.  Integrating Learning, Problem Solving, and Engagement in Narrative-Centered Learning Environments , 2011, Int. J. Artif. Intell. Educ..

[21]  Hung Hai Bui,et al.  A General Model for Online Probabilistic Plan Recognition , 2003, IJCAI.

[22]  Cristina Conati,et al.  Using Bayesian Networks to Manage Uncertainty in Student Modeling , 2002, User Modeling and User-Adapted Interaction.

[23]  Boyang Li,et al.  An Offline Planning Approach to Game Plotline Adaptation , 2010, AIIDE.

[24]  Henry A. Kautz,et al.  Recognizing Multi-Agent Activities from GPS Data , 2010, AAAI.

[25]  Jonathan P. Rowe,et al.  Modeling User Knowledge with Dynamic Bayesian Networks in Interactive Narrative Environments , 2010, AIIDE.

[26]  Koby Crammer,et al.  Ultraconservative Online Algorithms for Multiclass Problems , 2001, J. Mach. Learn. Res..

[27]  Daniel Marcu,et al.  The rhetorical parsing of unrestricted texts: a surface-based approach , 2000, CL.

[28]  James C. Lester,et al.  Probabilistic Goal Recognition in Interactive Narrative Environments , 2006, AAAI.

[29]  John D. Lafferty,et al.  Inducing Features of Random Fields , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  N. S. Sridharan,et al.  The Plan Recognition Problem: An Intersection of Psychology and Artificial Intelligence , 1978, Artif. Intell..

[31]  Raymond J. Mooney,et al.  Abductive Markov Logic for Plan Recognition , 2011, Proceedings of the AAAI Conference on Artificial Intelligence.

[32]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[33]  James C. Lester,et al.  Evaluating the consequences of affective feedback in intelligent tutoring systems , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[34]  Henry A. Kautz,et al.  Generalized Plan Recognition , 1986, AAAI.

[35]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[36]  Matthew Richardson,et al.  Markov logic networks , 2006, Machine Learning.

[37]  Henry A. Kautz,et al.  Interactive activity recognition and prompting to assist people with cognitive disabilities , 2012, J. Ambient Intell. Smart Environ..

[38]  Robert Michael Young,et al.  Managing interaction between users and agents in a multi-agent storytelling environment , 2003, AAMAS '03.

[39]  James C. Lester,et al.  Real-Time Narrative-Centered Tutorial Planning for Story-Based Learning , 2012, ITS.

[40]  Qiang Yang,et al.  CIGAR: Concurrent and Interleaving Goal and Activity Recognition , 2008 .

[41]  Ingrid Zukerman,et al.  Bayesian Models for Keyhole Plan Recognition in an Adventure Game , 2004, User Modeling and User-Adapted Interaction.

[42]  Nate Blaylock,et al.  Corpus-based, Statistical Goal Recognition , 2003, IJCAI.