A Generalized Multidimensional Evaluation Framework for Player Goal Recognition

Recent years have seen a growing interest in player modeling, which supports the creation of player-adaptive digital games. A central problem of player modeling is goal recognition, which aims to recognize players’ intentions from observable gameplay behaviors. Player goal recognition offers the promise of enabling games to dynamically adjust challenge levels, perform procedural content generation, and create believable NPC interactions. A growing body of work is investigating a wide range of machine learning-based goal recognition models. In this paper, we introduce GOALIE, a multidimensional framework for evaluating player goal recognition models. The framework integrates multiple metrics for player goal recognition models, including two novel metrics, n-early convergence rate and standardized convergence point . We demonstrate the application of the GOALIE framework with the evaluation of several player goal recognition models, including Markov logic network-based, deep feedforward neural network-based, and long short-term memory network-based goal recognizers on two different educational games. The results suggest that GOALIE effectively captures goal recognition behaviors that are key to next-generation player modeling.

[1]  Rafael Bidarra,et al.  In Press: Ieee Transactions on Computational Intelligence and Ai in Games Adaptivity Challenges in Games and Simulations: a Survey , 2022 .

[2]  Daniele Loiacono,et al.  Player Modeling , 2013, Artificial and Computational Intelligence in Games.

[3]  Jonathan P. Rowe,et al.  Integrating Learning, Problem Solving, and Engagement in Narrative-Centered Learning Environments , 2011, Int. J. Artif. Intell. Educ..

[4]  Hugo Larochelle,et al.  Using a Recursive Neural Network to Learn an Agent's Decision Model for Plan Recognition , 2015, IJCAI.

[5]  James C. Lester,et al.  Probabilistic Goal Recognition in Interactive Narrative Environments , 2006, AAAI.

[6]  Gabriel Synnaeve,et al.  A Bayesian model for opening prediction in RTS games with application to StarCraft , 2011, 2011 IEEE Conference on Computational Intelligence and Games (CIG'11).

[7]  Vadim Bulitko,et al.  Interactive Narrative: An Intelligent Systems Approach , 2012, AI Mag..

[8]  Jonathan P. Rowe,et al.  Deep Learning-Based Goal Recognition in Open-Ended Digital Games , 2014, AIIDE.

[9]  Robert P. Goldman,et al.  A probabilistic plan recognition algorithm based on plan tree grammars , 2009, Artif. Intell..

[10]  Stephen G. Ware,et al.  A Survey and Analysis of Techniques for Player Behavior Prediction in Massively Multiplayer Online Role-Playing Games , 2015, IEEE Transactions on Emerging Topics in Computing.

[11]  Julian Togelius,et al.  Procedural Content Generation in Games , 2016, Computational Synthesis and Creative Systems.

[12]  Raymond J. Mooney,et al.  Plan, Activity, and Intent Recognition: Theory and Practice , 2014 .

[13]  Yoshua Bengio,et al.  A Neural Probabilistic Language Model , 2003, J. Mach. Learn. Res..

[14]  Chris L. Baker,et al.  Action understanding as inverse planning , 2009, Cognition.

[15]  Pedro M. Domingos,et al.  Unifying Logical and Statistical AI , 2006, 2016 31st Annual ACM/IEEE Symposium on Logic in Computer Science (LICS).

[16]  Padraig Cunningham,et al.  Case-Based Plan Recognition in Computer Games , 2003, ICCBR.

[17]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[18]  Nate Blaylock,et al.  Corpus-based, Statistical Goal Recognition , 2003, IJCAI.

[19]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[20]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[21]  Hector Geffner,et al.  Goal Recognition over POMDPs: Inferring the Intention of a POMDP Agent , 2011, IJCAI.

[22]  James C. Lester,et al.  Designing game-based learning environments for elementary science education: A narrative-centered learning perspective , 2014, Inf. Sci..

[23]  Jonathan P. Rowe,et al.  Player Goal Recognition in Open-World Digital Games with Long Short-Term Memory Networks , 2016, IJCAI.

[24]  Jonathan P. Rowe,et al.  Generalizability of Goal Recognition Models in Narrative-Centered Learning Environments , 2014, UMAP.

[25]  Alex Graves,et al.  Supervised Sequence Labelling with Recurrent Neural Networks , 2012, Studies in Computational Intelligence.

[26]  Jonathan P. Rowe,et al.  Goal Recognition with Markov Logic Networks for Player-Adaptive Games , 2011, AIIDE.