Detecting long-range cause-effect relationships in game provenance graphs with graph-based representation learning

Abstract Game Analytics comprises a set of techniques to analyze both the game quality and player behavior. To succeed in Game Analytics, it is essential to identify what is happening in a game (an effect) and track its causes. Thus, game provenance graph tools have been proposed to capture cause-and-effect relationships occurring in a gameplay session to assist the game design process. However, since game provenance data capture is guided by a set of strict predefined rules established by the game developers, the detection of long-range cause-and-effect relationships may demand huge coding efforts. In this paper, we contribute with a framework named PingUMiL that leverages the recently proposed graph embeddings to represent game provenance graphs in a latent space. The embeddings learned from the data pose as the features of a machine learning task tailored towards detecting long-range cause-and-effect relationships. We evaluate the generalization capacity of PingUMiL when learning from similar games and compare its performance to classical machine learning methods. The experiments conducted on two racing games show that (1) PingUMiL outperforms classical machine learning methods and (2) representation learning can be used to detect long-range cause-and-effect relationships in only partially observed game data provenance graphs.

[1]  Ameet Talwalkar,et al.  MLlib: Machine Learning in Apache Spark , 2015, J. Mach. Learn. Res..

[2]  Nitesh V. Chawla,et al.  metapath2vec: Scalable Representation Learning for Heterogeneous Networks , 2017, KDD.

[3]  Daniel R. Figueiredo,et al.  struc2vec: Learning Node Representations from Structural Identity , 2017, KDD.

[4]  Troy C. Kohwalter,et al.  Provenance in Games , 2012 .

[5]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[6]  Esteban Walter Gonzalez Clua,et al.  Game Flux Analysis with Provenance , 2013, Advances in Computer Entertainment.

[7]  Jian Pei,et al.  Asymmetric Transitivity Preserving Graph Embedding , 2016, KDD.

[8]  David L. Olson,et al.  Advanced Data Mining Techniques , 2008 .

[9]  W. Marsden I and J , 2012 .

[10]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[11]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[12]  Esteban Walter Gonzalez Clua,et al.  Capturing Game Telemetry with Provenance , 2017, SBGames.

[13]  Esteban Walter Gonzalez Clua,et al.  Understanding game sessions through provenance , 2018, Entertain. Comput..

[14]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[15]  Troy Costa Kohwalter,et al.  Capturing Game Telemetry with Provenance , 2017, 2017 16th Brazilian Symposium on Computer Games and Digital Entertainment (SBGames).

[16]  Tim Fields,et al.  Social Game Design: Monetization Methods and Mechanics , 2011 .

[17]  Richard S. Zemel,et al.  Gated Graph Sequence Neural Networks , 2015, ICLR.

[18]  Esteban Walter Gonzalez Clua,et al.  Reinforcing Software Engineering Learning through Provenance , 2014, 2014 Brazilian Symposium on Software Engineering.

[19]  Wenwu Zhu,et al.  Structural Deep Network Embedding , 2016, KDD.

[20]  Pablo Moreno-Ger,et al.  Game Learning Analytics: Learning Analytics for Serious Games , 2016 .

[21]  Mark O. Riedl,et al.  Monte-Carlo Tree Search for Simulation-based Play Strategy Analysis , 2015, FDG.

[22]  Christian Bauckhage,et al.  How players lose interest in playing a game: An empirical study based on distributions of total playing times , 2012, 2012 IEEE Conference on Computational Intelligence and Games (CIG).

[23]  Sam Devlin,et al.  Narrative Bytes: Data-Driven Content Production in Esports , 2018, TVX.

[24]  Magy Seif El-Nasr,et al.  Game Analytics , 2013, Springer London.

[25]  Alessandro Canossa,et al.  Defining personas in games using metrics , 2008, Future Play.

[26]  Julian Togelius,et al.  Predicting player behavior in Tomb Raider: Underworld , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[27]  Ethem Alpaydin,et al.  Introduction to machine learning , 2004, Adaptive computation and machine learning.

[28]  Jure Leskovec,et al.  Predicting multicellular function through multi-layer tissue networks , 2017, Bioinform..

[29]  Jure Leskovec,et al.  Inductive Representation Learning on Large Graphs , 2017, NIPS.

[30]  Günter Rudolph,et al.  Demonstrating the Feasibility of Automatic Game Balancing , 2016, GECCO.

[31]  Esteban Walter Gonzalez Clua,et al.  Prov Viewer: A Graph-Based Visualization Tool for Interactive Exploration of Provenance Data , 2016, IPAW.

[32]  Yogesh L. Simmhan,et al.  The Open Provenance Model core specification (v1.1) , 2011, Future Gener. Comput. Syst..

[33]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[34]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Leonardo Murta,et al.  Player Behavior Profiling through Provenance Graphs and Representation Learning , 2020, FDG.

[36]  Ah Chung Tsoi,et al.  The Graph Neural Network Model , 2009, IEEE Transactions on Neural Networks.

[37]  Vincent Corruble,et al.  Extending Reinforcement Learning to Provide Dynamic Game Balancing , 2005 .

[38]  Michael D. Kickmeier-Rust Predicting Learning Performance in Serious Games , 2018, JCSG.

[39]  Pietro Guardini,et al.  Better Game Experience Through Game Metrics: A Rally Videogame Case Study , 2013, Game Analytics, Maximizing the Value of Player Data.

[40]  Jure Leskovec,et al.  Representation Learning on Graphs: Methods and Applications , 2017, IEEE Data Eng. Bull..