Evolving personas for player decision modeling

This paper explores how evolved game playing agents can be used to represent a priori defined archetypical ways of playing a test-bed game, as procedural personas. The end goal of such procedural personas is substituting players when authoring game content manually, procedurally, or both (in a mixed-initiative setting). Building on previous work, we compare the performance of newly evolved agents to agents trained via Q-learning as well as a number of baseline agents. Comparisons are performed on the grounds of game playing ability, generalizability, and conformity among agents. Finally, all agents' decision making styles are matched to the decision making styles of human players in order to investigate whether the different methods can yield agents who mimic or differ from human decision making in similar ways. The experiments performed in this paper conclude that agents developed from a priori defined objectives can express human decision making styles and that they are more generalizable and versatile than Q-learning and hand-crafted agents.

[1]  Julian Togelius,et al.  Generative agents for player decision modeling in games , 2014, FDG.

[2]  A. Tversky,et al.  Prospect theory: analysis of decision under risk , 1979 .

[3]  A. Rubinstein Modeling Bounded Rationality , 1998 .

[4]  Alessandro Canossa Give me a reason to dig: qualitative associations between player behavior in Minecraft and life motives , 2012, FDG.

[5]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[6]  Julian Togelius,et al.  Generating Map Sketches for Strategy Games , 2013, EvoApplications.

[7]  Antonios Liapis,et al.  Mixed-initiative co-creativity , 2014, FDG.

[8]  Gerd Gigerenzer,et al.  Heuristic decision making. , 2011, Annual review of psychology.

[9]  Adam M. Smith,et al.  An Inclusive Taxonomy of Player Modeling , 2011 .

[10]  Dave Morris,et al.  Game Architecture and Design: A New Edition , 2003 .

[11]  Julian Togelius,et al.  Search-Based Procedural Content Generation: A Taxonomy and Survey , 2011, IEEE Transactions on Computational Intelligence and AI in Games.

[12]  R. Caillois,et al.  Man, Play and Games , 1958 .

[13]  Nick Yee,et al.  Motivations for Play in Online Games , 2006, Cyberpsychology Behav. Soc. Netw..

[14]  Julian Togelius,et al.  Decision Making Styles as Deviation from Rational Action: A Super Mario Case Study , 2013, AIIDE.

[15]  Julian Togelius,et al.  Designer Modeling for Personalized Game Content Creation Tools , 2021, Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment.

[16]  Julian Togelius,et al.  Sentient Sketchbook: Computer-aided game level authoring , 2013, FDG.

[17]  Daniele Loiacono,et al.  Player Modeling , 2013, Artificial and Computational Intelligence in Games.