Dynamic Difficulty Balancing for Cautious Players and Risk Takers

Dynamic balancing of game difficulty can help cater for different levels of ability in players. However, performance in some game tasks depends on not only the player's ability but also their desire to take risk. Taking or avoiding risk can offer players its own reward in a game situation. Furthermore, a game designer may want to adjust the mechanics differently for a risky, high ability player, as opposed to a risky, low ability player. In this work, we describe a novel modelling technique known as particle filtering which can be used to model various levels of player ability while also considering the player's risk profile. We demonstrate this technique by developing a game challenge where players are required to make a decision between a number of possible alternatives where only a single alternative is correct. Risky players respond faster but with more likelihood of failure. Cautious players wait longer for more evidence, increasing their likelihood of success, but at the expense of game time. By gathering empirical data for the player's response time and accuracy, we develop particle filter models. These models can then be used in real-time to categorise players into different ability and risk-taking levels.

[1]  Michael D. Lee,et al.  Modeling Human Performance in Restless Bandits with Particle Filters , 2009, J. Probl. Solving.

[2]  Curt Bererton,et al.  State Estimation for Game AI Using Particle Filters , 2004 .

[3]  Charles S. Myers,et al.  On reaction times. , 1909 .

[4]  W. E. Hick Quarterly Journal of Experimental Psychology , 1948, Nature.

[5]  Robin Hunicke,et al.  The case for dynamic difficulty adjustment in games , 2005, ACE '05.

[6]  Vincent Corruble,et al.  Challenge-sensitive action selection: an application to game balancing , 2005, IEEE/WIC/ACM International Conference on Intelligent Agent Technology.

[7]  Fredric Brown,et al.  The Far Cry , 1987 .

[8]  Thomas L. Griffiths,et al.  A more rational model of categorization , 2006 .

[9]  Robin Hunicke,et al.  AI for Dynamic Difficulty Adjustment in Games , 2004 .

[10]  W H Teichner,et al.  Laws of visual choice reaction time. , 1974, Psychological review.

[11]  I. Sprinkhuizen-Kuyper,et al.  DIFFICULTY SCALING OF GAME AI , 2004 .

[12]  Adriano J. de O. Cruz,et al.  Online Coevolution for Action Games , 2002, Int. J. Intell. Games Simul..

[13]  Kathy Schwalbe,et al.  Information Technology Project Management , 1999 .

[14]  R. Hyman Stimulus information as a determinant of reaction time. , 1953, Journal of experimental psychology.

[15]  Georgios N. Yannakakis,et al.  Towards Capturing and Enhancing Entertainment in Computer Games , 2006, SETN.

[16]  M. Pitt,et al.  Filtering via Simulation: Auxiliary Particle Filters , 1999 .

[17]  Thomas Gärtner,et al.  Player Modeling for Intelligent Difficulty Adjustment , 2009, LWA.

[18]  Thomas L. Griffiths,et al.  Modeling the effects of memory on human online sentence processing with particle filters , 2008, NIPS.

[19]  Scott D. Brown,et al.  Detecting and predicting changes , 2009, Cognitive Psychology.