An Adaptive Training Framework for Increasing Player Proficiency in Games and Simulations

To improve a player's proficiency at a particular video game, the player must be presented with an appropriate level of challenge. This level of challenge must remain relative to the player as their proficiency changes. The current fixed difficulty settings (e.g. easy, medium or hard) provide a limited range of difficulty for the player. This work aims to address this problem through developing an adaptive training framework that utilities existing work in Dynamic Difficulty Adjustment to construct an adaptive AI opponent. The framework also provides a way to measure the player's proficiency, by analysing the level of challenge the adaptive AI opponent provides for the player. This work tests part of the proposed adaptive training framework through a pilot study that uses a real-time fighting game.

[1]  Georgios N. Yannakakis,et al.  Real-Time Game Adaptation for Optimizing Player Satisfaction , 2009, IEEE Transactions on Computational Intelligence and AI in Games.

[2]  Julian Togelius,et al.  Experience-Driven Procedural Content Generation , 2011, IEEE Transactions on Affective Computing.

[3]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[4]  Roger Smith,et al.  The Long History of Gaming in Military Training , 2010 .

[5]  Peta Wyeth,et al.  The effect of multiplayer dynamic difficulty adjustment on the player experience of video games , 2014, CHI Extended Abstracts.

[6]  Vincent Corruble,et al.  Challenge-sensitive action selection: an application to game balancing , 2005, IEEE/WIC/ACM International Conference on Intelligent Agent Technology.

[7]  Vincent Corruble,et al.  Extending Reinforcement Learning to Provide Dynamic Game Balancing , 2005 .

[8]  Alex Sandro Gomes,et al.  Dynamic Game Balancing: An Evaluation of User Satisfaction , 2006, AIIDE.

[9]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[10]  Zbigniew Michalewicz,et al.  Adapting to Human Gamers Using Coevolution , 2010, Advances in Machine Learning II.

[11]  Tom Minka,et al.  TrueSkillTM: A Bayesian Skill Rating System , 2006, NIPS.

[12]  Beverley Callard Street fighter. , 1998, Nursing standard (Royal College of Nursing (Great Britain) : 1987).

[13]  Shawn A. Weil,et al.  From Gaming to Training: A Review of Studies on Fidelity, Immersion, Presence, and Buy-in and Their Effects on Transfer in PC-Based Simulations and Games , 2005 .

[14]  Scott Sanner,et al.  Score-Based Bayesian Skill Learning , 2012, ECML/PKDD.

[15]  Sonia Swart,et al.  Mortal combat. , 2012, The Health service journal.

[16]  Robin Hunicke,et al.  AI for Dynamic Difficulty Adjustment in Games , 2004 .