An Intelligent Fighting Videogame Opponent Adapting to Behavior Patterns of the User

In standard fighting videogames, users usually prefer playing against other users rather than against machines because opponents controlled by machines are in a rut and users can memorize their behaviors after repetitive plays. On the other hand, human players adapt to each other’s behaviors, which makes fighting videogames interesting. Thus, in this paper, we propose an artificial agent for a fighting videogame that can adapt to its users, allowing users to enjoy the game even when playing alone. In particular, this work focuses on combination attacks, or combos, that give great damage to the opponent. The agent treats combos independently, i.e., it is composed of a subagent for predicting combos the user executes, that for choosing combos the agent executes, and that for controlling the whole agent. Human users evaluated the agent compared to static opponents, and the agent received minimal negative ratings. key words: entertainment computing, adapting agent, pattern matching, reinforcement learning

[1]  Alex Sandro Gomes,et al.  Dynamic Game Balancing: An Evaluation of User Satisfaction , 2006, AIIDE.

[2]  James Noble,et al.  Video game values: Human-computer interaction and games , 2007, Interact. Comput..

[3]  Masayuki Numao,et al.  Towards the Design of Affective Survival Horror Games: An Investigation on Player Affect , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[4]  Junichi Hoshino,et al.  Imitating the Behavior of Human Players in Action Games , 2006, ICEC.

[5]  Ernest Adams,et al.  Fundamentals of Game Design , 2006 .

[6]  Georgios N. Yannakakis,et al.  Evolving opponents for interesting interactive computer games , 2004 .

[7]  Vincent Corruble,et al.  Challenge-sensitive action selection: an application to game balancing , 2005, IEEE/WIC/ACM International Conference on Intelligent Agent Technology.

[8]  Masayuki Numao,et al.  Three-Subagent Adapting Architecture for Fighting Videogames , 2010, PRICAI.

[9]  Masayuki Numao,et al.  Road to an Interesting Opponent : An Agent that Predicts the Users ' Combination Attacks in a Fighting Videogame , 2009 .

[10]  Nikos Mamoulis,et al.  Mining frequent spatio-temporal sequential patterns , 2005, Fifth IEEE International Conference on Data Mining (ICDM'05).

[11]  K. Sycara,et al.  Learning Approach for Planning and Scheduling in Multi-Agent Domain , 2000 .

[12]  Jiming Liu,et al.  An Adaptive User Interface Based On Personalized Learning , 2003, IEEE Intell. Syst..

[13]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[14]  Thore Graepel,et al.  LEARNING TO FIGHT , 2004 .