Combining Coaching and Learning to Create Cooperative Character Behavior

We present a concept for developing cooperative characters (agents) for computer games that combines coaching by a human with evolutionary learning. The basic idea is to use prototypical situation-action pairs and the nearest-neighbor rule as agent architecture and to let the human coach provide key situations and his/her wishes for an associated action for the different characters. This skeleton strategy for characters (and teams) is then fleshed out by the evolutionary learner to produce the desired behavior. Our experimental evaluation with variants of Pursuit Games shows that already a rather small skeleton –that alone is not a complete strategy– can help solve examples that learning alone has big problems with.

[1]  Jörg Denzinger,et al.  On Customizing Evolutionary Learning of Agent Behavior , 2004, Canadian Conference on AI.

[2]  Jörg Denzinger,et al.  Improving Evolutionary Learning of Cooperative Behavior by Including Accountability of Strategy Components , 2003, MATES.

[3]  J. Denzinger Dealing with new guys in experienced teams-the old guys might also have to adapt , 2022 .

[4]  David B. Fogel,et al.  A platform for evolving characters in competitive games , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[5]  Jonathan Schaeffer,et al.  ScriptEase: generative design patterns for computer role-playing games , 2004, Proceedings. 19th International Conference on Automated Software Engineering, 2004..

[6]  Jörg Denzinger,et al.  Evolutionary online learning of cooperative behavior with situation-action pairs , 2000, Proceedings Fourth International Conference on MultiAgent Systems.

[7]  David Andre,et al.  State abstraction for programmable reinforcement learning agents , 2002, AAAI/IAAI.

[8]  Matthias Fuchs,et al.  Experiments in learning prototypical situations for variants of the pursuit game , 1999 .

[9]  M. Benda,et al.  On Optimal Cooperation of Knowledge Sources , 1985 .

[10]  Jörg Denzinger,et al.  Being the new guy in an experienced team: enhancing training on the job , 2002, AAMAS '02.

[11]  Sushil J. Louis,et al.  Learning to play like a human: case injected genetic algorithms for strategic computer gaming , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[12]  Sushil J. Louis,et al.  Learning to play like a human: case injected genetic algorithms for strategic computer gaming , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).