Evaluation of Techniques for a Learning-Driven Modeling Methodology in Multiagent Simulation

There have been a number of suggestions for methodologies supporting the development of multiagent simulation models. In this contribution we are introducing a learning-driven methodology that exploits learning techniques for generating suggestions for agent behavior models based on a given environmental model. The output must be human-interpretable. We compare different candidates for learning techniques - classifier systems, neural networks and reinforcement learning - concerning their appropriateness for such a modeling methodology.

[1]  Charles E. Taylor,et al.  Artificial Life II , 1991 .

[2]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[3]  Peter Dayan,et al.  Technical Note: Q-Learning , 2004, Machine Learning.

[4]  Martin V. Butz,et al.  Agent Learning Instead of Behavior Implementation for Simulations - A Case Study Using Classifier Systems , 2008, MATES.

[5]  Franziska Klügl,et al.  Multiagent Simulation Model Design Strategies. , 2009 .

[6]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[7]  Stewart W. Wilson Classifier Fitness Based on Accuracy , 1995, Evolutionary Computation.

[8]  Sridhar Mahadevan,et al.  Automatic Programming of Behavior-Based Robots Using Reinforcement Learning , 1991, Artif. Intell..

[9]  Matthias Fuchs,et al.  Experiments in learning prototypical situations for variants of the pursuit game , 1999 .

[10]  R. Neruda,et al.  Performance Comparison of Relational Reinforcement Learning and RBF Neural Networks for Small Mobile Robots , 2008, 2008 Second International Conference on Future Generation Communication and Networking Symposia.

[11]  Maarten Peeters,et al.  Learning Automata as a Basis for Multi Agent Reinforcement Learning , 2005, EUMAS.

[12]  Mal Lee,et al.  Learning enabled cooperative agent behavior in an evolutionary and competitive environment , 2006, Neural Computing & Applications.

[13]  David Stuart Robertson,et al.  Enacting the Distributed Business Workflows Using BPEL4WS on the Multi-agent Platform , 2005, MATES.

[14]  Yoichiro Maeda Simulation for behavior learning of multi-agent robot , 1998, J. Intell. Fuzzy Syst..

[15]  C. Adami,et al.  Introduction To Artificial Life , 1997, IEEE Trans. Evol. Comput..

[16]  Robert J. Collins,et al.  AntFarm: Towards Simulated Evolution , 2007 .

[17]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.