Evolution for modeling: a genetic programming framework for sesam

Developing a valid agent-based simulation model is not always straight forward, but involves a lot of prototyping, testing and analyzing until the right low-level behavior is fully specified and calibrated. Our aim is to replace the try and error search of a modeler by adaptive agents which learn a behavior that then can serve as a source of inspiration for the modeler. In this contribution, we suggest to use genetic programming as the learning mechanism. For this aim we developed a genetic programming framework integrated into the visual agent-based modeling and simulation tool SeSAm, providing similar easy-to-use functionality.

[1]  Sridhar Mahadevan,et al.  Automatic Programming of Behavior-Based Robots Using Reinforcement Learning , 1991, Artif. Intell..

[2]  Franziska Klügl-Frohnmeyer,et al.  SeSAm: implementation of agent-based simulation using visual programming , 2006, AAMAS '06.

[3]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[4]  Tiago Francisco,et al.  Evolving predator and prey behaviours with co-evolution using genetic programming and decision trees , 2008, GECCO '08.

[5]  R. Neruda,et al.  Performance Comparison of Relational Reinforcement Learning and RBF Neural Networks for Small Mobile Robots , 2008, 2008 Second International Conference on Future Generation Communication and Networking Symposia.

[6]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[7]  Gerhard Weiß,et al.  Adaptation and Learning in Multi-Agent Systems: Some Remarks and a Bibliography , 1995, Adaption and Learning in Multi-Agent Systems.

[8]  Peter Ross,et al.  Strength and Money: An LCS Approach to Increasing Returns , 2000, IWLCS.

[9]  Martin V. Butz,et al.  Agent Learning Instead of Behavior Implementation for Simulations - A Case Study Using Classifier Systems , 2008, MATES.

[10]  Frank Puppe,et al.  Learning for Analysis and Calibration in Agent-Based Simulation , 2006 .

[11]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[12]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[13]  Wentong Cai,et al.  Evolving agent-based simulations in the clouds , 2010, Third International Workshop on Advanced Computational Intelligence.

[14]  Maarten Peeters,et al.  Learning Automata as a Basis for Multi Agent Reinforcement Learning , 2005, EUMAS.

[15]  Mal Lee,et al.  Learning enabled cooperative agent behavior in an evolutionary and competitive environment , 2006, Neural Computing & Applications.

[16]  Franziska Klügl-Frohnmeyer,et al.  Evaluation of Techniques for a Learning-Driven Modeling Methodology in Multiagent Simulation , 2010, MATES.

[17]  Steven M. Gustafson,et al.  Genetic Programming And Multi-agent Layered Learning By Reinforcements , 2002, GECCO.

[18]  Martin V. Butz,et al.  Strong, Stable, and Reliable Fitness Pressure in XCS due to Tournament Selection , 2005, Genetic Programming and Evolvable Machines.

[19]  Joshua M. Epstein,et al.  Growing Artificial Societies: Social Science from the Bottom Up , 1996 .

[20]  Gary B. Lamont,et al.  Autonomous agent behavior generation using multiobjective evolutionary optimization , 2008, GECCO '08.

[21]  Franziska Klügl,et al.  Evolutionary Optimization of Societies in Simulated Multi-Agent Systems , 2000 .

[22]  Jonathan Cagan,et al.  Evolutionary Multi-Agent Systems: An Adaptive and Dynamic Approach to Optimization , 2009 .

[23]  Robert Junges,et al.  Learning convergence and agent behavior interpretation for designing agent-based simulations , 2010 .