A study of evolutionary multiagent models based on symbiosis

Multiagent Systems with Symbiotic Learning and Evolution (Masbiole) has been proposed and studied, which is a new methodology of Multiagent Systems (MAS) based on symbiosis in the ecosystem. Masbiole employs a method of symbiotic learning and evolution where agents can learn or evolve according to their symbiotic relations toward others, i.e., considering the benefits/losses of both itself and an opponent. As a result, Masbiole can escape from Nash Equilibria and obtain better performances than conventional MAS where agents consider only their own benefits. This paper focuses on the evolutionary model of Masbiole, and its characteristics are examined especially with an emphasis on the behaviors of agents obtained by symbiotic evolution. In the simulations, two ideas suitable for the effective analysis of such behaviors are introduced; "Match Type Tile-world (MTT)" and "Genetic Network Programming (GNP)". MTT is a virtual model where tile-world is improved so that agents can behave considering their symbiotic relations. GNP is a newly developed evolutionary computation which has the directed graph type gene structure and enables to analyze the decision making mechanism of agents easily. Simulation results show that Masbiole can obtain various kinds of behaviors and better performances than conventional MAS in MTT by evolution.

[1]  Agostino Poggi,et al.  Multiagent Systems , 2006, Intelligenza Artificiale.

[2]  Risto Miikkulainen,et al.  Efficient Reinforcement Learning through Symbiotic Evolution , 1996, Machine Learning.

[3]  J. Nash.  Equilibrium Points in N-Person Games. , 1950, Proceedings of the National Academy of Sciences of the United States of America.

[4]  Panos Liatsis,et al.  A collective-based adaptive symbiotic model for surface reconstruction in area-based stereo , 2003, IEEE Trans. Evol. Comput..

[5]  Tapan P. Bagchi,et al.  Multiobjective Scheduling by Genetic Algorithms , 1999 .

[6]  Hans-Georg Beyer,et al.  The Theory of Evolution Strategies , 2001, Natural Computing Series.

[7]  Martha E. Pollack,et al.  Introducing the Tileworld: Experimentally Evaluating Agent Architectures , 1990, AAAI.

[8]  Astro Teller,et al.  PADO: Learning Tree Structured Algorithms for Orchestration into an Object Recognition System , 1995 .

[9]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[10]  Kotaro Hirasawa,et al.  Multiagent Systems with Symbiotic Learning and Evolution Using Genetic Network Programming , 2002, GECCO Late Breaking Papers.

[11]  Panos Liatsis,et al.  Co-evolutionary-based active contour models in tracking of moving obstacles , 2001 .

[12]  Jinglu Hu,et al.  Genetic network programming - application to intelligent agents , 2000, Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0.

[13]  Panos Liatsis,et al.  Hybrid symbiotic genetic optimisation for robust edge-based stereo correspondence , 2001, Pattern Recognit..

[14]  Chin-Teng Lin,et al.  Genetic Reinforcement Learning through Symbiotic Evolution for Fuzzy Controller Design , 2022 .

[15]  Shingo Mabu,et al.  Online learning of genetic network programming (GNP) , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[16]  Shingo Mabu,et al.  Online Learning of Genetic Network Programming , 2002 .

[17]  K. P. Pieters.  Symbiotic networks , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[18]  Kotaro Hirasawa,et al.  Network structure oriented evolutionary model-Genetic Network Programming-and its comparison with Ge , 2001 .

[19]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[20]  Kotaro Hirasawa,et al.  Comparison between Genetic Network Programming (GNP) and Genetic Programming (GP) , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[21]  W. Hamilton,et al.  The evolution of cooperation. , 1984, Science.

[22]  Lawrence J. Fogel,et al.  Artificial Intelligence through Simulated Evolution , 1966 .

[23]  Paul Thagard.  Rationality and Science , 2004 .

[24]  Shingo Mabu,et al.  Genetic network programming with learning and evolution for adapting to dynamical environments , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[25]  Kotaro Hirasawa,et al.  Symbiotic evolutional models in multiagent systems , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[26]  Y. Shoham.  Introduction to Multi-Agent Systems , 2002 .

[27]  W. Daniel Hillis,et al.  Co-evolving parasites improve simulated evolution as an optimization procedure , 1990 .