Evolving intelligent multiagent systems using unsupervised agent communication and behavior training

Multiagent systems in which independent software agents interact with each other to achieve common goals, complete distributed tasks concurrently under autonomous control. Agent communication has been shown to be an important factor in coordinating efficient group behavior in agents. Most research on training or evolving group behavior in multiagent systems used predefined agent communication protocols. Designing agent communication becomes a complex problem in dynamic and large-scale systems. In order to solve this problem, in our previous research we proposed a method applying genetic programming techniques, in particular Automatically Defined Function Genetic Programming (ADF-GP) (K. Mackin and E. Tazaki, 1999), to allow agents to autonomously learn effective agent communication messaging. For this research we take this approach further and combine training of the agent behavior as well as the communication protocol. By training both behavior and communication we expect to further optimize the system performance. A software simulation of a multiagent transaction system is used to observe the effectiveness of the proposed method.

[1]  Lee Spector,et al.  Cultural transmission of information in genetic programming , 1996 .

[2]  Ronald R. Yager,et al.  Protocol for Negotiations among Multiple Intelligent Agents , 1997 .

[3]  Eiichiro Tazaki,et al.  Emergent agent communication in multi-agent systems using automatically defined function genetic programming (ADF-GP) , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[4]  Hitoshi Iba,et al.  Evolutionary Learning of Communicating Agents , 1998, Inf. Sci..

[5]  Lee Spector,et al.  Evolving teamwork and coordination with genetic programming , 1996 .

[6]  Marco Dorigo,et al.  Distributed Optimization by Ant Colonies , 1992 .

[7]  H. R. Berenji,et al.  Competition and collaboration among fuzzy reinforcement learning agents , 1998, 1998 IEEE International Conference on Fuzzy Systems Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36228).

[8]  Arthur C. Graesser,et al.  Agent behaviors in virtual negotiation environments , 1999, IEEE Trans. Syst. Man Cybern. Part C.

[9]  Hitoshi Iba,et al.  Evolving communicating agents based on genetic programming , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).