Learning Communication for Multi-agent Systems

We analyze a general model of multi-agent communication in which all agents communicate simultaneously to a message board. A genetic algorithm is used to learn multi-agent languages for the predator agents in a version of the predator-prey problem. The resulting evolved behavior of the communicating multi-agent system is equivalent to that of a Mealy machine whose states are determined by the evolved language. We also constructed non-learning predators whose capture behavior was designed to take advantage of prey behavior known a priori. Simulations show that introducing noise to the decision process of the hard-coded predators allow them to significantly ourperform all previously published work on similar preys. Furthermore, the evolved communicating predators were able to perform significantly better than the hard-coded predators, which indicates that the system was able to learn superior communicating strategies not readily available to the human designer.

[1]  M. Benda,et al.  On Optimal Cooperation of Knowledge Sources , 1985 .

[2]  Kalyanmoy Deb,et al.  A Comparative Analysis of Selection Schemes Used in Genetic Algorithms , 1990, FOGA.

[3]  Bruce J. MacLennan,et al.  Synthetic Ethology and the Evolution of Cooperative Communication , 1993, Adapt. Behav..

[4]  David H. Ackley,et al.  Altruism in the evolution of communication , 1994 .

[5]  Tucker R. Balch,et al.  Communication in reactive multiagent robotic systems , 1995, Auton. Robots.

[6]  Michael Wooldridge,et al.  Understanding the Emergence of Conventions in Multi-Agent Systems , 1995, ICMAS.

[7]  E. Durfee,et al.  Toward Rational Communicative Behavior , 1995 .

[8]  Michael Luck,et al.  Proceedings of the First International Conference on Multi-Agent Systems , 1995 .

[9]  Kôiti Hasida,et al.  A Game-Theoretic Account of Collaboration in Communication , 1995, ICMAS.

[10]  Sandip Sen,et al.  Evolving Beharioral Strategies in Predators and Prey , 1995, Adaption and Learning in Multi-Agent Systems.

[11]  L. Steels Self-organising vocabularies , 1996 .

[12]  Pattie Maes,et al.  The Evolution of Communication Schemes Over Continuous Channels , 1996 .

[13]  Sandip Sen,et al.  Evolution and learning in multiagent systems , 1998, Int. J. Hum. Comput. Stud..

[14]  C. Lee Giles,et al.  Talking Helps: Evolving Communicating Agents for the Predator-Prey Pursuit Problem , 2000, Artificial Life.

[15]  C. Lee Giles,et al.  How communication can improve the performance of multi-agent systems , 2001, AGENTS '01.