Robust coordination in large convention spaces

Regulating the behavior of autonomous agents is necessary to solve coordination problems and minimize conflicts in multi-agent systems (MAS). Social conventions can be regarded as coordination schemes that can be employed by agents to successfully coordinate. However, to have agents agree on good conventions, without the need of a central authority, is a challenging issue. In this paper we design a novel spreading-based convention emergence mechanism that helps agents distributedly agree on the best convention when there are multiple alternatives. We apply our convention emergence mechanism to a problem with a large convention space: finding a common vocabulary (lexicon) for the agents of a MAS that allows them to perfectly communicate with neither ambiguity nor inconsistencies. Thus, we empirically show the scalability of our approach in large (in terms of agents and conventions) scenarios that change over time. Moreover, since communication is crucial to spreading, we also show that our proposed spreading mechanism is resilient to unreliable communications, thus guaranteeing the robust emergence of conventions.

[1]  Luc Steels,et al.  Grounding symbols through evolutionary language games , 2002 .

[2]  R. Axelrod The Dissemination of Culture , 1997 .

[3]  Yoav Shoham,et al.  Multiagent Systems - Algorithmic, Game-Theoretic, and Logical Foundations , 2009 .

[4]  Albert-László Barabási,et al.  Statistical mechanics of complex networks , 2001, ArXiv.

[5]  John J. Grefenstette,et al.  Evolutionary Algorithms for Reinforcement Learning , 1999, J. Artif. Intell. Res..

[6]  Vittorio Loreto,et al.  Nonequilibrium dynamics of language games on complex networks. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[7]  L. Steels Self-organising vocabularies , 1996 .

[8]  Luc Steels,et al.  A Distributed Learning Algorithm for Communication Development , 2003, Complex Syst..

[9]  Alessandro Vespignani,et al.  Epidemic dynamics and endemic states in complex networks. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[10]  Alkiviadis Kalampokis,et al.  Evolution of vocabulary on scale-free and random networks , 2007 .

[11]  Moshe Tennenholtz,et al.  On the Emergence of Social Conventions: Modeling, Analysis, and Simulations , 1997, Artif. Intell..

[12]  Norman T. J. Bailey,et al.  The Mathematical Theory of Infectious Diseases , 1975 .

[13]  Vittorio Loreto,et al.  Cultural route to the emergence of linguistic categories , 2007, Proceedings of the National Academy of Sciences.

[14]  L. Steels,et al.  Social dynamics: Emergence of language , 2007 .

[15]  Vittorio Loreto,et al.  Journal of Statistical Mechanics: An IOP and SISSA journal Theory and Experiment Sharp transition towardsshared vocabularies in multi-agent systems , 2006 .

[16]  Thomas Bäck,et al.  Evolutionary algorithms in theory and practice - evolution strategies, evolutionary programming, genetic algorithms , 1996 .

[17]  Juan A. Rodríguez-Aguilar,et al.  Infection-based self-configuration in agent societies , 2008, GECCO '08.

[18]  Michael Wooldridge,et al.  Understanding the Emergence of Conventions in Multi-Agent Systems , 1995, ICMAS.

[19]  Guido Boella,et al.  Normative framework for normative system change , 2009, AAMAS 2009.

[20]  Juan A. Rodríguez-Aguilar,et al.  An Infection-Based Mechanism in Large Convention Spaces , 2009, COIN@AAMAS&IJCAI&MALLOW.

[21]  E. C. Zeeman,et al.  Population dynamics from game theory , 1980 .

[22]  Luc Steels,et al.  The Origins of Ontologies and Communication Conventions in Multi-Agent Systems , 2004, Autonomous Agents and Multi-Agent Systems.

[23]  Sandip Sen,et al.  Effects of Social Network Topology and Options on Norm Emergence , 2009, COIN@AAMAS&IJCAI&MALLOW.

[24]  Juan A. Rodríguez-Aguilar,et al.  An Infection-Based Mechanism for Self-Adaptation in Multi-agent Complex Networks , 2008, 2008 Second IEEE International Conference on Self-Adaptive and Self-Organizing Systems.

[25]  Ju-Jang Lee,et al.  Evolving multi-agents using a self-organizing genetic algorithm , 1997 .

[26]  A. Barabasi,et al.  Halting viruses in scale-free networks. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[27]  Territoire Urbain,et al.  Convention , 1955, Hidden Nature.

[28]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[29]  Ramon Sangüesa,et al.  The Role of Clustering on the Emergence of Efficient Social Conventions , 2005, IJCAI.

[30]  Bambi Hu,et al.  Epidemic spreading in community networks , 2005 .

[31]  Jordi Delgado,et al.  Emergence of social conventions in complex networks , 2002, Artif. Intell..

[32]  James E. Kittock Emergent Conventions and the Structure of Multi--Agent Systems , 1995 .