Journal of Statistical Mechanics: An IOP and SISSA journal Theory and Experiment Sharp transition towardsshared vocabularies in multi-agent systems

What processes can explain how very large populations are able to converge on the use of a particular word or grammatical construction without global coordination? Answering this question helps to understand why new language constructs usually propagate along an S-shaped curve with a rather sudden transition towards global agreement. It also helps to analyse and design new technologies that support or orchestrate self-organizing communication systems, such as recent social tagging systems for the web. The article introduces and studies a microscopic model of communicating autonomous agents performing language games without any central control. We show that the system undergoes a disorder/order transition, going through a sharp symmetry breaking process to reach a shared set of conventions. Before the transition, the system builds up non-trivial scale-invariant correlations, for instance in the distribution of competing synonyms, which display a Zipf-like law. These correlations make the system ready for the transition towards shared conventions, which, observed on the timescale of collective behaviours, becomes sharper and sharper with system size. This surprising result not only explains why human language can scale up to very large populations but also suggests ways to optimize artificial semiotic dynamics.

[1]  Luc Steels.  A self-organizing spatial vocabulary , 1995 .

[2]  Partha Niyogi,et al.  Optimizing the mutual intelligibility of linguistic agents in a shared world , 2004, Artif. Intell..

[3]  E. J. Gumbel,et al.  Statistics of Extremes. , 1960 .

[4]  R. Lass.  Historical linguistics and language change , 1997 .

[5]  Michael Wooldridge,et al.  Autonomous agents and multi-agent systems , 2014 .

[6]  B. Bollobás.  The evolution of random graphs , 1984 .

[7]  Karl-Heinz Best,et al.  Spracherwerb, Sprachwandel und Wortschatzwachstum in Texten. Zur Reichweite des Piotrowski-Gesetzes , 2003, Glottometrics.

[8]  F. Chung,et al.  Generalizations of Polya's urn Problem , 2003 .

[9]  Steffen Staab.  Emergent Semantics , 2002, IEEE Intell. Syst..

[10]  P. Libby.  The Scientific American , 1881, Nature.

[11]  M. F.,et al.  Bibliography , 1985, Experimental Gerontology.

[12]  James R. Hurford,et al.  Biological evolution of the Saussurean sign as a component of the language acquisition device , 1989 .

[13]  Simon Kirby,et al.  Natural Language From Artificial Life , 2002, Artificial Life.

[14]  N. Gilbert,et al.  Artificial Societies: The Computer Simulation of Social Life , 1995 .

[15]  V. F. Kolchin.  On the Behavior of a Random Graph Near a Critical Point , 1987 .

[16]  Luc Steels,et al.  The synthetic modeling of language origins , 1997 .

[17]  Helle Körner.  Der Zuwachs der Wörter auf -ion im Deutschen , 2002, Glottometrics.

[18]  Tomasz Łuczak.  Component behavior near the critical point of the random graph process , 1990 .

[19]  Partha Niyogi,et al.  Evolutionary Consequences of Language Learning , 1997 .

[20]  M A Nowak,et al.  Evolution of universal grammar. , 2001, Science.

[21]  Karl-Heinz Best.  Der Zuwachs der Wörter auf -ical im Deutschen , 2002, Glottometrics.

[22]  M. Nowak,et al.  The evolutionary language game. , 1999, Journal of theoretical biology.

[23]  W. Strange.  Evolution of language. , 1984, JAMA.

[24]  Samuel Kotz,et al.  Urn Models and Their Applications: An Approach to Modern Discrete Probability Theory , 1978, The Mathematical Gazette.

[25]  Ramon Ferrer-i-Cancho,et al.  Can simple models explain Zipf's law for all exponents? , 2005, Glottometrics.

[26]  Z. Burda,et al.  Condensation in the Backgammon model , 1997 .

[27]  Brian Hazlehurst,et al.  How to invent a lexicon: the development of shared symbols in interaction , 2006 .

[28]  Luc Steels,et al.  The Origins of Ontologies and Communication Conventions in Multi-Agent Systems , 2004, Autonomous Agents and Multi-Agent Systems.

[29]  J. Peregrin.  LINGUISTICS AND PHILOSOPHY , 1998 .

[30]  Martin A Nowak,et al.  Win–stay, lose–shift in language learning from peers , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[31]  Michael Oliphant,et al.  Learning and the Emergence of Coordinated Communication , 1997 .

[32]  R. Burton,et al.  Density and uniqueness in percolation , 1989 .

[33]  Simon Kirby,et al.  Iterated Learning: A Framework for the Emergence of Language , 2003, Artificial Life.

[34]  L. Steels.  Evolving grounded communication for robots , 2003, Trends in Cognitive Sciences.