Simple models of distributed co-ordination

Distributed co-ordination is the result of dynamical processes enabling independent agents to co-ordinate their actions without the need of a central co-ordinator. In the past few years, several computational models have illustrated the role played by such dynamics for self-organizing communication systems. In particular, it has been shown that agents could bootstrap shared convention systems based on simple local adaptation rules. Such models have played a pivotal role for our understanding of emergent language processes. However, only few formal or theoretical results have been published about such systems. Deliberately simple computational models are discussed in this paper in order to make progress in understanding the underlying dynamics responsible for distributed co-ordination and the scaling laws of such systems. In particular, the paper focuses on explaining the convergence speed of those models, a largely under-investigated issue. Conjectures obtained through empirical and qualitative studies of these simple models are compared with results of more complex simulations and discussed in relation to theoretical models formalized using Markov chains, game theory and Polya processes.

[1]  W. Arthur,et al.  Increasing Returns and Path Dependence in the Economy , 1996 .

[2]  Angelo Cangelosi,et al.  The Emergence of a 'Language' in an Evolving Population of Neural Networks , 1998, Connect. Sci..

[3]  K Khanin,et al.  A probabilistic model for the establishment of neuron polarity , 2000, Journal of mathematical biology.

[4]  Simon Kirby,et al.  Iterated Learning: A Framework for the Emergence of Language , 2003, Artificial Life.

[5]  R. Kirk CONVENTION: A PHILOSOPHICAL STUDY , 1970 .

[6]  Sony CSL-Paris Semiotic schemata : Selection units for linguistic cultural evolution , 2000 .

[7]  Scott C. Stoness,et al.  Effective Lexicon Change in the Absence of Population Flux , 1999, ECAL.

[8]  Angelo Cangelosi,et al.  Simulating the Evolution of Language , 2002, Springer London.

[9]  Michael Oliphant,et al.  Formal approaches to innate and learned communication : laying the foundation for language , 1998 .

[10]  Radu Theodorescu,et al.  Random processes and learning , 1969 .

[11]  S. I. Sara De Boer: The origins of vowel systems , 2004 .

[12]  Takaya Arita,et al.  Evolution of Linguistic Diversity in a Simple Communication System , 1998, Artificial Life.

[13]  W. Brian Arthur,et al.  Path-dependent processes and the emergence of macro-structure , 1987 .

[14]  Bart de Boer,et al.  The Origins of Vowel Systems , 2001 .

[15]  Paul Vogt,et al.  Bootstrapping grounded symbols by minimal autonomous robots , 2000 .

[16]  Pierre-Yves Oudeyer,et al.  The Self-Organization of Speech Sounds , 2005, Journal of theoretical biology.

[17]  Yuri Ermoliev,et al.  Strong laws for a class of path-dependent stochastic processes with applications , 1986 .

[18]  James W. Minett,et al.  Self-organization and selection in the emergence of vocabulary , 2002, Complex..

[19]  Frédéric Kaplan,et al.  A new approach to class formation in multi-agent simulations of language evolution , 1998, Proceedings International Conference on Multi Agent Systems (Cat. No.98EX160).

[20]  Luc Steels,et al.  Situated Grounded Word Semantics , 1999, IJCAI.

[21]  Phil Husbands,et al.  Minimum cost and the emergence of the Zipf-Mandelbrot law , 2004 .

[22]  Luc Steels,et al.  Spontaneous Lexicon Change , 1998, ACL.

[23]  Moshe Tennenholtz,et al.  On the Emergence of Social Conventions: Modeling, Analysis, and Simulations , 1997, Artif. Intell..

[24]  Luc Steels,et al.  Stochasticity as a source of innovation in language games , 1998 .

[25]  Pierre-Yves Oudeyer Self-Organization of a Lexicon in a Structured Society of Agents , 1999, ECAL.

[26]  F. Chung,et al.  Generalizations of Polya's urn Problem , 2003 .

[27]  Brian Hazlehurst,et al.  How to invent a lexicon: the development of shared symbols in interaction , 2006 .

[28]  Luc Steels,et al.  A Distributed Learning Algorithm for Communication Development , 2003, Complex Syst..

[29]  Ricard V. Solé,et al.  Least effort and the origins of scaling in human language , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[30]  Kenny Smith,et al.  The evolution of vocabulary. , 2004, Journal of theoretical biology.

[31]  W. Weidlich,et al.  Concepts and Models of a Quantitative Sociology , 1983 .

[32]  Colin Fyfe,et al.  Modelling the Evolution of Linguistic Diversity , 1999, ECAL.

[33]  Paul Vogt,et al.  Minimum cost and the emergence of the Zipf-Mandelbrot law , 2004 .

[34]  W. Strange Evolution of language. , 1984, JAMA.

[35]  J. Laurie Snell,et al.  Markov Random Fields and Their Applications , 1980 .

[36]  Yu. M. Ermol’ev,et al.  A generalized URN problem and its applications , 1983 .

[37]  A. Cangelosi,et al.  The processing of verbs and nouns in neural networks: Insights from synthetic brain imaging , 2004, Brain and Language.

[38]  Luc Steels,et al.  Bootstrapping grounded word semantics , 1999 .