Language evolution and information theory.

This paper places models of language evolution within the framework of information theory. We study how signals become associated with meaning. If there is a probability of mistaking signals for each other, then evolution leads to an error limit: increasing the number of signals does not increase the fitness of a language beyond a certain limit. This error limit can be overcome by word formation: a linear increase of the word length leads to an exponential increase of the maximum fitness. We develop a general model of word formation and demonstrate the connection between the error limit and Shannon's noisy coding theorem.

[1]  R. Gallager.  Information Theory and Reliable Communication , 1968 .

[2]  Martin A. Nowak,et al.  The evolution of syntactic communication , 2000, Nature.

[3]  Josef Hofbauer,et al.  Evolutionary Games and Population Dynamics , 1998 .

[4]  Jacob Wolfowitz.  Coding Theorems of Information Theory , 1962 .

[5]  Claude E. Shannon,et al.  A mathematical theory of communication , 1948, MOCO.

[6]  Jan C. van der Lubbe,et al.  Information theory , 1997 .

[7]  George A. Miller,et al.  The science of words , 1991 .

[8]  M. Hauser.  The Evolution of Communication , 1996 .

[9]  J. Wolfowitz.  Coding Theorems of Information Theory , 1962, Ergebnisse der Mathematik und Ihrer Grenzgebiete.

[10]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[11]  M A Nowak,et al.  An error limit for the evolution of language , 1999, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[12]  Dominic J. A. Welsh,et al.  Codes and cryptography , 1988 .

[13]  W. Strange.  Evolution of language. , 1984, JAMA.

[14]  M. Nowak,et al.  The evolutionary language game. , 1999, Journal of theoretical biology.

[15]  P. Marler.  Birdsong and speech development: could there be parallels? , 1970, American scientist.

[16]  S. Pinker.  The Language Instinct , 1994 .

[17]  M. Studdert-Kennedy,et al.  Approaches to the Evolution of Language , 1999 .