Compositional Syntax From Cultural Transmission

A growing body of work demonstrates that syntactic structure can evolve in populations of genetically identical agents. Traditional explanations for the emergence of syntactic structure employ an argument based on genetic evolution: Syntactic structure is specified by an innate language acquisition device (LAD). Knowledge of language is complex, yet the data available to the language learner are sparse. This incongruous situation, termed the poverty of the stimulus, is accounted for by placing much of the specification of language in the LAD. The assumption is that the characteristic structure of language is somehow coded genetically. The effect of language evolution on the cultural substrate, in the absence of genetic change, is not addressed by this explanation. We show that the poverty of the stimulus introduces a pressure for compositional language structure when we consider language evolution resulting from iterated observational learning. We use a mathematical model to map the space of parameters that result in compositional syntax. Our hypothesis is that compositional syntax cannot be explained by understanding the LAD alone: Compositionality is an emergent property of the dynamics resulting from sparse language exposure.

[1]  Morten H. Christiansen,et al.  Language evolution: consensus and controversies , 2003, Trends in Cognitive Sciences.

[2]  Noam Chomsky,et al.  Rules and Representations , 1982 .

[3]  P. Thomas Schoenemann,et al.  Syntax as an Emergent Characteristic of the Evolution of Semantic Complexity , 1999, Minds and Machines.

[4]  M. Studdert-Kennedy,et al.  The evolutionary emergence of language : social function and the origins of linguistic form , 2000 .

[5]  J. Gerard Wolff,et al.  Language acquisition, data compression and generalization , 1982 .

[6]  S. McKennoch,et al.  A biologically-inspired platform for the evolution of communication in multi-agent systems , 2003, Proceedings of the 2003 IEEE International Symposium on Intelligent Control.

[7]  J. Stevenson The cultural origins of human cognition , 2001 .

[8]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[9]  Kenny Smith,et al.  The cultural evolution of communication in a population of neural networks , 2002, Connect. Sci..

[10]  Boris Ryabko,et al.  Using Shannon entropy and Kolmogorov complexity to study the communicative system and cognitive capacities in ants , 1996 .

[11]  Charles E. Taylor,et al.  Effects of Compression on Language Evolution , 2000, Artificial Life.

[12]  Max J. Cresswell,et al.  Formal philosophy, selected papers of richard montague , 1976 .

[13]  Simon Kirby,et al.  Linguistic Evolution Through Language Acquisition: Learning, bottlenecks and the evolution of recursive syntax , 2002 .

[14]  Luc Steels,et al.  The Origins of Syntax in Visually Grounded Robotic Agents , 1997, IJCAI.

[15]  S. Pinker,et al.  Natural language and natural selection , 1990, Behavioral and Brain Sciences.

[16]  G. Zipf,et al.  The Psycho-Biology of Language , 1936 .

[17]  L. Steels Constructing and Sharing Perceptual Distinctions , 1997 .

[18]  G. Āllport The Psycho-Biology of Language. , 1936 .

[19]  C. Lumsden Culture and the Evolutionary Process, Robert Boyd, Peter J. Richerson. University of Chicago Press, Chicago & London (1985), viii, +301. Price $29.95 , 1986 .

[20]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[21]  Seth Bullock,et al.  Made to Measure: Ecological Rationality in Structured Environments , 1999, Minds and Machines.

[22]  M A Nowak,et al.  Evolution of universal grammar. , 2001, Science.

[23]  Ming Li,et al.  An Introduction to Kolmogorov Complexity and Its Applications , 1997, Texts in Computer Science.

[24]  Simon Kirby,et al.  The Evolutionary Emergence of Language: Syntax Without Natural Selection: How Compositionality Emerges from Vocabulary in a Population of Learners , 2000 .

[25]  Simon Kirby,et al.  The Survival of the Smallest: Stability Conditions for the Cultural Evolution of Compositional Language , 2001, ECAL.

[26]  Barbara C. Scholz,et al.  Empirical assessment of stimulus poverty arguments , 2002 .

[27]  Simon Kirby,et al.  Spontaneous evolution of linguistic structure-an iterated learning model of the emergence of regularity and irregularity , 2001, IEEE Trans. Evol. Comput..

[28]  Robin I. M. Dunbar Coevolution of neocortical size, group size and language in humans , 1993, Behavioral and Brain Sciences.

[29]  Simon Kirby,et al.  Natural Language From Artificial Life , 2002, Artificial Life.

[30]  Tracy K. Teal,et al.  Effects of Acquisition on Language Evolution , 2000 .

[31]  J. Rissanen,et al.  Modeling By Shortest Data Description* , 1978, Autom..

[32]  Andrew D. M. Smith Intelligent Meaning Creation in a Clumpy World Helps Communication , 2003, Artificial Life.

[33]  Noam Chomsky Reflections on Language. , 1977 .

[34]  Martin A. Nowak,et al.  The evolution of syntactic communication , 2000, Nature.

[35]  Simon Kirby,et al.  Iterated Learning: A Framework for the Emergence of Language , 2003, Artificial Life.

[36]  Andrew D. M. Smith,et al.  Establishing Communication Systems without Explicit Meaning Transmission , 2001, ECAL.

[37]  Simon Kirby,et al.  Function, Selection, and Innateness: The Emergence of Language Universals , 1999 .