On the Acquisition and Evolution of Compositional Languages: Sparse Input and the Productive Creativity of Children

This paper investigates the productive creativity of children in a computational model of the emergence and evolution of compositional structures in language. In previous models it was shown that compositional structures can emerge in language when the language is transmitted from one generation to the next through a transmission bottleneck. Due to the fact that in these models language is transmitted only in a vertical direction where adults only speak to children and children only listen, this bottleneck needs to be imposed by the experimenter. In the current study, this bottleneck is removed and instead of having a vertical transmission of language, the language is—in most simulations— transmitted horizontally (i.e., any agent can speak to any other agent). It is shown that such a horizontal transmission scenario does not need an externally imposed bottleneck, because the children face an implicit bottleneck when they start speaking early in life. The model is compared with the recent development of Nicaraguan Sign Language, where it is observed that children are a driving force for inventing grammatical (or compositional) structures, possibly due to a sparseness of input (i.e., an implicit bottleneck). The results show that in the studied model children are indeed the creative driving force for the emergence and stable evolution of compositional languages, thus suggesting that this implicit bottleneck may—in part—explain why children are so typically good at acquiring language and, moreover, why they may have been the driving force for the emergence of grammar in language.

[1]  D. Bickerton The language bioprogram hypothesis , 1984, Behavioral and Brain Sciences.

[2]  M. Tomasello,et al.  Early syntactic creativity: a usage-based approach. , 2003, Journal of child language.

[3]  A. Senghas,et al.  Children Creating Language: How Nicaraguan Sign Language Acquired a Spatial Grammar , 2001, Psychological science.

[4]  L. Steels,et al.  Crucial factors in the origins of word-meaning , 2000 .

[5]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[6]  Seth Bullock,et al.  Advances in Artificial Life: Proceedings of the Seventh European Conference on Artificial Life (ECAL 2003) , 1999 .

[7]  Menno van Zaanen ABL: Alignment-Based Learning , 2000, COLING.

[8]  Yuen Ren Chao,et al.  Human Behavior and the Principle of Least Effort: An Introduction to Human Ecology , 1950 .

[9]  Luc Steels,et al.  Constructivist Development of Grounded Construction Grammar , 2004, ACL.

[10]  Mark Sebba,et al.  Contact Languages: Pidgins and Creoles , 1997 .

[11]  A. Senghas,et al.  Children Creating Core Properties of Language: Evidence from an Emerging Sign Language in Nicaragua , 2004, Science.

[12]  Paul Vogt THSim v3.2: The Talking Heads Simulation Tool , 2003, ECAL.

[13]  James R. Hurford,et al.  Language Evolution in Populations: Extending the Iterated Learning Model , 2003, ECAL.

[14]  Paul Vogt,et al.  The emergence of compositional structures in perceptually grounded language games , 2005, Artif. Intell..

[15]  Simon Kirby,et al.  Spontaneous evolution of linguistic structure-an iterated learning model of the emergence of regularity and irregularity , 2001, IEEE Trans. Evol. Comput..

[16]  R. Jackendoff Possible stages in the evolution of the language capacity , 1999, Trends in Cognitive Sciences.

[17]  George Kingsley Zipf,et al.  Human Behaviour and the Principle of Least Effort: an Introduction to Human Ecology , 2012 .

[18]  Alison Wray,et al.  The transition to language , 2002 .

[19]  Gottlob Frege,et al.  Collected Papers on Mathematics, Logic, and Philosophy , 1991 .

[20]  D. Bickerton Language and Species , 1990 .

[21]  Simon Kirby,et al.  Linguistic Evolution Through Language Acquisition: Learning, bottlenecks and the evolution of recursive syntax , 2002 .

[22]  L. Steels Perceptually grounded meaning creation , 1996 .

[23]  Henry Brighton,et al.  Compositional Syntax From Cultural Transmission , 2002, Artificial Life.

[24]  Gillian Sankoff,et al.  10. On the Acquisition of Native Speakers by a Language , 1980 .

[25]  M. Tomasello Do young children have adult syntactic competence? , 2000, Cognition.

[26]  Paul Vogt,et al.  learning colour words is slow: a cross-situational learning account , 2005, Behavioral and Brain Sciences.

[27]  Eric Wanner,et al.  Language acquisition: the state of the art , 1982 .

[28]  Angelo Cangelosi,et al.  Simulating the Evolution of Language , 2002, Springer London.

[29]  Simon Kirby,et al.  Complex Systems in Language Evolution: the Cultural Emergence of Compositional Structure , 2003, Adv. Complex Syst..

[30]  Christopher Hookway Collected Papers on Mathematics, Logic and Philosophy , 1985 .

[31]  A. Wray Protolanguage as a holistic system for social interaction , 1998 .

[32]  Luc Steels,et al.  Emergent adaptive lexicons , 1996 .

[33]  Andrew D. M. Smith,et al.  The Inferential Transmission of Language , 2005, Adapt. Behav..

[34]  Federico Divina,et al.  Language evolution in large populations of autonomous agents : issues in scaling , 2005 .

[35]  Ann M. Peters,et al.  The Units of Language Acquisition , 1983 .

[36]  Paul Vogt Meaning development versus predefined meanings in language evolution models , 2005, IJCAI.

[37]  S. Pinker,et al.  Natural language and natural selection , 1990, Behavioral and Brain Sciences.

[38]  Matthijs den Besten,et al.  Environment design for emerging artificial societies , 2005 .

[39]  Ted Briscoe,et al.  Linguistic Evolution through Language Acquisition: Formal and Computational Models. , 2002 .

[40]  Edwin D. de Jong Analyzing the Evolution of Communication from a Dynamical Systems's Perspective , 1999, ECAL.

[41]  M. Minami How Children Learn the Meanings of Words , 2001 .

[42]  Noam Chomsky,et al.  Rules and Representations , 1982 .

[43]  Marc Schoenauer,et al.  Stability conditions in the evolution of compositional languages : issues in scaling population sizes , 2005 .

[44]  Tony Belpaeme,et al.  Explaining Universal Color Categories Through a Constrained Acquisition Process , 2005, Adapt. Behav..

[45]  Kellogg W. Hunt,et al.  The learning of language , 1972 .

[46]  L. Steels,et al.  coordinating perceptually grounded categories through language: a case study for colour , 2005, Behavioral and Brain Sciences.

[47]  Ilya Prigogine,et al.  Order out of chaos , 1984 .

[48]  M. Feldman,et al.  Cultural transmission and evolution: a quantitative approach. , 1981, Monographs in population biology.

[49]  Max Black,et al.  On concept and object , 1892 .