Emergence of Scale-Free Syntax Networks

The evolution of human language allowed the efficient propagation of nongenetic information, thus creating a new form of evolutionary change. Language development in children offers the opportunity of exploring the emergence of such complex communication system and provides a window to understanding the transition from protolanguage to language. Here we present the first analysis of the emergence of syntax in terms of complex networks. A previously unreported, sharp transition is shown to occur around two years of age from a (pre-syntactic) tree-like structure to a scale-free, small world syntax network. The observed combinatorial patterns provide valuable data to understand the nature of the cognitive processes involved in the acquisition of syntax, introducing a new ingredient to understand the possible biological endowment of human beings which results in the emergence of complex language. We explore this problem by using a minimal, data-driven model that is able to capture several statistical traits, but some key features related to the emergence of syntactic complexity display important divergences.

[1]  Partha Niyogi,et al.  Optimizing the mutual intelligibility of linguistic agents in a shared world , 2004, Artif. Intell..

[2]  Reinhard Köhler,et al.  Patterns in syntactic dependency networks. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[3]  Ramon Ferrer i Cancho,et al.  The small world of human language , 2001, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[4]  Partha Niyogi,et al.  Book Reviews: The Computational Nature of Language Learning and Evolution, by Partha Niyogi , 2007, CL.

[5]  S. Pinker The Language Instinct , 1994 .

[6]  KE Jinyun,et al.  Complex networks and human language , 2007, cs/0701135.

[7]  S. Gould,et al.  The spandrels of San Marco and the Panglossian paradigm: a critique of the adaptationist programme , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[8]  Andrew Radford,et al.  Syntactic Theory and the Acquisition of English Syntax: The Nature of Early Child Grammars of English , 1990 .

[9]  G. A. Miller,et al.  Finitary models of language users , 1963 .

[10]  B. Goodwin,et al.  Signs Of Life: How Complexity Pervades Biology , 2000 .

[11]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[12]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[13]  Anna L. Theakston,et al.  The role of performance limitations in the acquisition of verb-argument structure: an alternative account. , 2001, Journal of child language.

[14]  R. Mishra Pierre-Yves Oudeyer Self-Organization in the Evolution of Speech , 2011, Cognitive Systems Research.

[15]  R. Solé,et al.  Are network motifs the spandrels of cellular complexity? , 2006, Trends in ecology & evolution.

[16]  Stuart A. Kauffman,et al.  The origins of order , 1993 .

[17]  John Scott What is social network analysis , 2010 .

[18]  M A Nowak,et al.  The evolutionary dynamics of grammar acquisition. , 2001, Journal of theoretical biology.

[19]  M E J Newman Assortative mixing in networks. , 2002, Physical review letters.

[20]  Bernat Corominas-Murtra,et al.  Network statistics on early English Syntax: Structural criteria , 2007, ArXiv.

[21]  Joshua B. Tenenbaum,et al.  The Large-Scale Structure of Semantic Networks: Statistical Analyses and a Model of Semantic Growth , 2001, Cogn. Sci..

[22]  Tom A. B. Snijders,et al.  Social Network Analysis , 2011, International Encyclopedia of Statistical Science.

[23]  Béla Bollobás,et al.  Random Graphs: Notation , 2001 .

[24]  D. Champion,et al.  Book Review:Assimilation in American Life: The Role of Race, Religion, and National Origins. Milton M. Gordon , 1965 .

[25]  T. Deacon The Symbolic Species: The Co-evolution of Language and the Brain , 1998 .

[26]  Eörs Szathmáry,et al.  Selective scenarios for the emergence of natural language. , 2006, Trends in ecology & evolution.

[27]  E. Veneziano,et al.  The changing status of ‘filler syllables’ on the way to grammatical morphemes , 2000, Journal of Child Language.

[28]  Alan M. Frieze,et al.  Random graphs , 2006, SODA '06.

[29]  Béla Bollobás,et al.  The consequences of Zipf's law for syntax and symbolic reference , 2005, Proceedings of the Royal Society B: Biological Sciences.

[30]  J. Elman Learning and development in neural networks: the importance of starting small , 1993, Cognition.

[31]  W. Strange Evolution of language. , 1984, JAMA.

[32]  B. MacWhinney The CHILDES project: tools for analyzing talk , 1992 .

[33]  Angelo Cangelosi,et al.  Emergence of Communication and Language , 2006 .

[34]  Ricard V. Solé,et al.  Least effort and the origins of scaling in human language , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[35]  S. Pinker,et al.  Natural language and natural selection , 1990, Behavioral and Brain Sciences.

[36]  Mariano Sigman,et al.  Global organization of the Wordnet lexicon , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[37]  S N Dorogovtsev,et al.  Language as an evolving word web , 2001, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[38]  James R. Hurford,et al.  Biological evolution of the Saussurean sign as a component of the language acquisition device , 1989 .

[39]  Peter Harremoës,et al.  Maximum Entropy Fundamentals , 2001, Entropy.

[40]  P. Lightbown,et al.  Structure and variation in child language. , 1975 .

[41]  Arantxa Etxeverria The Origins of Order , 1993 .

[42]  D. McNeill Language and species , 1992, International Journal of Primatology.

[43]  Richard Hudson,et al.  Language Networks: The New Word Grammar , 2007 .

[44]  Pierre-Yves Oudeyer,et al.  Self-Organization in the Evolution of Speech , 2006, Oxford Studies in the Evolution of Language.

[45]  Wilhelm Freiherr von Humboldt,et al.  On Language: On the Diversity of Human Language Construction and Its Influence on the Mental Development of the Human Species , 2001 .

[46]  Noam Chomsky,et al.  The faculty of language: what is it, who has it, and how did it evolve? , 2002, Science.

[47]  Eörs Szathmáry,et al.  In silico Evolutionary Developmental Neurobiology and the Origin of Natural Language (Abstract) , 2008, AFL.

[48]  Peter M. Duppenthaler Maturational Constraints on Language Learning , 1990 .

[49]  Noam Chomsky Language and Problems of Knowledge , 1987 .

[50]  Jinyun Ke,et al.  Complex networks and human language , 2007, ArXiv.

[51]  Luc Steels,et al.  The synthetic modeling of language origins , 1997 .

[52]  S. N. Dorogovtsev,et al.  Evolution of networks , 2001, cond-mat/0106144.

[53]  Ricard Solé,et al.  Language: Syntax for free? , 2005, Nature.

[54]  D. Dennett Darwin's Dangerous Idea , 1995 .

[55]  Morten H. Christiansen,et al.  Language evolution: consensus and controversies , 2003, Trends in Cognitive Sciences.

[56]  Susan Bowsfield The Symbolic Species: The Co-Evolution of Language and the Brain , 2004 .

[57]  Eörs Szathmáry,et al.  The Major Transitions in Evolution , 1997 .

[58]  Brian MacWhinney,et al.  The emergence of linguistic form in time , 2005, Connect. Sci..

[59]  P. Holland,et al.  A Method for Detecting Structure in Sociometric Data , 1970, American Journal of Sociology.

[60]  P. Lightbown,et al.  Imitation in language development: If, when, and why , 1974 .

[61]  S. Gould The Structure of Evolutionary Theory , 2002 .