Exploring the Robustness of Cross-Situational Learning Under Zipfian Distributions

Cross-situational learning has recently gained attention as a plausible candidate for the mechanism that underlies the learning of word-meaning mappings. In a recent study, Blythe and colleagues have studied how many trials are theoretically required to learn a human-sized lexicon using cross-situational learning. They show that the level of referential uncertainty exposed to learners could be relatively large. However, one of the assumptions they made in designing their mathematical model is questionable. Although they rightfully assumed that words are distributed according to Zipf's law, they applied a uniform distribution of meanings. In this article, Zipf's law is also applied to the distribution of meanings, and it is shown that under this condition, cross-situational learning can only be plausible when referential uncertainty is sufficiently small. It is concluded that cross-situational learning is a plausible learning mechanism but needs to be guided by heuristics that aid word learners with reducing referential uncertainty.

[1]  George Kingsley Zipf,et al.  Human behavior and the principle of least effort , 1949 .

[2]  S. Carey The child as word learner , 1978 .

[3]  G. Miller,et al.  Cognitive science. , 1981, Science.

[4]  Dmitrii Y. Manin,et al.  Zipf's Law and Avoidance of Excessive Synonymy , 2007, Cogn. Sci..

[5]  Michael C. Frank,et al.  A Bayesian Framework for Cross-Situational Word-Learning , 2007, NIPS.

[6]  Kenny Smith,et al.  Cross-Situational Learning: A Mathematical Approach , 2006, EELC.

[7]  E. Markman,et al.  Children's use of mutual exclusivity to constrain the meanings of words , 1988, Cognitive Psychology.

[8]  M. Tomasello,et al.  Joint attention and lexical acquisition style , 1983 .

[9]  P. Bloom How children learn the meanings of words , 2000 .

[10]  Phil Husbands,et al.  Minimum cost and the emergence of the Zipf-Mandelbrot law , 2004 .

[11]  Chrystopher L. Nehaniv,et al.  Symbol Grounding and Beyond, Third International Workshop on the Emergence and Evolution of Linguistic Communication, EELC 2006, Rome, Italy, September 30 - October 1, 2006, Proceedings , 2006, EELC.

[12]  Yuen Ren Chao,et al.  Human Behavior and the Principle of Least Effort: An Introduction to Human Ecology , 1950 .

[13]  Linda B. Smith,et al.  Infants rapidly learn word-referent mappings via cross-situational statistics , 2008, Cognition.

[14]  J. Macnamara Names for Things: A Study in Human Learning , 1984 .

[15]  M. R. Manzini Learnability and Cognition , 1991 .

[16]  N. Akhtar,et al.  Early lexical acquisition: the role of cross-situational learning , 1999 .

[17]  Susan Carey,et al.  Acquiring a Single New Word , 1978 .

[18]  Sandra R. Waxman,et al.  Weaving a Lexicon , 2004 .

[19]  B. Corominas-Murtra,et al.  Universality of Zipf's law. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[20]  Chen Yu,et al.  The Role of Embodied Intention in Early Lexical Acquisition , 2005, Cogn. Sci..

[21]  Eve V. Clark,et al.  The Lexicon in Acquisition , 1996 .

[22]  A. Alishahi,et al.  Cross-situational Learning of Low Frequency Words: The Role of Context Familiarity and Age of Exposure , 2010 .

[23]  Andrew D. M. Smith,et al.  Mutual Exclusivity: Communicative Success Despite Conceptual Divergence , 2005 .

[24]  Eleanor Rosch,et al.  Principles of Categorization , 1978 .

[25]  Paul Vogt,et al.  Minimum cost and the emergence of the Zipf-Mandelbrot law , 2004 .

[26]  Todd R. Risley,et al.  The Early Catastrophe. The 30 Million Word Gap. , 2003 .

[27]  Afsaneh Fazly,et al.  A Probabilistic Computational Model of Cross-Situational Word Learning , 2010, Cogn. Sci..

[28]  Chen Yu,et al.  Frequency and Contextual Diversity Effects in Cross-Situational Word Learning , 2009 .

[29]  J. M. Anglin Vocabulary Development: A Morphological Analysis , 1994 .

[30]  Afsaneh Fazly,et al.  Integrating Syntactic Knowledge into a Model of Cross-situational Word Learning , 2010 .

[31]  J. Siskind A computational study of cross-situational techniques for learning word-to-meaning mappings , 1996, Cognition.

[32]  Kim Plunkett,et al.  ‘Word-learning wizardry’ at 1;6 , 2005, Journal of Child Language.

[33]  R. Martorell,et al.  Early supplementary feeding and cognition: effects over two decades. , 1969, Monographs of the Society for Research in Child Development.

[34]  H. Gleitman,et al.  Human simulations of vocabulary learning , 1999, Cognition.

[35]  Eve V. Clark,et al.  First Language Acquisition , 2002, The Study of Language.

[36]  Chen Yu,et al.  A unified model of early word learning: Integrating statistical and social cues , 2007, Neurocomputing.

[37]  Kenny Smith,et al.  Learning Times for Large Lexicons Through Cross-Situational Learning , 2010, Cogn. Sci..

[38]  George Kingsley Zipf,et al.  Human Behaviour and the Principle of Least Effort: an Introduction to Human Ecology , 2012 .