Minimal model of associative learning for cross-situational lexicon acquisition

Abstract An explanation for the acquisition of word–object mappings is the associative learning in a cross-situational scenario. Here we present analytical results of the performance of a simple associative learning algorithm for acquiring a one-to-one mapping between N objects and N words based solely on the co-occurrence between objects and words. In particular, a learning trial in our learning scenario consists of the presentation of C + 1 N objects together with a target word, which refers to one of the objects in the context. We find that the learning times are distributed exponentially and the learning rates are given by ln [ N ( N − 1 ) C + ( N − 1 ) 2 ] in the case the N target words are sampled randomly and by 1 N ln [ N − 1 C ] in the case they follow a deterministic presentation sequence. This learning performance is much superior to those exhibited by humans and more realistic learning algorithms in cross-situational experiments. We show that introduction of discrimination limitations using Weber’s law and forgetting reduce the performance of the associative algorithm to the human level.

[1]  P. Cameron.  Combinatorics: Topics, Techniques, Algorithms , 1995 .

[2]  Chen Yu,et al.  Frequency and Contextual Diversity Effects in Cross-Situational Word Learning , 2009 .

[3]  Angelo Cangelosi,et al.  2009 Special Issue: Cross-situational learning of object-word mapping using Neural Modeling Fields , 2009 .

[4]  Chen Yu,et al.  Statistical Cross-Situational Learning to Build Word-to-World Mappings , 2006 .

[5]  Linda B. Smith,et al.  Rapid Word Learning Under Uncertainty via Cross-Situational Statistics , 2007, Psychological science.

[6]  P. Bloom.  How Children Learn the Meaning of Words and How LSA Does It ( Too ) , 2005 .

[7]  J. Tenenbaum,et al.  Word learning as Bayesian inference. , 2007, Psychological review.

[8]  Michael C. Frank,et al.  A Bayesian Framework for Cross-Situational Word-Learning , 2007, NIPS.

[9]  R. Shiffrin,et al.  An associative model of adaptive inference for learning word–referent mappings , 2012, Psychonomic bulletin & review.

[10]  Ellen M. Markman,et al.  Constraints Children Place on Word Meanings , 1990, Cogn. Sci..

[11]  J. Elman,et al.  Learning Rediscovered , 1996, Science.

[12]  A. Nowe,et al.  Quantifying lexicon acquisition under uncertainty , 2004 .

[13]  Frederick Mosteller,et al.  Stochastic Models for Learning , 1956 .

[14]  Heidi Kloos,et al.  PSYCHOLOGICAL SCIENCE Research Article When Looks Are Everything Appearance Similarity Versus Kind Information in Early Induction , 2022 .

[15]  José F. Fontanari,et al.  Critical behavior in a cross-situational lexicon learning scenario , 2012, ArXiv.

[16]  Feller William,et al.  An Introduction To Probability Theory And Its Applications , 1950 .

[17]  J. Siskind.  A computational study of cross-situational techniques for learning word-to-meaning mappings , 1996, Cognition.

[18]  Kenny Smith,et al.  Learning Times for Large Lexicons Through Cross-Situational Learning , 2010, Cogn. Sci..

[19]  Kenny Smith,et al.  Cross-Situational Learning: An Experimental Study of Word-Learning Mechanisms , 2011, Cogn. Sci..

[20]  Willard Van Orman Quine,et al.  Word and Object , 1960 .

[21]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1967 .

[22]  Chen Yu,et al.  A Statistical Associative Account of Vocabulary Growth in Early Word Learning , 2008 .

[23]  L. Gleitman.  The Structural Sources of Verb Meanings , 2020, Sentence First, Arguments Afterward.

[24]  Kenny Smith,et al.  Cross-Situational Learning: A Mathematical Approach , 2006, EELC.

[25]  Andrew D. M. Smith.  Intelligent Meaning Creation in a Clumpy World Helps Communication , 2003, Artificial Life.

[26]  R. Adolphs.  Cognitive neuroscience: Cognitive neuroscience of human social behaviour , 2003, Nature Reviews Neuroscience.

[27]  Steven Pinker,et al.  Language learnability and language development , 1985 .

[28]  Angelo Cangelosi,et al.  Cross-situational and supervised learning in the emergence of communication , 2009, 0901.4012.

[29]  Andrew D. M. Smith,et al.  Semantic Generalisation and the Inference of Meaning , 2003, ECAL.

[30]  S. Waxman,et al.  Early word-learning entails reference, not merely associations , 2009, Trends in Cognitive Sciences.

[31]  Chen Yu,et al.  Modeling cross-situational word-referent learning: prior questions. , 2012, Psychological review.