Reinforcement and inference in cross-situational word learning

Cross-situational word learning is based on the notion that a learner can determine the referent of a word by finding something in common across many observed uses of that word. Here we propose an adaptive learning algorithm that contains a parameter that controls the strength of the reinforcement applied to associations between concurrent words and referents, and a parameter that regulates inference, which includes built-in biases, such as mutual exclusivity, and information of past learning events. By adjusting these parameters so that the model predictions agree with data from representative experiments on cross-situational word learning, we were able to explain the learning strategies adopted by the participants of those experiments in terms of a trade-off between reinforcement and inference. These strategies can vary wildly depending on the conditions of the experiments. For instance, for fast mapping experiments (i.e., the correct referent could, in principle, be inferred in a single observation) inference is prevalent, whereas for segregated contextual diversity experiments (i.e., the referents are separated in groups and are exhibited with members of their groups only) reinforcement is predominant. Other experiments are explained with more balanced doses of reinforcement and inference.

[1]  Chen Yu,et al.  Frequency and Contextual Diversity Effects in Cross-Situational Word Learning , 2009 .

[2]  Afsaneh Fazly,et al.  A Probabilistic Computational Model of Cross-Situational Word Learning , 2010, Cogn. Sci..

[3]  Paul Vogt Exploring the Robustness of Cross-Situational Learning Under Zipfian Distributions , 2012, Cogn. Sci..

[4]  Chen Yu,et al.  Modeling cross-situational word-referent learning: prior questions. , 2012, Psychological review.

[5]  J.F. Fontanari,et al.  Integrating Language and Cognition: A Cognitive Robotics Approach , 2007, IEEE Computational Intelligence Magazine.

[6]  Harley Bornbach,et al.  An introduction to mathematical learning theory , 1967 .

[7]  Dare A. Baldwin,et al.  Infants' reliance on a social criterion for establishing word-object relations. , 1996, Child development.

[8]  José F. Fontanari,et al.  Minimal model of associative learning for cross-situational lexicon acquisition , 2012, ArXiv.

[9]  Michael J. Spivey,et al.  Computational Grounded Cognition: a new alliance between grounded cognition and computational modeling , 2013, Front. Psychology.

[10]  George E. Ferris,et al.  An Introduction to Mathematical Learning Theory , 1966 .

[11]  Kenny Smith,et al.  Stochastic dynamics of lexicon learning in an uncertain and nonuniform world. , 2013, Physical review letters.

[12]  L. Gleitman The Structural Sources of Verb Meanings , 2020, Sentence First, Arguments Afterward.

[13]  Angelo Cangelosi,et al.  2009 Special Issue: Cross-situational learning of object-word mapping using Neural Modeling Fields , 2009 .

[14]  Angelo Cangelosi,et al.  Cross-situational and supervised learning in the emergence of communication , 2009, 0901.4012.

[15]  L. Steels Modeling the cultural evolution of language. , 2011, Physics of life reviews.

[16]  Linda B. Smith,et al.  Rapid Word Learning Under Uncertainty via Cross-Situational Statistics , 2007, Psychological science.

[17]  A. Newell Unified Theories of Cognition , 1990 .

[18]  Linda B. Smith,et al.  Visual Attention Is Not Enough: Individual Differences in Statistical Word-Referent Learning in Infants , 2013, Language learning and development : the official journal of the Society for Language Development.

[19]  S. Waxman,et al.  Early word-learning entails reference, not merely associations , 2009, Trends in Cognitive Sciences.

[20]  Kenny Smith,et al.  Learning Times for Large Lexicons Through Cross-Situational Learning , 2010, Cogn. Sci..

[21]  José F. Fontanari,et al.  Critical behavior in a cross-situational lexicon learning scenario , 2012, ArXiv.

[22]  R. Shiffrin,et al.  An associative model of adaptive inference for learning word–referent mappings , 2012, Psychonomic bulletin & review.

[23]  Angelo Cangelosi,et al.  Grounding language in action and perception: from cognitive agents to humanoid robots. , 2010, Physics of life reviews.

[24]  P. Bloom How Children Learn the Meaning of Words and How LSA Does It ( Too ) , 2005 .

[25]  Michael C. Frank,et al.  PSYCHOLOGICAL SCIENCE Research Article Using Speakers ’ Referential Intentions to Model Early Cross-Situational Word Learning , 2022 .

[26]  Kenny Smith,et al.  Cross-Situational Learning: An Experimental Study of Word-Learning Mechanisms , 2011, Cogn. Sci..

[27]  Steven Pinker,et al.  Language learnability and language development , 1985 .

[28]  L. Steels Evolving grounded communication for robots , 2003, Trends in Cognitive Sciences.

[29]  J. Siskind A computational study of cross-situational techniques for learning word-to-meaning mappings , 1996, Cognition.

[30]  Chen Yu,et al.  Embodied attention and word learning by toddlers , 2012, Cognition.

[31]  E. Markman,et al.  Children's use of mutual exclusivity to constrain the meanings of words , 1988, Cognitive Psychology.

[32]  Linda B. Smith,et al.  Statistical Cross-Situational Learning in Adults and Infants , 2008 .