How to Make the Most out of Very Little

I review the problem of referential ambiguity that arises when children learn the meanings of words, along with a number of models that have been proposed to solve it. I then provide a formal analysis of why a resource-limited model that retains very few meaning hypotheses may be more effective than "big data" models that keep track of all word-meaning associations.

[1]  Dana Angluin,et al.  Inductive Inference of Formal Languages from Positive Data , 1980, Inf. Control..

[2]  John C. Trueswell,et al.  Multiple Proposal Memory in Observational Word Learning , 2013, CogSci.

[3]  Lila R. Gleitman,et al.  A Picture Is Worth a Thousand Words, but That's the Problem: The Role of Syntax in Vocabulary Acquisition , 1992 .

[4]  Dare A. Baldwin,et al.  Infants' contribution to the achievement of joint reference. , 1991, Child development.

[5]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[6]  B. MacWhinney.  The CHILDES project: tools for analyzing talk , 1992 .

[7]  Charles D. Yang,et al.  Knowledge and learning in natural language , 2000 .

[8]  M. Tomasello,et al.  Joint attention and early language. , 1986, Child development.

[9]  Marc'Aurelio Ranzato,et al.  Building high-level features using large scale unsupervised learning , 2011, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[10]  L. Gleitman.  The Structural Sources of Verb Meanings , 2020, Sentence First, Arguments Afterward.

[11]  W S Murray,et al.  Serial mechanisms in lexical access: the rank hypothesis. , 2004, Psychological review.

[12]  Steven Pinker,et al.  Language learnability and language development , 1985 .

[13]  Dedre Gentner,et al.  Why Nouns Are Learned before Verbs: Linguistic Relativity Versus Natural Partitioning. Technical Report No. 257. , 1982 .

[14]  John R. Anderson,et al.  Reflections of the Environment in Memory Form of the Memory Functions , 2022 .

[15]  Inge-Marie Eigsti,et al.  Mutual exclusivity in autism spectrum disorders: Testing the pragmatic hypothesis , 2011, Cognition.

[16]  R. Rescorla,et al.  A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement , 1972 .

[17]  Stefanie Tellex,et al.  The Human Speechome Project , 2006, EELC.

[18]  Linda B. Smith,et al.  Infants rapidly learn word-referent mappings via cross-situational statistics , 2008, Cognition.

[19]  Chen Yu,et al.  A bottom-up view of toddler word learning , 2013, Psychonomic Bulletin & Review.

[20]  Patrice D. Tremoulet,et al.  Perceptual causality and animacy , 2000, Trends in Cognitive Sciences.

[21]  L. Gleitman,et al.  Hard Words , 2005, Language in Development.

[22]  Afsaneh Fazly,et al.  A Probabilistic Computational Model of Cross-Situational Word Learning , 2010, Cogn. Sci..

[23]  Letitia R. Naigles,et al.  Children use syntax to learn verb meanings , 1990, Journal of Child Language.

[24]  D. Swinney.  Lexical access during sentence comprehension: (Re)consideration of context effects , 1979 .

[25]  Janet D. Fodor.  Unambiguous Triggers , 1998, Linguistic Inquiry.

[26]  R. Herrnstein,et al.  Maximizing and matching on concurrent ratio schedules. , 1975, Journal of the experimental analysis of behavior.

[27]  L. Gleitman,et al.  The Pursuit of Word Meanings. , 2017, Cognitive science.

[28]  Charles D. Yang.  Universal Grammar, statistics or both? , 2004, Trends in Cognitive Sciences.

[29]  L. Gleitman,et al.  Language and Experience: Evidence from the Blind Child , 1988 .

[30]  Kathy Hirsh-Pasek,et al.  Fast mapping word meanings across trials: Young children forget all but their first guess , 2018, Cognition.

[31]  E. Markman,et al.  When it is better to receive than to give: Syntactic and conceptual constraints on vocabulary growth , 1994 .

[32]  Letitia R. Naigles,et al.  The use of multiple frames in verb learning via syntactic bootstrapping , 1996, Cognition.

[33]  Robert C. Berwick,et al.  The acquisition of syntactic knowledge , 1985 .

[34]  Chen Yu,et al.  A unified model of early word learning: Integrating statistical and social cues , 2007, Neurocomputing.

[35]  Constantine Lignos.  Modeling words in the mind , 2013 .

[36]  R. R. Bush,et al.  A Mathematical Model for Simple Learning , 1951 .

[37]  Amanda L. Woodward,et al.  Infants’ developing understanding of the link between looker and object , 2003 .

[38]  S. Pinker.  How could a child use verb syntax to learn verb semantics , 1994 .

[39]  Noam Chomsky,et al.  A Review of B. F. Skinner's Verbal Behavior , 1980 .

[40]  L. Gleitman,et al.  How words can and cannot be learned by observation , 2011, Proceedings of the National Academy of Sciences.

[41]  S. Sternberg.  Memory-scanning: mental processes revealed by reaction-time experiments. , 1969, American scientist.

[42]  J. Elman.  Learning and development in neural networks: the importance of starting small , 1993, Cognition.

[43]  P. Dayan,et al.  Decision theory, reinforcement learning, and the brain , 2008, Cognitive, affective & behavioral neuroscience.

[44]  J. Siskind.  A computational study of cross-situational techniques for learning word-to-meaning mappings , 1996, Cognition.

[45]  Richard J. Herrnstein,et al.  MAXIMIZING AND MATCHING ON CONCURRENT RATIO SCHEDULES1 , 1975 .

[46]  Linda B. Smith,et al.  Rapid Word Learning Under Uncertainty via Cross-Situational Statistics , 2007, Psychological science.

[47]  L. Gleitman,et al.  Propose but verify: Fast mapping meets cross-situational word learning , 2013, Cognitive Psychology.

[48]  Michael C. Frank,et al.  PSYCHOLOGICAL SCIENCE Research Article Using Speakers ’ Referential Intentions to Model Early Cross-Situational Word Learning , 2022 .

[49]  Larissa K. Samuelson,et al.  Word learning emerges from the interaction of online referent selection and slow associative learning. , 2012, Psychological review.

[50]  Roger S. Brown,et al.  Linguistic determinism and the part of speech. , 1957, Journal of abnormal psychology.

[51]  Noam Chomsky.  Review of B.F. Skinner, Verbal Behavior , 1959 .

[52]  Elissa L. Newport,et al.  Maturational Constraints on Language Learning , 1990, Cogn. Sci..

[53]  E. Markman,et al.  Use of the mutual exclusivity assumption by young word learners , 2003, Cognitive Psychology.

[54]  Ellen M. Markman,et al.  Constraints Children Place on Word Meanings , 1990, Cogn. Sci..

[55]  Susan Goldin-Meadow,et al.  Perceiving referential intent: Dynamics of reference in natural parent–child interactions , 2016, Cognition.

[56]  Susan Carey,et al.  Acquiring a Single New Word , 1978 .

[57]  Willard Van Orman Quine,et al.  Word and Object , 1960 .

[58]  H. Gleitman,et al.  Human simulations of vocabulary learning , 1999, Cognition.