What you learn is what you see: using eye movements to study infant cross-situational word learning.

Recent studies show that both adults and young children possess powerful statistical learning capabilities to solve the word-to-world mapping problem. However, the underlying mechanisms that make statistical learning possible and powerful are not yet known. With the goal of providing new insights into this issue, the research reported in this paper used an eye tracker to record the moment-by-moment eye movement data of 14-month-old babies in statistical learning tasks. Various measures are applied to such fine-grained temporal data, such as looking duration and shift rate (the number of shifts in gaze from one visual object to the other) trial by trial, showing different eye movement patterns between strong and weak statistical learners. Moreover, an information-theoretic measure is developed and applied to gaze data to quantify the degree of learning uncertainty trial by trial. Next, a simple associative statistical learning model is applied to eye movement data and these simulation results are compared with empirical results from young children, showing strong correlations between these two. This suggests that an associative learning mechanism with selective attention can provide a cognitively plausible model of cross-situational statistical learning. The work represents the first steps in using eye movement data to infer underlying real-time processes in statistical word learning.

[1]  R. Aslin,et al.  PSYCHOLOGICAL SCIENCE Research Article UNSUPERVISED STATISTICAL LEARNING OF HIGHER-ORDER SPATIAL STRUCTURES FROM VISUAL SCENES , 2022 .

[2]  S. Gelman,et al.  How two-year-old children interpret proper and common names for unfamiliar objects. , 1984, Child development.

[3]  Eytan Ruppin,et al.  Unsupervised learning of natural languages , 2006 .

[4]  Zenzi M. Griffin,et al.  Constraint, Word Frequency, and the Relationship between Lexical Processing Levels in Spoken Word Production , 1998 .

[5]  Elissa L. Newport,et al.  The distributional structure of grammatical categories in speech to young children , 2002, Cogn. Sci..

[6]  Noam Chomsky.  Review of B.F. Skinner, Verbal Behavior , 1959 .

[7]  Joshua B. Tenenbaum,et al.  The Large-Scale Structure of Semantic Networks: Statistical Analyses and a Model of Semantic Growth , 2001, Cogn. Sci..

[8]  Scott P. Johnson,et al.  Visual statistical learning in infancy: evidence for a domain general learning mechanism , 2002, Cognition.

[9]  K Plunkett,et al.  Rapid word learning by fifteen-month-olds under tightly controlled conditions. , 1998, Child development.

[10]  Linda B. Smith,et al.  Rapid Word Learning Under Uncertainty via Cross-Situational Statistics , 2007, Psychological science.

[11]  E. Newport,et al.  Learning at a distance I. Statistical learning of non-adjacent dependencies , 2004, Cognitive Psychology.

[12]  Linda B. Smith,et al.  The importance of shape in early lexical learning , 1988 .

[13]  Morten H. Christiansen,et al.  Learning to Segment Speech Using Multiple Cues: A Connectionist Model , 1998 .

[14]  K. Hirsh-Pasek,et al.  The intermodal preferential looking paradigm: A window onto emerging language comprehension. , 1996 .

[15]  Kathy Hirsh-Pasek,et al.  Emergent Cues for Early Word Learning , 2013 .

[16]  W. Merriman,et al.  Restricting a familiar name in response to learning a new one: evidence for the mutual exclusivity bias in young two-year-olds. , 1997, Child development.

[17]  J. Halberda,et al.  The development of a word-learning strategy , 2003, Cognition.

[18]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[19]  Z. Griffin.  Why Look? Reasons for Eye Movements Related to Language Production. , 2004 .

[20]  Ping Li,et al.  The Acquisition of Word Meaning through Global Lexical Co-occurrences , 2000 .

[21]  Michael C. Frank,et al.  PSYCHOLOGICAL SCIENCE Research Article Using Speakers ’ Referential Intentions to Model Early Cross-Situational Word Learning , 2022 .

[22]  Mutsurni Irnai,et al.  A cross-linguistic study of early word meaning : universal ontology and linguistic influence , 1994 .

[23]  G. Altmann,et al.  Word meaning and the control of eye fixation: semantic competitor effects and the visual world paradigm , 2005, Cognition.

[24]  E. Markman,et al.  When it is better to receive than to give: Syntactic and conceptual constraints on vocabulary growth , 1994 .

[25]  C. Mervis,et al.  Early object labels: the case for a developmental lexical principles framework , 1994, Journal of Child Language.

[26]  Linda B. Smith,et al.  Hypothesis Testing and Associative Learning in Cross-Situational Word Learning: Are They One and the Same? , 2007 .

[27]  Peter M. Vishton,et al.  Predictive action in infancy: tracking and reaching for moving objects , 1998, Cognition.

[28]  T. Landauer,et al.  A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. , 1997 .

[29]  Morten H. Christiansen,et al.  The differential role of phonological and distributional cues in grammatical categorisation , 2005, Cognition.

[30]  R N Aslin,et al.  Statistical Learning by 8-Month-Old Infants , 1996, Science.

[31]  Peter M. Duppenthaler.  Maturational Constraints on Language Learning , 1990 .

[32]  S. Waxman,et al.  Word learning is ‘smart’: evidence that conceptual information affects preschoolers' extension of novel words , 2002, Cognition.

[33]  L. Cohen,et al.  Labels can override perceptual categories in early infancy , 2008, Cognition.

[34]  J. Elman.  Learning and development in neural networks: the importance of starting small , 1993, Cognition.

[35]  Letitia R. Naigles,et al.  Children use syntax to learn verb meanings , 1990, Journal of Child Language.

[36]  L. Gleitman,et al.  Hard Words , 2005, Language in Development.

[37]  Leslie M. Bailey,et al.  Young children and adults use lexical principles to learn New Nouns , 1992 .

[38]  Christopher D. Manning,et al.  Probabilistic models of language processing and acquisition , 2006, Trends in Cognitive Sciences.

[39]  Linda B. Smith,et al.  Infants rapidly learn word-referent mappings via cross-situational statistics , 2008, Cognition.

[40]  Richard N Aslin,et al.  Automated Corneal-reflection Eye Tracking in Infancy: Methodological Developments and Applications to Cognition Calibration of Eye-tracking Systems , 2022 .

[41]  K. Plunkett,et al.  Learning Words Over Time: The Role of Stimulus Repetition in Mutual Exclusivity. , 2009, Infancy : the official journal of the International Society on Infant Studies.

[42]  Chen Yu,et al.  A Statistical Associative Account of Vocabulary Growth in Early Word Learning , 2008 .

[43]  Zenzi M. Griffin,et al.  Why Look? Reasons for Eye Movements Related to Language Production. , 2004 .

[44]  R. Gómez,et al.  Artificial grammar learning by 1-year-olds leads to specific and abstract knowledge , 1999, Cognition.

[45]  Ellen M. Markman,et al.  Constraints Children Place on Word Meanings , 1990, Cogn. Sci..

[46]  Scott P. Johnson,et al.  Development of object concepts in infancy: Evidence for early learning in an eye-tracking paradigm , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[47]  R. Aslin,et al.  Lexical competition in young children’s word learning , 2007, Cognitive Psychology.

[48]  J. Halberda,et al.  Is this a dax which I see before me? Use of the logical argument disjunctive syllogism supports word-learning in children and adults , 2006, Cognitive Psychology.

[49]  Manuela Friedrich,et al.  Early Word Learning , 2010 .

[50]  J. Tenenbaum,et al.  Word learning as Bayesian inference. , 2007, Psychological review.

[51]  Julie C. Sedivy,et al.  Subject Terms: Linguistics Language Eyes & eyesight Cognition & reasoning , 1995 .

[52]  Rebecca J. Brand,et al.  Breaking the language barrier: an emergentist coalition model for the origins of word learning. , 2000, Monographs of the Society for Research in Child Development.

[53]  I. Sigel,et al.  HANDBOOK OF CHILD PSYCHOLOGY , 2006 .

[54]  F. Keil.  Concepts, Kinds, and Cognitive Development , 1989 .

[55]  S. Waxman,et al.  Basic level object categories support the acquisition of novel adjectives: evidence from preschool-aged children. , 2000, Child development.

[56]  Lila R. Gleitman,et al.  Why It Is Hard to Label Our Concepts. , 2004 .

[57]  J. Michael.  Verbal behavior. , 1984, Journal of the experimental analysis of behavior.

[58]  L. Gleitman.  The Structural Sources of Verb Meanings , 2020, Sentence First, Arguments Afterward.

[59]  Robert M. Gonyea,et al.  Learning at a Distance : , 2009 .

[60]  Judith F. Feldman,et al.  Infant visual recognition memory: independent contributions of speed and attention. , 2003, Developmental psychology.

[61]  Matthew W. Crocker,et al.  The Coordinated Interplay of Scene, Utterance, and World Knowledge: Evidence From Eye Tracking , 2006, Cogn. Sci..

[62]  J. Siskind.  A computational study of cross-situational techniques for learning word-to-meaning mappings , 1996, Cognition.

[63]  Chen Yu,et al.  The Role of Embodied Intention in Early Lexical Acquisition , 2005, Cogn. Sci..

[64]  R. Nandakumar,et al.  Lexical principles may underlie the learning of verbs. , 1996, Child development.

[65]  W. Levelt,et al.  Viewing and naming objects: eye movements during noun phrase production , 1998, Cognition.