Learning to predict or predicting to learn?

ABSTRACT Humans complete complex commonplace tasks, such as understanding sentences, with striking speed and accuracy. This expertise is dependent on anticipation: predicting upcoming words gets us ahead of the game. But how do we master the game in the first place? To make accurate predictions, children must first learn their language. One possibility is that prediction serves double duty, enabling rapid language learning as well as understanding. Children could master the structures of their language by predicting how speakers will behave and, when those guesses are wrong, revising their linguistic representations. A number of prominent computational models assume that children learn in this way. But is that assumption correct? Here, we lay out the requirements for showing that children use “predictive learning”, and review the current evidence for this position. We argue that, despite widespread enthusiasm for the idea, we cannot yet conclude that children “predict to learn”.

[1]  Jesse Snedeker,et al.  The use of lexical and referential cues in children's online interpretation of adjectives. , 2013, Developmental psychology.

[2]  V. Marchman,et al.  Speed of word recognition and vocabulary knowledge in infancy predict cognitive and language outcomes in later childhood. , 2008, Developmental science.

[3]  B. Ambridge,et al.  The development of abstract syntax: Evidence from structural priming and the lexical boost , 2012, Cognition.

[4]  James L. Morgan,et al.  Signal to syntax : bootstrapping from speech to grammar in early acquisition , 1996 .

[5]  Anne Fernald,et al.  Individual differences in lexical processing at 18 months predict vocabulary growth in typically developing and late-talking toddlers. , 2012, Child development.

[6]  M. Pickering,et al.  Toward a mechanistic psychology of dialogue , 2004, Behavioral and Brain Sciences.

[7]  M. Bar The proactive brain: using analogies and associations to generate predictions , 2007, Trends in Cognitive Sciences.

[8]  J. Elman,et al.  Knowing a lot for one's age: Vocabulary skill and not age is associated with anticipatory incremental sentence interpretation in children and adults. , 2012, Journal of experimental child psychology.

[9]  John Duncan,et al.  Shape-specific preparatory activity mediates attention to targets in human visual cortex , 2009, Proceedings of the National Academy of Sciences.

[10]  J. Tenenbaum,et al.  The learnability of abstract syntactic principles , 2011, Cognition.

[11]  Kara D. Federmeier,et al.  The N400 as a snapshot of interactive processing: Evidence from regression analyses of orthographic neighbor and lexical associate effects. , 2011, Psychophysiology.

[12]  M. Grice,et al.  The role of prosody in the interpretation of structural ambiguities: A study of anticipatory eye movements , 2006, Cognition.

[13]  Melissa Bowerman,et al.  Commentary: Mechanisms of language acquisition , 1987 .

[14]  Michael C. Frank,et al.  PSYCHOLOGICAL SCIENCE Research Article Using Speakers ’ Referential Intentions to Model Early Cross-Situational Word Learning , 2022 .

[15]  Vieri Samek-Lodovici,et al.  The role of prosody , 2015 .

[16]  A. Markman,et al.  The Curse of Planning: Dissecting Multiple Reinforcement-Learning Systems by Taxing the Central Executive , 2013 .

[17]  Martin D. S. Braine,et al.  The Ontogeny of English Phrase Structure: The First Phase , 1963 .

[18]  Franklin Chang,et al.  Do Lemmas Speak German? A Verb Position Effect in German Structural Priming , 2015, Cogn. Sci..

[19]  Peter,et al.  Semantic Unification , 2008 .

[20]  J. Magnuson,et al.  The time course of anticipatory constraint integration , 2011, Cognition.

[21]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[22]  Jesse Snedeker,et al.  Cascading activation across levels of representation in children's lexical processing. , 2011, Journal of child language.

[23]  S. Pinker Learnability and Cognition: The Acquisition of Argument Structure , 1989 .

[24]  B. Ross The Psychology of Learning and Motivation , 2012 .

[25]  J. Trueswell,et al.  The developing constraints on parsing decisions: The role of lexical-biases and referential scenes in child and adult sentence processing , 2004, Cognitive Psychology.

[26]  M. Pickering,et al.  An integrated theory of language production and comprehension. , 2013, The Behavioral and brain sciences.

[27]  Thomas T. Hills,et al.  Model-Based Reinforcement Learning as Cognitive Search: Neurocomputational Theories , 2012 .

[28]  J. Snedeker Effects of prosodic and lexical constraints on parsing in young children (and adults). , 2008, Journal of memory and language.

[29]  Holly P. Branigan,et al.  A blue cat or a cat that is blue? Evidence for abstract syntax in young children's noun phrases , 2005 .

[30]  Kenneth Wexler,et al.  Formal Principles of Language Acquisition , 1980 .

[31]  G. Marcus The Algebraic Mind: Integrating Connectionism and Cognitive Science , 2001 .

[32]  R. Levy Expectation-based syntactic comprehension , 2008, Cognition.

[33]  J. Elman Learning and development in neural networks: the importance of starting small , 1993, Cognition.

[34]  J. Snedeker,et al.  Syntactic priming during language comprehension in three- and four-year-old children , 2008 .

[35]  S. Crain,et al.  Language Acquisition , 2008 .

[36]  A. Fernald,et al.  Young Children Learning Spanish Make Rapid Use of Grammatical Gender in Spoken Word Recognition , 2007, Psychological science.

[37]  Amy Perfors,et al.  Picking up speed in understanding: Speech processing efficiency and vocabulary growth across the 2nd year. , 2006, Developmental psychology.

[38]  Albert Kim,et al.  Rapid Interactions between Lexical Semantic and Word Form Analysis during Word Recognition in Context: Evidence from ERPs , 2012, Journal of Cognitive Neuroscience.

[39]  Falk Huettig,et al.  Prediction during language processing is a piece of cake--but only for skilled producers. , 2012, Journal of experimental psychology. Human perception and performance.

[40]  R. Rescorla,et al.  A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement , 1972 .

[41]  G. Bower,et al.  From conditioning to category learning: an adaptive network model. , 1988, Journal of experimental psychology. General.

[42]  Stewart M. McCauley,et al.  Error and expectation in language learning: The curious absence of mouses in adult speech , 2013 .

[43]  G. Altmann,et al.  The time-course of prediction in incremental sentence processing: Evidence from anticipatory eye-movements , 2003 .

[44]  John P. Pinto,et al.  Rapid Gains in Speed of Verbal Processing by Infants in the 2nd Year , 1998 .

[45]  M. Bar Predictions in the brain : using our past to generate a future , 2011 .

[46]  Maryellen C. MacDonald,et al.  A probabilistic constraints approach to language acquisition and processing , 1999, Cogn. Sci..

[47]  Franklin Chang,et al.  Symbolically speaking: a connectionist model of sentence production , 2002, Cogn. Sci..

[48]  M. Tomasello First Verbs: A Case Study of Early Grammatical Development , 1994 .

[49]  N. Daw,et al.  The ubiquity of model-based reinforcement learning , 2012, Current Opinion in Neurobiology.

[50]  P. Dayan,et al.  Model-based influences on humans’ choices and striatal prediction errors , 2011, Neuron.

[51]  Kara D. Federmeier,et al.  Electrophysiology reveals semantic memory use in language comprehension , 2000, Trends in Cognitive Sciences.

[52]  Manizeh Khan Thinking in Words: Implicit Verbal Activation in Children and Adults , 2013 .

[53]  G. Dell,et al.  Becoming syntactic. , 2006, Psychological review.

[54]  Mitsuo Kawato,et al.  Multiple Model-Based Reinforcement Learning , 2002, Neural Computation.

[55]  Kate Nation,et al.  Investigating individual differences in children's real-time sentence comprehension using language-mediated eye movements. , 2003, Journal of experimental child psychology.

[56]  Irina A. Sekerina,et al.  The kindergarten-path effect: studying on-line sentence processing in young children , 1999, Cognition.

[57]  Kara D. Federmeier,et al.  Thirty years and counting: finding meaning in the N400 component of the event-related brain potential (ERP). , 2011, Annual review of psychology.

[58]  Ghislaine Dehaene-Lambertz,et al.  Two-year-olds compute syntactic structure on-line. , 2010, Developmental science.

[59]  Noam Chomsky,et al.  Lectures on Government and Binding , 1981 .

[60]  J. Snedeker,et al.  Semantic meaning and pragmatic interpretation in 5-year-olds: evidence from real-time spoken language comprehension. , 2009, Developmental psychology.

[61]  J. Huttenlocher,et al.  Syntactic priming in young children , 2004 .

[62]  Marta Kutas,et al.  CHAPTER 15 A Look around at What Lies Ahead: Prediction and Predictability in Language Processing , 2010 .

[63]  Ellen F. Lau,et al.  Dissociating N400 Effects of Prediction from Association in Single-word Contexts , 2013, Journal of Cognitive Neuroscience.

[64]  M. Pickering,et al.  The Representation of Verbs: Evidence from Syntactic Priming in Language Production , 1998 .

[65]  Anne Fernald,et al.  Real-time interpretation of novel events across childhood. , 2014, Journal of memory and language.

[66]  S. Levinson On the Human "Interaction Engine" , 2020, Roots of Human Sociality.

[67]  B. MacWhinney A multiple process solution to the logical problem of language acquisition , 2004, Journal of Child Language.

[68]  Mante S. Nieuwland,et al.  When Peanuts Fall in Love: N400 Evidence for the Power of Discourse , 2005, Journal of Cognitive Neuroscience.

[69]  P. Dayan,et al.  Decision theory, reinforcement learning, and the brain , 2008, Cognitive, affective & behavioral neuroscience.

[70]  H. Rabagliati,et al.  Sensitivity to syntax in visual cortex , 2009, Cognition.

[71]  Steven Pinker,et al.  Language learnability and language development , 1985 .

[72]  Joshua K. Hartshorne,et al.  Development of the first-mention bias* , 2014, Journal of Child Language.

[73]  A. Clark Whatever next? Predictive brains, situated agents, and the future of cognitive science. , 2013, The Behavioral and brain sciences.

[74]  Hal L. Smith,et al.  A competition model , 2008 .

[75]  J. Stevenson The cultural origins of human cognition , 2001 .

[76]  K. Plunkett,et al.  In the Infant’s Mind’s Ear , 2010, Psychological science.

[77]  Julian M. Pine,et al.  Constructing a Language: A Usage-Based Theory of Language Acquisition. , 2004 .

[78]  John Hale,et al.  A Probabilistic Earley Parser as a Psycholinguistic Model , 2001, NAACL.

[79]  Manuela Friedrich,et al.  Early N400 development and later language acquisition. , 2006, Psychophysiology.

[80]  Nathaniel J. Smith,et al.  The effect of word predictability on reading time is logarithmic , 2013, Cognition.

[81]  N. Daw Model-based reinforcement learning as cognitive search : Neurocomputational theories , 2012 .

[82]  T. Jaeger,et al.  Alignment as a consequence of expectation adaptation: Syntactic priming is affected by the prime’s prediction error given both prior and recent experience , 2013, Cognition.

[83]  A. Friederici,et al.  N400-like Semantic Incongruity Effect in 19-Month-Olds: Processing Known Words in Picture Contexts , 2004, Journal of Cognitive Neuroscience.

[84]  John P. Pinto,et al.  Continuous processing in word recognition at 24 months , 1999, Cognition.

[85]  Jennifer E. Arnold,et al.  Children's use of gender and order-of-mention during pronoun comprehension , 2007 .

[86]  Katherine A. DeLong,et al.  Probabilistic word pre-activation during language comprehension inferred from electrical brain activity , 2005, Nature Neuroscience.