Downstream Behavioral and Electrophysiological Consequences of Word Prediction on Recognition Memory

When people process language, they can use context to predict upcoming information, influencing processing and comprehension as seen in both behavioral and neural measures. Although numerous studies have shown immediate facilitative effects of confirmed predictions, the downstream consequences of prediction have been less explored. In the current study, we examined those consequences by probing participants’ recognition memory for words after they read sets of sentences. Participants read strongly and weakly constraining sentences with expected or unexpected endings (“I added my name to the list/basket”), and later were tested on their memory for the sentence endings while EEG was recorded. Critically, the memory test contained words that were predictable (“list”) but were never read (participants saw “basket”). Behaviorally, participants showed successful discrimination between old and new items, but false alarmed to the expected-item lures more often than to new items, showing that predicted words or concepts can linger, even when predictions are disconfirmed. Although false alarm rates did not differ by constraint, event-related potentials (ERPs) differed between false alarms to strongly and weakly predictable words. Additionally, previously unexpected (compared to previously expected) endings that appeared on the memory test elicited larger N1 and LPC amplitudes, suggesting greater attention and episodic recollection. In contrast, highly predictable sentence endings that had been read elicited reduced LPC amplitudes during the memory test. Thus, prediction can facilitate processing in the moment, but can also lead to false memory and reduced recollection for predictable information.

[1]  T. Jaeger,et al.  Categorical Data Analysis: Away from ANOVAs (transformation or not) and towards Logit Mixed Models. , 2008, Journal of memory and language.

[2]  J. Deese On the prediction of occurrence of particular verbal intrusions in immediate recall. , 1959, Journal of experimental psychology.

[3]  E. Shoben,et al.  The influence of sentence constraint on the scope of facilitation for upcoming words. , 1985 .

[4]  Matthew J. Traxler,et al.  Goals and strategies influence lexical prediction during sentence comprehension , 2017 .

[5]  Eric C. Fields,et al.  Having your cake and eating it too: Flexibility and power with mass univariate statistics for ERP data , 2018 .

[6]  Van Berkum,et al.  The brain is a prediction machine that cares about good and bad - Any implications for neuropragmatics? , 2010 .

[7]  M. S. Beato,et al.  False memory and level of processing effect: an event-related potential study , 2012, Neuroreport.

[8]  Steven G. Luke,et al.  Limits on lexical prediction during reading , 2016, Cognitive Psychology.

[9]  R. E. Schuberth,et al.  Effects of Context on the Classification of Words and Nonwords. , 1977 .

[10]  David J. Hess,et al.  Effects of global and local context on lexical processing during language comprehension , 1995 .

[11]  R. E. Schuberth,et al.  Effects of stimulus and contextual information on the lexical decision process , 1981, Memory & cognition.

[12]  K. Rayner,et al.  Effects of contextual predictability and transitional probability on eye movements during reading. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[13]  Keith E. Stanovich,et al.  Automatic Contextual Facilitation in Readers of Three Ages. , 1978 .

[14]  Edward L. Wilding,et al.  Prefrontal cortex contributions to episodic retrieval monitoring and evaluation , 2009, Neuropsychologia.

[15]  A. Haycox,et al.  Having Your Cake and Eating It , 2012, PharmacoEconomics (Auckland).

[16]  G. Altmann,et al.  Incremental interpretation at verbs: restricting the domain of subsequent reference , 1999, Cognition.

[17]  C. Burgess,et al.  Lexical and Sentence Context Effects in Word Recognition , 1989 .

[18]  Adrian Staub,et al.  No Prediction Error Cost in Reading:: Evidence from Eye Movements , 2017 .

[19]  R. Bell,et al.  A Semantic Mismatch Effect on Serial Recall: Evidence for Interlexical Processing of Irrelevant Speech , 2019, Journal of experimental psychology. Learning, memory, and cognition.

[20]  Marte Otten,et al.  Discourse-Based Word Anticipation During Language Processing: Prediction or Priming? , 2008 .

[21]  K. Rayner,et al.  Contextual effects on word perception and eye movements during reading , 1981 .

[22]  Hiroki R. Hayama,et al.  Electrophysiological dissociation of the neural correlates of recollection and familiarity , 2006, Brain Research.

[23]  Michael D. Rugg,et al.  Right dorsolateral prefrontal cortex is engaged during post-retrieval processing of both episodic and semantic information , 2009, Neuropsychologia.

[24]  T. C. Lorsbach,et al.  Memory for Relevant and Irrelevant Information: Evidence for Deficient Inhibitory Processes in Language/ Learning Disabled Children , 1996, Contemporary educational psychology.

[25]  Marta Kutas,et al.  Brain Potentials during Memory Retrieval Provide Neurophysiological Support for the Distinction between Conscious Recollection and Priming , 1992, Journal of Cognitive Neuroscience.

[26]  Yuki Kamide,et al.  Anticipatory Processes in Sentence Processing , 2008, Lang. Linguistics Compass.

[27]  Kenneth Kreutz-Delgado,et al.  AMICA : An Adaptive Mixture of Independent Component Analyzers with Shared Components , 2011 .

[28]  Kara D. Federmeier,et al.  Predictability's aftermath: Downstream consequences of word predictability as revealed by repetition effects , 2018, Cortex.

[29]  Kara D. Federmeier,et al.  Finding the right word: Hemispheric asymmetries in the use of sentence context information , 2007, Neuropsychologia.

[30]  Moshe Bar,et al.  The proactive brain: memory for predictions , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[31]  H. V. Restorff Über die Wirkung von Bereichsbildungen im Spurenfeld , 1933 .

[32]  Chuanji Gao,et al.  Electrophysiological correlates associated with contributions of perceptual and conceptual fluency to familiarity , 2015, Front. Hum. Neurosci..

[33]  Michael D. Rugg,et al.  The effect of encoding manipulations on neural correlates of episodic retrieval , 2000, Neuropsychologia.

[34]  T. Curran Effects of attention and confidence on the hypothesized ERP correlates of recollection and familiarity , 2004, Neuropsychologia.

[35]  R. Baayen,et al.  Mixed-effects modeling with crossed random effects for subjects and items , 2008 .

[36]  Kara D. Federmeier,et al.  Age-related changes in the impact of contextual strength on multiple aspects of sentence comprehension. , 2012, Psychophysiology.

[37]  Gina R Kuperberg,et al.  What do we mean by prediction in language comprehension? , 2016, Language, cognition and neuroscience.

[38]  Yanhong Wu,et al.  Neurophysiological correlates of memory illusion in both encoding and retrieval phases , 2007, Brain Research.

[39]  Kara D. Federmeier,et al.  FN400 potentials are functionally identical to N400 potentials and reflect semantic processing during recognition testing. , 2011, Psychophysiology.

[40]  Marta Kutas,et al.  CHAPTER 15 A Look around at What Lies Ahead: Prediction and Predictability in Language Processing , 2010 .

[41]  A. Clark Whatever next? Predictive brains, situated agents, and the future of cognitive science. , 2013, The Behavioral and brain sciences.

[42]  D. Donaldson,et al.  It’s the way that you, er, say it: Hesitations in speech affect language comprehension , 2007, Cognition.

[43]  Kara D. Federmeier,et al.  Multiple effects of sentential constraint on word processing , 2007, Brain Research.

[44]  A. Morcom Resisting false recognition: An ERP study of lure discrimination , 2015, Brain Research.

[45]  Kara D. Federmeier,et al.  Thirty years and counting: finding meaning in the N400 component of the event-related brain potential (ERP). , 2011, Annual review of psychology.

[46]  S. Hillyard,et al.  Modulations of sensory-evoked brain potentials indicate changes in perceptual processing during visual-spatial priming. , 1991, Journal of experimental psychology. Human perception and performance.

[47]  Kara D. Federmeier,et al.  A Rose by Any Other Name: Long-Term Memory Structure and Sentence Processing , 1999 .

[48]  Jeffrey D. Johnson,et al.  The relationship between the right frontal old/new ERP effect and post-retrieval monitoring: Specific or non-specific? , 2008, Neuropsychologia.

[49]  Katherine A. DeLong,et al.  Predictability, plausibility, and two late ERP positivities during written sentence comprehension , 2014, Neuropsychologia.

[50]  Daniel L. Schacter,et al.  ERP correlates of recognition memory: Effects of retention interval and false alarms , 2006, Brain Research.

[51]  K. McDermott,et al.  Creating false memories: Remembering words not presented in lists. , 1995 .

[52]  M. Bar Predictions in the brain : using our past to generate a future , 2011 .

[53]  Michael D. Rugg,et al.  Dissociation of the electrophysiological correlates of familiarity strength and item repetition , 2010, Brain Research.

[54]  F. Craik,et al.  Depth of processing and the retention of words , 1975 .

[55]  C. Van Petten,et al.  Lexical versus conceptual anticipation during sentence processing: frontal positivity and N400 ERP components. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[56]  S. Hillyard,et al.  Cortical sources of the early components of the visual evoked potential , 2002, Human brain mapping.

[57]  P. Schwanenflugel,et al.  Semantic relatedness and the scope of facilitation for upcoming words in sentences. , 1988 .

[58]  J. Ballas,et al.  Effects of Context on the Classification of Everyday Sounds , 1989 .

[59]  Satterthwaite Fe An approximate distribution of estimates of variance components. , 1946 .

[60]  F. E. Satterthwaite An approximate distribution of estimates of variance components. , 1946, Biometrics.

[61]  M. Bar The proactive brain: using analogies and associations to generate predictions , 2007, Trends in Cognitive Sciences.

[62]  Kara D. Federmeier Thinking ahead: the role and roots of prediction in language comprehension. , 2007, Psychophysiology.

[63]  I. Fischler,et al.  Automatic and attentional processes in the effects of sentence contexts on word recognition , 1979 .

[64]  H. Kucera,et al.  Computational analysis of present-day American English , 1967 .

[65]  M. Rugg,et al.  Event-related potentials and recognition memory , 2007, Trends in Cognitive Sciences.

[66]  Michael D. Rugg,et al.  Dissociation of the neural correlates of implicit and explicit memory , 1998, Nature.

[67]  F. Craik,et al.  Levels of Pro-cessing: A Framework for Memory Research , 1975 .

[68]  Chunyan Guo,et al.  Event-related brain potentials that distinguish false memory for events that occurred only seconds in the past , 2012, Behavioral and Brain Functions.

[69]  Brion Woroch,et al.  Event-related potential correlates of item and source memory strength , 2010, Brain Research.

[70]  J. Tanaka,et al.  An electrophysiological comparison of visual categorization and recognition memory , 2002, Cognitive, affective & behavioral neuroscience.

[71]  J. Henderson,et al.  Semantic facilitation of lexical access during sentence processing. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[72]  R. Oostenveld,et al.  Nonparametric statistical testing of EEG- and MEG-data , 2007, Journal of Neuroscience Methods.

[73]  E. Tulving,et al.  Event-related brain potential correlates of two states of conscious awareness in memory. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[74]  Andy J. Wills,et al.  Predictive Learning, Prediction Errors, and Attention: Evidence from Event-related Potentials and Eye Tracking , 2007, Journal of Cognitive Neuroscience.

[75]  R Kakigi,et al.  [Event-related brain potentials]. , 1997, Nihon rinsho. Japanese journal of clinical medicine.

[76]  David M. Groppe,et al.  Overlapping dual ERP responses to low cloze probability sentence continuations. , 2011, Psychophysiology.

[77]  Cynthia P. May,et al.  Inhibitory control over no-longer-relevant information: Adult age differences , 1997, Memory & cognition.

[78]  Daniel L. Schacter,et al.  Brain Potentials Reflect Behavioral Differences in True and False Recognition , 2001, Journal of Cognitive Neuroscience.

[79]  Claire S. Birch,et al.  Electrophysiological Evidence for the Modulation of Retrieval Orientation by Depth of Study Processing , 2000, Journal of Cognitive Neuroscience.

[80]  S. Hillyard,et al.  Event-related brain potentials in the study of visual selective attention. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[81]  M. Steffens,et al.  False memories: Phenomena, theories, and implications. , 2007 .

[82]  M. Kutas,et al.  Brain potentials during reading reflect word expectancy and semantic association , 1984, Nature.

[83]  E. Vogel,et al.  The visual N1 component as an index of a discrimination process. , 2000, Psychophysiology.

[84]  F. Craik,et al.  The effects of divided attention on encoding and retrieval processes in human memory. , 1996, Journal of experimental psychology. General.

[85]  David M. Groppe,et al.  Mass univariate analysis of event-related brain potentials/fields I: a critical tutorial review. , 2011, Psychophysiology.

[86]  Kara D. Federmeier,et al.  Lingering expectations: A pseudo-repetition effect for words previously expected but not presented , 2018, NeuroImage.

[87]  J. H. Neely,et al.  Semantic Context Effects on Visual Word Processing: A Hybrid Prospective-Retrospective Processing Theory , 1989 .

[88]  Hans-Jochen Heinze,et al.  Localizing visual discrimination processes in time and space. , 2002, Journal of neurophysiology.

[89]  T. Curran Brain potentials of recollection and familiarity , 2000, Memory & cognition.

[90]  L Hasher,et al.  Aging and suppression: memory for previously relevant information. , 1991, Psychology and aging.

[91]  Andrew P. Yonelinas,et al.  Examining ERP correlates of recognition memory: Evidence of accurate source recognition without recollection , 2012, NeuroImage.

[92]  D. Gallo,et al.  False memories and fantastic beliefs: 15 years of the DRM illusion , 2010, Memory & cognition.