ERP evidence for memory and predictive mechanisms in word-to-text integration

During reading, word-to-text integration (WTI) proceeds quickly and incrementally through both prediction and memory processes. We tested predictive and memory mechanisms with event-related potentials (ERPs) recorded on critical words that were across a sentence boundary from co-referential words that differed in dominant direction of lexical association. For comparison of text comprehension, participants performed meaning judgements on a matched set of word pairs. In both tasks, reduced N400 amplitudes were elicited over central scalp electrodes by words associated in either direction relative to task-specific baseline conditions. A temporal principal component analysis of the ERP data extracted a component reflecting this central N400. Additionally, for the text comprehension task early (N200) and late (parietal N400 and P600) discriminated between forward associated and backward associated conditions. The results demonstrate that, beyond N400 indicators of prediction, ERPs reflect the role of memory processes in WTI across sentences.

[1]  J. H. Neely Semantic priming effects in visual word recognition: A selective review of current findings and theories. , 1991 .

[2]  Marte Otten,et al.  Discourse-Based Word Anticipation During Language Processing: Prediction or Priming? , 2008 .

[3]  C. Perfetti,et al.  Word-to-text integration: Message level and lexical level influences in ERPs , 2014, Neuropsychologia.

[4]  S. Luck,et al.  Electrophysiological correlates of feature analysis during visual search. , 1994, Psychophysiology.

[5]  M. Rugg,et al.  Event-related potentials and recognition memory , 2007, Trends in Cognitive Sciences.

[6]  C. Petten,et al.  Conceptual integration and metaphor: An event-related potential study , 2002, Memory & cognition.

[7]  Joseph Dien,et al.  Separating the visual sentence N400 effect from the P400 sequential expectancy effect: Cognitive and neuroanatomical implications , 2010, Brain Research.

[8]  S R Goldman,et al.  Reading skill and the identification of words in discourse context , 1979, Memory & cognition.

[9]  F. Schmalhofer,et al.  Comprehension Skill and Word-to-Text Integration Processes , 2008 .

[10]  E. J. O'Brien,et al.  Antecedent retrieval processes. , 1990, Journal of experimental psychology. Learning, memory, and cognition.

[11]  M A Just,et al.  A theory of reading: from eye fixations to comprehension. , 1980, Psychological review.

[12]  Kara D. Federmeier,et al.  Hemispheric differences in the recruitment of semantic processing mechanisms , 2010, Neuropsychologia.

[13]  Kara D. Federmeier,et al.  Right hemisphere sensitivity to word- and sentence-level context: evidence from event-related brain potentials. , 2005, Journal of Experimental Psychology. Learning, Memory and Cognition.

[14]  John O. Willis,et al.  Test of Word Reading Efficiency , 2014 .

[15]  Kara D. Federmeier,et al.  Time for prediction? The effect of presentation rate on predictive sentence comprehension during word-by-word reading , 2015, Cortex.

[16]  Kara D. Federmeier,et al.  Thirty years and counting: finding meaning in the N400 component of the event-related brain potential (ERP). , 2011, Annual review of psychology.

[17]  Joseph Dien,et al.  The ERP PCA Toolkit: An open source program for advanced statistical analysis of event-related potential data , 2010, Journal of Neuroscience Methods.

[18]  P. Burkhardt The P600 reflects cost of new information in discourse memory , 2007, Neuroreport.

[19]  P. Johnson-Laird,et al.  Mental Models: Towards a Cognitive Science of Language, Inference, and Consciousness , 1985 .

[20]  E. Donchin,et al.  Is the P300 component a manifestation of context updating? , 1988, Behavioral and Brain Sciences.

[21]  Robin K. Morris,et al.  Eye movements and on-line language comprehension processes , 1989 .

[22]  John C J Hoeks,et al.  Seeing words in context: the interaction of lexical and sentence level information during reading. , 2004, Brain research. Cognitive brain research.

[23]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[24]  W. Kintsch,et al.  Context effects in word identification , 1985 .

[25]  J. Dien Looking both ways through time: The Janus model of lateralized cognition , 2008, Brain and Cognition.

[26]  Christopher J. May,et al.  Is “Blank” a suitable neutral prime for event-related potential experiments? , 2006, Brain and Language.

[27]  Marc Brysbaert,et al.  Moving beyond Kučera and Francis: A critical evaluation of current word frequency norms and the introduction of a new and improved word frequency measure for American English , 2009, Behavior research methods.

[28]  T. Landauer,et al.  A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. , 1997 .

[29]  Thomas A. Schreiber,et al.  The University of South Florida free association, rhyme, and word fragment norms , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[30]  Peter Hagoort,et al.  The Processing Nature of the N400: Evidence from Masked Priming , 1993, Journal of Cognitive Neuroscience.

[31]  Manuel Martín-Loeches,et al.  The Recognition Potential: An ERP Index of Lexical Access , 1999, Brain and Language.

[32]  Charles A. Perfetti,et al.  Inferences during Reading: Comprehending implicit meanings in text without making inferences , 2015 .

[33]  Gina R. Kuperberg,et al.  Neural mechanisms of language comprehension: Challenges to syntax , 2007, Brain Research.

[34]  Jerome L. Myers,et al.  Accessing the discourse representation during reading , 1998 .

[35]  J. Horn A rationale and test for the number of factors in factor analysis , 1965, Psychometrika.

[36]  Morton Ann Gernsbacher,et al.  Two Decades of Structure Building. , 1997, Discourse processes.

[37]  D. Tucker Spatial sampling of head electrical fields: the geodesic sensor net. , 1993, Electroencephalography and clinical neurophysiology.

[38]  M. Kutas,et al.  Semantic integration in reading: engagement of the right hemisphere during discourse processing. , 1999, Brain : a journal of neurology.

[39]  S. Bookheimer Functional MRI of language: new approaches to understanding the cortical organization of semantic processing. , 2002, Annual review of neuroscience.

[40]  R. Ratcliff,et al.  A retrieval theory of priming in memory. , 1988, Psychological review.

[41]  M. Kutas,et al.  Event-related potential asymmetries during the reading of sentences. , 1988, Electroencephalography and clinical neurophysiology.

[42]  Aminda J. O'Hare,et al.  Evidence for automatic sentence priming in the fusiform semantic area: Convergent ERP and fMRI findings , 2008, Brain Research.

[43]  E. Donchin Presidential address, 1980. Surprise!...Surprise? , 1981, Psychophysiology.

[44]  C. Petten,et al.  Neural localization of semantic context effects in electromagnetic and hemodynamic studies , 2006, Brain and Language.

[45]  Robin K. Morris,et al.  Priming in Sentence Processing: Intralexical Spreading Activation, Schemas, and Situation Models , 2000, Journal of psycholinguistic research.

[46]  C. Petten A comparison of lexical and sentence-level context effects in event-related potentials , 1993 .

[47]  M. Kutas,et al.  Reading senseless sentences: brain potentials reflect semantic incongruity. , 1980, Science.

[48]  William D. Marslen-Wilson,et al.  The time course of visual word recognition as revealed by linear regression analysis of ERP data , 2006, NeuroImage.

[49]  Charles A. Perfetti,et al.  Less skilled comprehenders’ ERPs show sluggish word-to-text integration processes , 2005 .

[50]  Richard F. West,et al.  The Effect of Sentence Context on Word Recognition in Second-and Sixth-Grade Children. , 1983 .

[51]  Keith A Hutchison,et al.  The influence of working memory load on semantic priming. , 2015, Journal of experimental psychology. Learning, memory, and cognition.

[52]  Anders M. Dale,et al.  N400-like Magnetoencephalography Responses Modulated by Semantic Context, Word Frequency, and Lexical Class in Sentences , 2002, NeuroImage.

[53]  James I. Brown The Nelson-Denny Reading Test. , 1960 .

[54]  J. H. Neely,et al.  Semantic priming modulates the N400, N300, and N400RP , 2007, Clinical Neurophysiology.

[55]  G. Frishkoff Hemispheric differences in strong versus weak semantic priming: Evidence from event-related brain potentials , 2007, Brain and Language.

[56]  Ellen F. Lau,et al.  A lexical basis for N400 context effects: Evidence from MEG , 2009, Brain and Language.

[57]  Colin M. Brown,et al.  Early referential context effects in sentence processing: Evidence from event-related brain potentials , 1999 .

[58]  T. Ferrée,et al.  Spherical Splines and Average Referencing in Scalp Electroencephalography , 2006, Brain Topography.

[59]  Jason E. Albrecht,et al.  Updating a situation model: a memory-based text processing view. , 1998, Journal of experimental psychology. Learning, memory, and cognition.

[60]  P. Gordon,et al.  Reading words in discourse: the modulation of lexical priming effects by message-level context. , 2006, Behavioral and cognitive neuroscience reviews.

[61]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[62]  K. A. Ericsson,et al.  Long-term working memory. , 1995, Psychological review.

[63]  R. Heuser Surprise, surprise , 2014, Catheterization and cardiovascular interventions : official journal of the Society for Cardiac Angiography & Interventions.

[64]  A. Paivio Dual coding theory: Retrospect and current status. , 1991 .

[65]  G. McCarthy,et al.  Augmenting mental chronometry: the P300 as a measure of stimulus evaluation time. , 1977, Science.

[66]  J. H. Neely,et al.  Semantic Context Effects on Visual Word Processing: A Hybrid Prospective-Retrospective Processing Theory , 1989 .

[67]  Kara D. Federmeier Thinking ahead: the role and roots of prediction in language comprehension. , 2007, Psychophysiology.

[68]  Colin M. Brown,et al.  The Mechanism Underlying Backward Priming in a Lexical Decision Task: Spreading Activation versus Semantic Matching , 1998 .

[69]  P. O. White,et al.  PROMAX: A QUICK METHOD FOR ROTATION TO OBLIQUE SIMPLE STRUCTURE , 1964 .

[70]  Charles A. Perfetti,et al.  Word Knowledge in a Theory of Reading Comprehension , 2014 .

[71]  Jason E. Albrecht,et al.  Updating a mental model: maintaining both local and global coherence , 1993 .

[72]  Franz Schmalhofer,et al.  Event-related potential indicators of text integration across sentence boundaries. , 2007, Journal of experimental psychology. Learning, memory, and cognition.

[73]  W. Kintsch,et al.  Strategies of discourse comprehension , 1983 .

[74]  D. Tucker,et al.  Scalp electrode impedance, infection risk, and EEG data quality , 2001, Clinical Neurophysiology.

[75]  William D. Marslen-Wilson,et al.  The On-Line Effects of Semantic Context on Syntactic Processing , 1977 .

[76]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[77]  Michael K. Tanenhaus,et al.  Verb Argument Structure in Parsing and Interpretation: Evidence from wh-Questions , 1995 .

[78]  K. Rayner,et al.  Language processing in reading and speech perception is fast and incremental: Implications for event-related potential research , 2009, Biological Psychology.

[79]  P. Johnson-Laird Comprehension as the Construction of Mental Models , 1981 .

[80]  M. Jung-Beeman Bilateral brain processes for comprehending natural language , 2005, Trends in Cognitive Sciences.

[81]  Jason E. Albrecht,et al.  The role of context in accessing antecedents in text , 1991 .

[82]  D. Tucker,et al.  Parametric analysis of event-related potentials in semantic comprehension: evidence for parallel brain mechanisms. , 2003, Brain research. Cognitive brain research.

[83]  Phillip J. Holcomb,et al.  The contributions of lexico-semantic and discourse information to the resolution of ambiguous categorical anaphors , 2007 .

[84]  P. Gordon,et al.  The interplay of discourse congruence and lexical association during sentence processing: Evidence from ERPs and eye tracking. , 2007, Journal of memory and language.

[85]  Mark S. Seidenberg,et al.  Pre- and postlexical loci of contextual effects on word recognition , 1984, Memory & cognition.

[86]  E. J. O'Brien,et al.  1 Comprehending implicit meanings in text without making inferences , 2015 .

[87]  P. Holcomb,et al.  Event-related brain potentials elicited by syntactic anomaly , 1992 .

[88]  G. Altmann,et al.  Incremental interpretation at verbs: restricting the domain of subsequent reference , 1999, Cognition.

[89]  G. Simpson,et al.  Effect of backward priming on word recognition in single-word and sentence contexts. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[90]  William W. Graves,et al.  Where is the semantic system? A critical review and meta-analysis of 120 functional neuroimaging studies. , 2009, Cerebral cortex.

[91]  James H. Neely,et al.  When Word Identification Gets Tough, Retrospective Semantic Processing Comes to the Rescue. , 2012 .

[92]  A. Koriat,et al.  Semantic facilitation in lexical decision as a function of prime-target association , 1981, Memory & cognition.

[93]  Michael D. Rugg,et al.  Dissociation of the neural correlates of implicit and explicit memory , 1998, Nature.

[94]  Robin K. Morris,et al.  Lexical and message-level sentence context effects on fixation times in reading. , 1994, Journal of experimental psychology. Learning, memory, and cognition.

[95]  Morton Ann Gernsbacher,et al.  Language Comprehension As Structure Building , 1990 .

[96]  Debra L. Long,et al.  The propositional structure of discourse in the two cerebral hemispheres , 2005, Brain and Language.

[97]  M. Slowiaczek,et al.  Constraints on semantic priming in reading: A fixation time analysis , 1986, Memory & cognition.