Oculomotor Control, Brain Potentials, and Timelines of Word Recognition During Natural Reading

Reading requires the orchestration of vision, attention, and language processes, usually along with the programming of eye movements. The co-registration of eye movements and electroencephalography (EEG) during natural reading promises to deliver two complementary sets of information. Fixation durations reflect the difficulty of sublexical, lexical, and sentence-level properties, such as the frequency and predictability of the fixated word and (at least) its left and right neighbors; they reveal space-related constraints of distributed processing in the perceptual span. Co-registered fixation-related potentials (FRPs) yield time-related constraints of word recognition within fixation durations. Effects of word frequency and predictability in FRPs are shown to be qualitatively similar to those in event-related potentials (ERPs) measured during serial visual presentation of sentence words. However, FRPs and ERPs differ with respect to the timelines associated with frequency and predictability effects. It is anticipated that space-related and time-related constraints of word recognition during reading will guide the further development of computational models of eye-movement control during reading as well as their integration with computational models of (isolated) word recognition.

[1]  Punit Shah.  Toward a Neurobiology of Unrealistic Optimism , 2012, Front. Psychology.

[2]  A. Jacobs,et al.  Stimulus onset asynchrony and the timeline of word recognition: Event-related potentials during sentence reading , 2012, Neuropsychologia.

[3]  Shlomit Yuval-Greenberg,et al.  Saccadic spike potentials in gamma-band EEG: Characterization, detection and suppression , 2010, NeuroImage.

[4]  P Berg,et al.  A multiple source approach to the correction of eye artifacts. , 1994, Electroencephalography and clinical neurophysiology.

[5]  Colin M. Brown,et al.  Anticipating upcoming words in discourse: evidence from ERPs and reading times. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[6]  A. Jacobs,et al.  Event-Related Potentials Reveal Rapid Verification of Predicted Visual Input , 2009, PloS one.

[7]  A. Jacobs,et al.  Coregistration of eye movements and EEG in natural reading: analyses and review. , 2011, Journal of experimental psychology. General.

[8]  M. Schlesewsky,et al.  Parafoveal versus foveal N400s dissociate spreading activation from contextual fit , 2009, Neuroreport.

[9]  K. Rayner,et al.  Lexical complexity and fixation times in reading: Effects of word frequency, verb complexity, and lexical ambiguity , 1986, Memory & cognition.

[10]  G. McConkie,et al.  The span of the effective stimulus during a fixation in reading , 1975 .

[11]  Patrick Berg,et al.  Artifact Correction of the Ongoing EEG Using Spatial Filters Based on Artifact and Brain Signal Topographies , 2002, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[12]  Thierry Baccino,et al.  Eye-Fixation-Related Potentials: Insight into Parafoveal Processing , 2005 .

[13]  Jie-Li Tsai,et al.  The Time Course of Contextual Effects on Visual Word Recognition , 2012, Front. Psychology.

[14]  Reinhold Kliegl,et al.  Eye movements and brain electric potentials during reading , 2012, Psychological research.

[15]  Michael D. Rugg,et al.  Dissociation of Semantic Priming, Word and Non-Word Repetition Effects by Event-Related Potentials , 1987 .

[16]  Reinhold Kliegl,et al.  Parallel graded attention models of reading , 2011 .

[17]  M. Rugg.  Event-related brain potentials dissociate repetition effects of high-and low-frequency words , 1990, Memory & cognition.

[18]  Thierry Baccino,et al.  Eye movements and concurrent event-related potentials: Eye fixation-related potential investigations in reading , 2011 .

[19]  M. Posner,et al.  Establishing a time‐line of word recognition: evidence from eye movements and event‐related potentials , 1998, Neuroreport.

[20]  Reinhold Kliegl,et al.  Semantic preview benefit during reading. , 2014, Journal of experimental psychology. Learning, memory, and cognition.

[21]  K. Rayner,et al.  Measuring word recognition in reading: eye movements and event-related potentials , 2003, Trends in Cognitive Sciences.

[22]  M. Kutas,et al.  Interactions between sentence context and word frequencyinevent-related brainpotentials , 1990, Memory & cognition.

[23]  Reinhold Kliegl,et al.  Synchronizing timelines: Relations between fixation durations and N400 amplitudes during sentence reading , 2007, Brain Research.

[24]  M. Kutas,et al.  Psycholinguistics Electrified II (1994–2005) , 2006 .

[25]  R. Kliegl,et al.  Human Microsaccade-Related Visual Brain Responses , 2009, The Journal of Neuroscience.

[26]  K. Rayner.  The perceptual span and peripheral cues in reading , 1975, Cognitive Psychology.

[27]  M. Dambacher.  Bottom-up and top-down processes in reading : influences of frequency and predictability on event-related potentials and eye movements , 2010 .

[28]  A. Jacobs,et al.  Frequency and predictability effects on event-related potentials during reading , 2006, Brain Research.

[29]  Reinhold Kliegl,et al.  Semantic preview benefit in eye movements during reading: A parafoveal fast-priming study. , 2010, Journal of experimental psychology. Learning, memory, and cognition.

[30]  Reinhold Kliegl,et al.  Trans-saccadic parafoveal preview benefits in fluent reading: A study with fixation-related brain potentials , 2012, NeuroImage.

[31]  K. Rayner,et al.  Contextual effects on word perception and eye movements during reading , 1981 .

[32]  Kara D. Federmeier,et al.  Thirty years and counting: finding meaning in the N400 component of the event-related brain potential (ERP). , 2011, Annual review of psychology.

[33]  Ronan G. Reilly,et al.  Some empirical tests of an interactive activation model of eye movement control in reading , 2006, Cognitive Systems Research.

[34]  Victor Kuperman,et al.  The effect of word position on eye-movements in sentence and paragraph reading , 2010, Quarterly journal of experimental psychology.

[35]  M. Kutas,et al.  Reading senseless sentences: brain potentials reflect semantic incongruity. , 1980, Science.

[36]  Erik D. Reichle,et al.  Serial-attention models of reading , 2011 .

[37]  Reinhold Kliegl,et al.  Toward a Perceptual-Span Theory of Distributed Processing in Reading: A Reply to Rayner, Pollatsek, Drieghe, Slattery, and Reichle (2007). , 2007 .

[38]  F. Pulvermüller,et al.  Effects of word length and frequency on the human event-related potential , 2004, Clinical Neurophysiology.

[39]  Wilson L. Taylor,et al.  “Cloze Procedure”: A New Tool for Measuring Readability , 1953 .

[40]  Ralf Engbert,et al.  Tracking the mind during reading: the influence of past, present, and future words on fixation durations. , 2006, Journal of experimental psychology. General.