What eye movements can tell us about sentence comprehension.

Eye movement data have proven to be very useful for investigating human sentence processing. Eyetracking research has addressed a wide range of questions, such as recovery mechanisms following garden-pathing, the timing of processes driving comprehension, the role of anticipation and expectation in parsing, the role of semantic, pragmatic, and prosodic information, and so on. However, there are some limitations regarding the inferences that can be made on the basis of eye movements. One relates to the nontrivial interaction between parsing and the eye movement control system which complicates the interpretation of eye movement data. Detailed computational models that integrate parsing with eye movement control theories have the potential to unpack the complexity of eye movement data and can therefore aid in the interpretation of eye movements. Another limitation is the difficulty of capturing spatiotemporal patterns in eye movements using the traditional word-based eyetracking measures. Recent research has demonstrated the relevance of these patterns and has shown how they can be analyzed. In this review, we focus on reading, and present examples demonstrating how eye movement data reveal what events unfold when the parser runs into difficulty, and how the parsing system interacts with eye movement control. WIREs Cogn Sci 2013, 4:125-134. doi: 10.1002/wcs.1209 For further resources related to this article, please visit the WIREs website.

[1]  Richard L. Lewis,et al.  Argument-Head Distance and Processing Complexity: Explaining both Locality and Antilocality Effects , 2006 .

[2]  Ralf Engbert,et al.  Tracking the mind during reading: the influence of past, present, and future words on fixation durations. , 2006, Journal of experimental psychology. General.

[3]  C. Clifton,et al.  Overt reanalysis strategies and eye movements during the reading of mild garden path sentences , 2002, Memory & cognition.

[4]  G. Legge,et al.  Mr. Chips 2002: new insights from an ideal-observer model of reading , 2002, Vision Research.

[5]  B. J. Davidson,et al.  Regression analyses as a tool for studying reading processes: Comment on Just and Carpenters eye fixation theory , 1982, Memory & cognition.

[6]  Shravan Vasishth,et al.  Locality in German , 2011, Dialogue Discourse.

[7]  Gerrit Kentner Linguistic rhythm guides parsing decisions in written sentence comprehension , 2012, Cognition.

[8]  K. Rayner Eye movements in reading: Models and data , 2003, Behavioral and Brain Sciences.

[9]  A. Jacobs,et al.  Coregistration of eye movements and EEG in natural reading: analyses and review. , 2011, Journal of experimental psychology. General.

[10]  Irina A. Sekerina,et al.  Chance in agrammatic sentence comprehension: What does it really mean? Evidence from eye movements of German agrammatic aphasic patients , 2011 .

[11]  Reinhold Kliegl,et al.  SWIFT: a dynamical model of saccade generation during reading. , 2005, Psychological review.

[12]  Roger Levy,et al.  A Rational Model of Eye Movement Control in Reading , 2010, ACL.

[13]  C. Thompson,et al.  Real-time comprehension of wh- movement in aphasia: Evidence from eyetracking while listening , 2007, Brain and Language.

[14]  John R Anderson,et al.  An integrated theory of the mind. , 2004, Psychological review.

[15]  Ellen F. Lau,et al.  Agreement Attraction in Comprehension: Representations and Processes. , 2009 .

[16]  R. Levy Expectation-based syntactic comprehension , 2008, Cognition.

[17]  Lyn Frazier,et al.  Sentence processing: A tutorial review. , 1987 .

[18]  Reinhold Kliegl,et al.  A Framework for Modeling the Interaction of Syntactic Processing and Eye Movement Control , 2013, Top. Cogn. Sci..

[19]  Robert L. Goldstone Returning to a New Home , 2005, Cogn. Sci..

[20]  Reinhold Kliegl,et al.  Reading strategy modulates parafoveal-on-foveal effects in sentence reading , 2013, Quarterly journal of experimental psychology.

[21]  Reinhold Kliegl,et al.  Scanpaths in reading are informative about sentence processing , 2012 .

[22]  K. Bock,et al.  Broken agreement , 1991, Cognitive Psychology.

[23]  M A Just,et al.  A theory of reading: from eye fixations to comprehension. , 1980, Psychological review.

[24]  Reinhold Kliegl,et al.  Parsing costs as predictors of reading difficulty: An evaluation using the Potsdam Sentence Corpus , 2008, Journal of Eye Movement Research.

[25]  K. Rayner,et al.  Linguistic focus affects eye movements during reading , 1997, Memory & cognition.

[26]  Erik D. Reichle,et al.  Using E-Z reader to model the effects of higher level language processing on eye movements during reading , 2009, Psychonomic bulletin & review.

[27]  K. Rayner Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[28]  Richard L. Lewis,et al.  Reanalysis and Limited Repair Parsing: Leaping off the Garden Path , 1998 .

[29]  Brian Dillon,et al.  Structured access in sentence comprehension , 2011 .

[30]  Dario D. Salvucci An integrated model of eye movements and visual encoding , 2001, Cognitive Systems Research.

[31]  Joseph Hilbe,et al.  Data Analysis Using Regression and Multilevel/Hierarchical Models , 2009 .

[32]  C. Clifton,et al.  Underspecification of syntactic ambiguities: Evidence from self-paced reading , 2008, Memory & cognition.

[33]  Kiwako Ito,et al.  Anticipatory effects of intonation: Eye movements during instructed visual search. , 2008, Journal of memory and language.

[34]  Erik D. Reichle,et al.  Toward a model of eye movement control in reading. , 1998, Psychological review.

[35]  Reinhold Kliegl,et al.  Eye movements and brain electric potentials during reading , 2012, Psychological research.

[36]  M. Schlesewsky,et al.  Parafoveal versus foveal N400s dissociate spreading activation from contextual fit , 2009, Neuroreport.

[37]  K. Rayner The perceptual span and peripheral cues in reading , 1975, Cognitive Psychology.

[38]  Noam Chomsky,et al.  Lectures on Government and Binding , 1981 .

[39]  Erik D. Reichle,et al.  The E-Z Reader model of eye-movement control in reading: Comparisons to other models , 2003, Behavioral and Brain Sciences.

[40]  Susan M. Garnsey,et al.  Agreement Processes in Sentence Comprehension , 1999 .

[41]  M. Coltheart Attention and Performance XII: The Psychology of Reading , 1987 .

[42]  Richard L. Lewis,et al.  In search of on-line locality effects in sentence comprehension. , 2011, Journal of experimental psychology. Learning, memory, and cognition.

[43]  C. Phillips,et al.  Illusory licensing effects across dependency types: ERP evidence , 2009, Brain and Language.

[44]  G. Altmann,et al.  The time-course of prediction in incremental sentence processing: Evidence from anticipatory eye-movements , 2003 .

[45]  K. Rayner,et al.  Eye movements in reading words and sentences , 2007 .

[46]  P. Sturt,et al.  The time-course of the application of binding constraints in reference resolution , 2003 .

[47]  Deborah A. Prentice,et al.  When small effects are impressive , 1992 .

[48]  Fernanda Ferreira,et al.  The 'Good Enough' Approach to Language Comprehension , 2007, Lang. Linguistics Compass.

[49]  Reinhold Kliegl,et al.  Determinants of Scanpath Regularity in Reading , 2015, Cogn. Sci..

[50]  J. V. Van Dyke Interference effects from grammatically unavailable constituents during sentence processing. , 2007, Journal of experimental psychology. Learning, memory, and cognition.

[51]  Richard L. Lewis,et al.  Processing Polarity: How the Ungrammatical Intrudes on the Grammatical , 2008, Cogn. Sci..

[52]  John K Kruschke,et al.  Bayesian data analysis. , 2010, Wiley interdisciplinary reviews. Cognitive science.

[53]  K. Rayner,et al.  Making and correcting errors during sentence comprehension: Eye movements in the analysis of structurally ambiguous sentences , 1982, Cognitive Psychology.

[54]  G. Legge,et al.  Mr. Chips: An ideal-observer model of reading , 1997 .

[55]  Shravan Vasishth,et al.  What is the scanpath signature of syntactic reanalysis , 2011 .

[56]  G. Legge,et al.  Mr. Chips: an ideal-observer model of reading. , 1997, Psychological review.

[57]  Robert P. Abelson,et al.  A Variance Explanation Paradox : When a Little is a Lot , 1985 .

[58]  Don C. Mitchell,et al.  Accounting for regressive eye-movements in models of sentence processing: A reappraisal of the Selective Reanalysis hypothesis , 2008 .

[59]  John Hale,et al.  Parallel processing and sentence comprehension difficulty , 2011 .

[60]  Richard L. Lewis,et al.  An Activation-Based Model of Sentence Processing as Skilled Memory Retrieval , 2005, Cogn. Sci..

[61]  Frank Keller,et al.  Expectation and Locality Effects in German Verb-final Structures. , 2013, Journal of memory and language.

[62]  A. Sanford,et al.  Depth of processing in language comprehension: not noticing the evidence , 2002, Trends in Cognitive Sciences.

[63]  C. Clifton,et al.  Stress Matters: Effects of Anticipated Lexical Stress on Silent Reading. , 2011, Journal of memory and language.

[64]  Reinhold Kliegl,et al.  Current advances in SWIFT , 2006, Cognitive Systems Research.