What is the scanpath signature of syntactic reanalysis

Which repair strategy does the language system deploy when it gets garden-pathed, and what can regressive eye movements in reading tell us about reanalysis strategies? Several influential eye-tracking studies on syntactic reanalysis (Frazier & Rayner, 1982; Meseguer, Carreiras, & Clifton, 2002; Mitchell, Shen, Green, & Hodgson, 2008) have addressed this question by examining scanpaths, i.e., sequential patterns of eye fixations. However, in the absence of a suitable method for analyzing scanpaths, these studies relied on simplified dependent measures that are arguably ambiguous and hard to interpret. We address the theoretical question of repair strategy by developing a new method that quantifies scanpath similarity. Our method reveals several distinct fixation strategies associated with reanalysis that went undetected in a previously published data set (Meseguer et al., 2002). One prevalent pattern suggests re-parsing of the sentence, a strategy that has been discussed in the literature (Frazier & Rayner, 1982); however, readers differed tremendously in how they orchestrated the various fixation strategies. Our results suggest that the human parsing system non-deterministically adopts different strategies when confronted with the disambiguating material in garden-path sentences.

[1]  Richard L. Lewis,et al.  Reanalysis and Limited Repair Parsing: Leaping off the Garden Path , 1998 .

[2]  John R. Anderson,et al.  Automated Eye-Movement Protocol Analysis , 2001, Hum. Comput. Interact..

[3]  L. Stark,et al.  Spontaneous Eye Movements During Visual Imagery Reflect the Content of the Visual Scene , 1997, Journal of Cognitive Neuroscience.

[4]  Benton J. Underwood,et al.  Individual differences as a crucible in theory construction. , 1975 .

[5]  Erik D. Reichle,et al.  Using E-Z reader to model the effects of higher level language processing on eye movements during reading , 2009, Psychonomic bulletin & review.

[6]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[7]  D. Whitteridge,et al.  The representation of the visual field on the cerebral cortex in monkeys , 1961, The Journal of physiology.

[8]  K. Rayner,et al.  Eye movements in reading words and sentences , 2007 .

[9]  Tim Smith,et al.  Sentence processing , 2004 .

[10]  John R. Anderson,et al.  Mapping eye movements to cognitive processes , 1999 .

[11]  J. Rovamo,et al.  Cortical magnification factor predicts the photopic contrast sensitivity of peripheral vision , 1978, Nature.

[12]  Reinhold Kliegl,et al.  SWIFT: a dynamical model of saccade generation during reading. , 2005, Psychological review.

[13]  K. Rayner Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[14]  M A Just,et al.  A theory of reading: from eye fixations to comprehension. , 1980, Psychological review.

[15]  Don C. Mitchell,et al.  Accounting for regressive eye-movements in models of sentence processing: A reappraisal of the Selective Reanalysis hypothesis , 2008 .

[16]  C. Clifton,et al.  Overt reanalysis strategies and eye movements during the reading of mild garden path sentences , 2002, Memory & cognition.

[17]  Ralf Engbert,et al.  Tracking the mind during reading: the influence of past, present, and future words on fixation durations. , 2006, Journal of experimental psychology. General.

[18]  K. Rayner Eye movements in reading: Models and data , 2003, Behavioral and Brain Sciences.

[19]  Merrill F. Garrett,et al.  Sentence processing , 1990 .

[20]  Adrian E. Raftery,et al.  How Many Clusters? Which Clustering Method? Answers Via Model-Based Cluster Analysis , 1998, Comput. J..

[21]  K. Rayner,et al.  Lexical complexity and fixation times in reading: Effects of word frequency, verb complexity, and lexical ambiguity , 1986, Memory & cognition.

[22]  Adrian E. Raftery,et al.  MCLUST Version 3 for R: Normal Mixture Modeling and Model-Based Clustering † , 2007 .

[23]  M. Pickering,et al.  Structural change and reanalysis difficulty in language comprehension , 1999 .

[24]  P. D. Eimas,et al.  Speech, language, and communication , 1997 .

[25]  K. Rayner,et al.  Making and correcting errors during sentence comprehension: Eye movements in the analysis of structurally ambiguous sentences , 1982, Cognitive Psychology.

[26]  S. B. Needleman,et al.  A general method applicable to the search for similarities in the amino acid sequence of two proteins. , 1970, Journal of molecular biology.

[27]  John W. Sammon,et al.  A Nonlinear Mapping for Data Structure Analysis , 1969, IEEE Transactions on Computers.

[28]  Vered Argaman,et al.  Against Repair-Based Reanalysis in Sentence Comprehension , 2003, Journal of psycholinguistic research.

[29]  Erik D. Reichle,et al.  Toward a model of eye movement control in reading. , 1998, Psychological review.

[30]  Lyn Frazier,et al.  ON COMPREHENDING SENTENCES: SYNTACTIC PARSING STRATEGIES. , 1979 .

[31]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[32]  Janet D. Fodor,et al.  Garden Path Repair: Diagnosis and Triage , 2000, Language and speech.

[33]  Robin L. Hill,et al.  Eye movements : a window on mind and brain , 2007 .

[34]  Jan Theeuwes,et al.  ScanMatch: A novel method for comparing fixation sequences , 2010, Behavior research methods.

[35]  Adrian E. Raftery,et al.  Model-Based Clustering, Discriminant Analysis, and Density Estimation , 2002 .

[36]  Vladimir I. Levenshtein,et al.  Binary codes capable of correcting deletions, insertions, and reversals , 1965 .

[37]  J. Kruskal Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis , 1964 .

[38]  H. Akaike A new look at the statistical model identification , 1974 .