The utility of modelling word identification from visual input within models of eye movements in reading

Decades of empirical work have shown that a range of eye movement phenomena in reading are sensitive to the details of the process of word identification. Despite this, major models of eye movement control in reading do not explicitly model word identification from visual input. This paper presents an argument for developing models of eye movements that do include detailed models of word identification. Specifically, we argue that insights into eye movement behaviour can be gained by understanding which phenomena naturally arise from an account in which the eyes move for efficient word identification, and that one important use of such models is to test which eye movement phenomena can be understood this way. As an extended case study, we present evidence from an extension of a previous model of eye movement control in reading that does explicitly model word identification from visual input, Mr. Chips (Legge, Klitz, & Tjan, 1997), to test two proposals for the effect of using linguistic context on reading efficiency.

[1]  John Morton,et al.  The Effects of Context upon Speed of Reading, Eye Movements and Eye-voice Span , 1964 .

[2]  G. McConkie,et al.  What guides a reader's eye movements? , 1976, Vision Research.

[3]  K. Rayner Eye Guidance in Reading: Fixation Locations within Words , 1979, Perception.

[4]  G. McConkie,et al.  Integrating information across eye movements , 1980, Cognitive Psychology.

[5]  K. Rayner,et al.  Contextual effects on word perception and eye movements during reading , 1981 .

[6]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: I. An account of basic findings. , 1981 .

[7]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: Part 2. The contextual enhancement effect and some tests and extensions of the model. , 1982, Psychological review.

[8]  J. H. Bertera,et al.  The availability of useful information to the right of fixation in reading , 1982, Perception & psychophysics.

[9]  Alexander Pollatsek,et al.  Eye movement control in reading: The role of word boundaries. , 1982 .

[10]  R. Weale Vision. A Computational Investigation Into the Human Representation and Processing of Visual Information. David Marr , 1983 .

[11]  J. O'Regan,et al.  Convenient fixation location within isolated words of different length and structure. , 1984, Journal of experimental psychology. Human perception and performance.

[12]  D. Balota,et al.  The interaction of contextual constraints and parafoveal visual information in reading , 1985, Cognitive Psychology.

[13]  J. O'Regan,et al.  Eye-movement strategy and tactics in word recognition and reading. , 1987 .

[14]  V. M. Holmes,et al.  DECOMPOSING FRENCH WORDS , 1987 .

[15]  G Underwood,et al.  Information Influences the Pattern of Eye Fixations during Sentence Comprehension , 1988, Perception.

[16]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: part 1.: an account of basic findings , 1988 .

[17]  P. W. Kerr,et al.  Eye movement control during reading: I. The location of initial eye fixations on words , 1987, Vision Research.

[18]  G Underwood,et al.  Reading long words embedded in sentences: informativeness of word halves affects eye movements. , 1989, Journal of experimental psychology. Human perception and performance.

[19]  M D Reddix,et al.  Eye movement control during reading: II. Frequency of refixating a word , 1989, Perception & psychophysics.

[20]  Robin K. Morris,et al.  Eye movement guidance in reading: the role of parafoveal letter and space information. , 1990, Journal of experimental psychology. Human perception and performance.

[21]  J. O'Regan,et al.  Optimal landing position in reading isolated words and continuous text , 1990, Perception & psychophysics.

[22]  G Underwood,et al.  How Do Readers Know Where to Look Next? Local Information Distributions Influence Eye Fixations , 1990, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[23]  Joël Pynte,et al.  Within-word inspection strategies in continuous reading: time course of perceptual, lexical, and contextual processes , 1991 .

[24]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[25]  Alan Agresti,et al.  Categorical Data Analysis , 1991, International Encyclopedia of Statistical Science.

[26]  Robin K. Morris,et al.  Eye movement control in reading: evidence against semantic preprocessing. , 1992, Journal of experimental psychology. Human perception and performance.

[27]  A. Agresti Categorical data analysis , 1993 .

[28]  John R. Anderson,et al.  The Adaptive Character of Thought , 1990 .

[29]  J. O'Regan,et al.  Mindless reading: Eye-movement characteristics are similar in scanning letter strings and reading texts , 1995, Perception & psychophysics.

[30]  Jukka Hyönä,et al.  Do irregular letter combinations attract readers' attention? Evidence from fixation locations in words. , 1995 .

[31]  Gary E. Raney,et al.  Eye movement control in reading: a comparison of two types of models. , 1996, Journal of experimental psychology. Human perception and performance.

[32]  K. Rayner,et al.  Effects of contextual constraint on eye movements in reading: A further examination , 1996, Psychonomic bulletin & review.

[33]  G. Legge,et al.  Mr. Chips: An ideal-observer model of reading , 1997 .

[34]  Erik D. Reichle,et al.  Toward a model of eye movement control in reading. , 1998, Psychological review.

[35]  K. Rayner Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[36]  James J. Clark,et al.  Word ambiguity and the optimal viewing position in reading , 1999, Vision Research.

[37]  Stanley F. Chen,et al.  An empirical study of smoothing techniques for language modeling , 1999 .

[38]  A Pollatsek,et al.  The effects of "neighborhood size" in reading and lexical decision. , 1999, Journal of experimental psychology. Human perception and performance.

[39]  F ChenStanley,et al.  An Empirical Study of Smoothing Techniques for Language Modeling , 1996, ACL.

[40]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[41]  James H. Martin,et al.  Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition , 2000 .

[42]  G. Legge,et al.  Mr. Chips 2002: new insights from an ideal-observer model of reading , 2002, Vision Research.

[43]  Ralf Engbert,et al.  A dynamical model of saccade generation in reading based on spatially distributed lexical processing , 2002, Vision Research.

[44]  R. Shillcock,et al.  Low-level predictive inference in reading: the influence of transitional probabilities on eye movements , 2003, Vision Research.

[45]  Jonathan Grainger,et al.  Commentary on Section 3 – Moving Eyes and Reading Words: How Can a Computational Model Combine the Two? , 2003 .

[46]  Jonathan Grainger,et al.  Visual word recognition and oculomotor control in reading , 2003 .

[47]  Erik D. Reichle,et al.  The E-Z Reader model of eye-movement control in reading: Comparisons to other models , 2003, Behavioral and Brain Sciences.

[48]  Alexander Pollatsek,et al.  The effects of frequency and predictability on eye fixations in reading: implications for the E-Z Reader model. , 2004, Journal of experimental psychology. Human perception and performance.

[49]  A. Kennedy,et al.  Parafoveal-on-foveal effects in normal reading , 2005, Vision Research.

[50]  Wilson S. Geisler,et al.  Optimal eye movement strategies in visual search , 2005, Nature.

[51]  Reinhold Kliegl,et al.  SWIFT: a dynamical model of saccade generation during reading. , 2005, Psychological review.

[52]  H. Basford,et al.  Optimal eye movement strategies in visual search , 2005 .

[53]  Dennis Norris,et al.  The Bayesian reader: explaining word recognition as an optimal Bayesian decision process. , 2006, Psychological review.

[54]  Ronan G. Reilly,et al.  Some empirical tests of an interactive activation model of eye movement control in reading , 2006, Cognitive Systems Research.

[55]  Short Article: The Impact of Letter Detection on Eye Movement Patterns during Reading: Reconsidering Lexical Analysis in Connected Text as a Function of Task , 2006, Quarterly journal of experimental psychology.

[56]  Antonio Torralba,et al.  Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. , 2006, Psychological review.

[57]  Erik D. Reichle,et al.  Tests of the E-Z Reader model: Exploring the interface between cognition and eye-movement control , 2006, Cognitive Psychology.

[58]  K. Rayner,et al.  Eye-Movement Control in Reading , 2006 .

[59]  Preeti Verghese,et al.  Where to look next? Eye movements reduce local uncertainty. , 2007, Journal of vision.

[60]  Jiri Najemnik,et al.  Eye movement statistics in humans are consistent with an optimal search strategy. , 2008, Journal of vision.

[61]  K. McRae,et al.  A Fully Analytical Model of the Visual Lexical Decision Task , 2008 .

[62]  Yuhong Yang Elements of Information Theory (2nd ed.). Thomas M. Cover and Joy A. Thomas , 2008 .

[63]  Tim K Marks,et al.  SUN: A Bayesian framework for saliency using natural statistics. , 2008, Journal of vision.

[64]  G. Zelinsky A theory of eye movements during target acquisition. , 2008, Psychological review.

[65]  Erik D. Reichle,et al.  Using E-Z reader to model the effects of higher level language processing on eye movements during reading , 2009, Psychonomic bulletin & review.

[66]  K. Rayner The 35th Sir Frederick Bartlett Lecture: Eye movements and attention in reading, scene perception, and visual search , 2009, Quarterly journal of experimental psychology.

[67]  K. Rayner,et al.  Eye movement evidence that readers maintain and act on uncertainty about past linguistic input , 2009, Proceedings of the National Academy of Sciences.

[68]  Daniel Jurafsky,et al.  Speech and language processing: an introduction to natural language processing, computational linguistics, and speech recognition, 2nd Edition , 2009, Prentice Hall series in artificial intelligence.

[69]  Pierre Baldi,et al.  Bayesian surprise attracts human attention , 2005, Vision Research.

[70]  Dennis Norris,et al.  Putting it all together: a unified account of word recognition and reaction-time distributions. , 2009, Psychological review.

[71]  Matthew H Tong,et al.  SUN: Top-down saliency using natural statistics , 2009, Visual cognition.

[72]  Timothy J Slattery,et al.  Word misperception, the neighbor frequency effect, and the role of sentence context: evidence from eye movements. , 2009, Journal of experimental psychology. Human perception and performance.

[73]  Roger Levy,et al.  A Rational Model of Eye Movement Control in Reading , 2010, ACL.

[74]  Javier R. Movellan,et al.  Infomax Control of Eye Movements , 2010, IEEE Transactions on Autonomous Mental Development.

[75]  J. Henderson,et al.  CRISP: a computational model of fixation durations in scene viewing. , 2010, Psychological review.

[76]  Ralf Engbert,et al.  The zoom lens of attention: Simulating shuffled versus normal text reading using the SWIFT model , 2012, Visual cognition.

[77]  Erik D. Reichle,et al.  Eye movements in reading versus nonreading tasks: Using E-Z Reader to understand the role of word/stimulus familiarity , 2012, Visual cognition.

[78]  Laurent Itti,et al.  Influence of the amount of context learned for improving object classification when simultaneously learning object and contextual cues , 2012 .

[79]  J. Henderson,et al.  Using CRISP to model global characteristics of fixation durations in scene viewing and reading with a common mechanism , 2012 .

[80]  Gregory J Zelinsky,et al.  TAM: Explaining off-object fixations and central fixation tendencies as effects of population averaging during search , 2012, Visual cognition.