ICAT: a computational model for the adaptive control of fixation durations

Eye movements depend on cognitive processes related to visual information processing. Much has been learned about the spatial selection of fixation locations, while the principles governing the temporal control (fixation durations) are less clear. Here, we review current theories for the control of fixation durations in tasks like visual search, scanning, scene perception, and reading and propose a new model for the control of fixation durations. We distinguish two local principles from one global principle of control. First, an autonomous saccade timer initiates saccades after random time intervals (local-I). Second, foveal inhibition permits immediate prolongation of fixation durations by ongoing processing (local-II). Third, saccade timing is adaptive, so that the mean timer value depends on task requirements and fixation history (Global). We demonstrate by numerical simulations that our model qualitatively reproduces patterns of mean fixation durations and fixation duration distributions observed in typical experiments. When combined with assumptions of saccade target selection and oculomotor control, the model accounts for both temporal and spatial aspects of eye movement control in two versions of a visual search task. We conclude that the model provides a promising framework for the control of fixation durations in saccadic tasks.

[1]  Björn N.S. Vlaskamp,et al.  Saccadic search: On the duration of a fixation , 2007 .

[2]  J. Henderson Visual Attention and Eye Movement Control During Reading and Picture Viewing , 1992 .

[3]  J. O'Regan,et al.  Fixation location effects on fixation durations during reading: an inverted optimal viewing position effect , 2001, Vision Research.

[4]  Alexander Pollatsek,et al.  Mislocated fixations can account for parafoveal-on-foveal effects in eye movements during reading , 2008, Quarterly journal of experimental psychology.

[5]  Ralf Engbert,et al.  Mislocated fixations during reading and the inverted optimal viewing position effect , 2005, Vision Research.

[6]  Satoshi Shioiri,et al.  Postsaccadic processing of the retinal image during picture scanning , 1993, Perception & psychophysics.

[7]  Philip L. Smith,et al.  Psychology and neurobiology of simple decisions , 2004, Trends in Neurosciences.

[8]  Reinhold Kliegl,et al.  SWIFT: a dynamical model of saccade generation during reading. , 2005, Psychological review.

[9]  Heiner Deubel,et al.  Commentary on Section 2. Attention, information processing and eye movement control. , 2000 .

[10]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[11]  Reinhold Kliegl,et al.  Parallel graded attention models of reading , 2011 .

[12]  Carrick C. Williams,et al.  Eye movements during information processing tasks: Individual differences and cultural effects , 2007, Vision Research.

[13]  Andrew Hollingworth,et al.  Eye Movements During Scene Viewing: An Overview , 1998 .

[14]  W. Becker,et al.  An analysis of the saccadic system by means of double step stimuli , 1979, Vision Research.

[15]  Rudolf Groner,et al.  The effect of spatial frequency content on parameters of eye movements , 2008, Psychological research.

[16]  Hazel I. Blythe,et al.  Children’s eye movements during reading , 2011 .

[17]  K. Rayner,et al.  Effects of contextual constraint on eye movements in reading: A further examination , 1996, Psychonomic bulletin & review.

[18]  Ralf Engbert,et al.  Oculomotor control in a sequential search task , 2007, Vision Research.

[19]  Gary E. Raney,et al.  Eye movement control in reading: a comparison of two types of models. , 1996, Journal of experimental psychology. Human perception and performance.

[20]  Z. Kapoula,et al.  Evidence for a range effect in the saccadic system , 1985, Vision Research.

[21]  R. Walker,et al.  A model of saccade generation based on parallel processing and competitive inhibition , 1999, Behavioral and Brain Sciences.

[22]  Alan M. Wing,et al.  Chapter 4 Modeling variability and dependence in timing , 1996 .

[23]  Miguel P Eckstein,et al.  The time course of visual information accrual guiding eye movement decisions. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[24]  Daniel T. Gillespie,et al.  Monte Carlo simulation of random walks with residence time dependent transition probability rates , 1978 .

[25]  G. d'Ydewalle,et al.  Early peripheral and foveal processing in fixations during scene perception , 2003 .

[26]  Fernanda Ferreira,et al.  Scene Perception for Psycholinguists. , 2004 .

[27]  M D Reddix,et al.  Eye movement control during reading: II. Frequency of refixating a word , 1989, Perception & psychophysics.

[28]  Keith Rayner,et al.  The time course of word frequency and case alternation effects on fixation times in reading: evidence for lexical control of eye movements. , 2010, Journal of experimental psychology. Human perception and performance.

[29]  C. Gardiner Handbook of Stochastic Methods , 1983 .

[30]  J. Henderson,et al.  CRISP: a computational model of fixation durations in scene viewing. , 2010, Psychological review.

[31]  G. Loftus Picture perception: effects of luminance on available information and information-extraction rate. , 1985, Journal of experimental psychology. General.

[32]  Sarah J. White,et al.  Distributional effects of word frequency on eye fixation durations. , 2010, Journal of experimental psychology. Human perception and performance.

[33]  J. Hyönä,et al.  Eye movements during repeated reading of a text. , 1990, Acta psychologica.

[34]  Alexander Pollatsek,et al.  Using E-Z Reader to simulate eye movements in nonreading tasks: a unified framework for understanding the eye-mind link. , 2012, Psychological review.

[35]  K. Rayner The perceptual span and peripheral cues in reading , 1975, Cognitive Psychology.

[36]  K. Rayner Visual attention in reading: Eye movements reflect cognitive processes , 1977, Memory & cognition.

[37]  J. Henderson,et al.  Eye movements and visual memory: Detecting changes to saccade targets in scenes , 2003, Perception & psychophysics.

[38]  Frans W Cornelissen,et al.  The Eyelink Toolbox: Eye tracking with MATLAB and the Psychophysics Toolbox , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[39]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[40]  D. Zola Redundancy and word perception during reading , 1984, Perception & psychophysics.

[41]  Ralf Engbert,et al.  The IOVP effect in mindless reading: Experiment and modeling , 2007, Vision Research.

[42]  Robert M. McPeek,et al.  Concurrent processing of saccades in visual search , 2000, Vision Research.

[43]  R. E. Morrison,et al.  Manipulation of stimulus onset delay in reading: evidence for parallel programming of saccades. , 1984, Journal of experimental psychology. Human perception and performance.

[44]  K. Rayner Eye Movements and Cognitive Processes in Reading, Visual Search, and Scene Perception , 1995 .

[45]  J. D. Gould,et al.  Eye-movement parameters and pattern discrimination , 1969 .

[46]  M A Just,et al.  A theory of reading: from eye fixations to comprehension. , 1980, Psychological review.

[47]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[48]  D. S. Wooding,et al.  Automatic control of saccadic eye movements made in visual inspection of briefly presented 2-D images. , 1995, Spatial vision.

[49]  C. J. Erkelens,et al.  Control of fixation duration in a simple search task , 1996, Perception & psychophysics.

[50]  K. Rayner,et al.  Parafoveal word processing during eye fixations in reading: Effects of word frequency , 1986, Perception & psychophysics.

[51]  K Rayner,et al.  Spelling-sound regularity effects on eye fixations in reading , 2000, Perception & psychophysics.

[52]  Erik D. Reichle,et al.  The E-Z Reader model of eye-movement control in reading: Comparisons to other models , 2003, Behavioral and Brain Sciences.

[53]  J. Henderson Human gaze control during real-world scene perception , 2003, Trends in Cognitive Sciences.

[54]  Robert M. McPeek,et al.  Superior colliculus activity related to concurrent processing of saccade goals in a visual search task. , 2002, Journal of neurophysiology.

[55]  K. Rayner The 35th Sir Frederick Bartlett Lecture: Eye movements and attention in reading, scene perception, and visual search , 2009, Quarterly journal of experimental psychology.

[56]  Graham L. Pierce,et al.  Eye movements during scene viewing: Evidence for mixed control of fixation durations , 2008, Psychonomic bulletin & review.

[57]  Björn N. S. Vlaskamp,et al.  Saccadic search performance: the effect of element spacing , 2005, Experimental Brain Research.

[58]  P. de Graef,et al.  Perceptual effects of scene context on object identification , 1990, Psychological research.

[59]  A. Kristofferson,et al.  Response delays and the timing of discrete motor responses , 1973 .

[60]  Denis Drieghe,et al.  Parafoveal-on-foveal effects on eye movements during reading , 2011 .

[61]  Erik D. Reichle,et al.  Using E-Z reader to model the effects of higher level language processing on eye movements during reading , 2009, Psychonomic bulletin & review.

[62]  J. Henderson,et al.  The effects of semantic consistency on eye movements during complex scene viewing , 1999 .

[63]  G. McConkie,et al.  The span of the effective stimulus during a fixation in reading , 1975 .

[64]  Geoffrey R. Loftus,et al.  Effects of Visual Degradation on Eye-Fixation Duration, Perceptual Processing, and Long-Term Visual Memory , 1992 .

[65]  Erik D. Reichle,et al.  Toward a model of eye movement control in reading. , 1998, Psychological review.

[66]  H. Basford,et al.  Optimal eye movement strategies in visual search , 2005 .

[67]  K. Rayner,et al.  Contextual effects on word perception and eye movements during reading , 1981 .

[68]  G. McConkie,et al.  What guides a reader's eye movements? , 1976, Vision Research.

[69]  Adrian Staub,et al.  The effect of lexical predictability on distributions of eye fixation durations , 2011, Psychonomic bulletin & review.

[70]  Albrecht W. Inhoff,et al.  Two stages of word processing during eye fixations in the reading of prose , 1984 .

[71]  K Rayner,et al.  Eye-Movement Control in Direction-Coded Visual Search , 2001, Perception.

[72]  K. Rayner Eye movements in reading: Models and data , 2003, Behavioral and Brain Sciences.

[73]  Hooge PII: S0042-6989(98)00213-2 , 1998 .

[74]  N. Mackworth,et al.  Cognitive determinants of fixation location during picture viewing. , 1978, Journal of experimental psychology. Human perception and performance.

[75]  Denis Cousineau,et al.  Confidence intervals in within-subject designs: A simpler solution to Loftus and Masson's method , 2005 .

[76]  J. Vaughan Control of fixation duration in visual search and memory search: another look. , 1982, Journal of experimental psychology. Human perception and performance.

[77]  A. Kennedy,et al.  Parafoveal-on-foveal interactions in word recognition , 2002, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[78]  J. Henderson,et al.  Effects of foveal processing difficulty on the perceptual span in reading: implications for attention and eye movement control. , 1990, Journal of experimental psychology. Learning, memory, and cognition.

[79]  Myriam Chanceaux,et al.  The influence of clutter on real-world scene search: evidence from search efficiency and eye movements. , 2009, Journal of vision.

[80]  Michael L. Mack,et al.  Viewing task influences eye movement control during active scene perception. , 2009, Journal of vision.

[81]  R Todd Ogden,et al.  Adding drift to the decomposition of simple isochronous tapping: an extension of the Wing-Kristofferson model. , 2004, Journal of experimental psychology. Human perception and performance.

[82]  H Herman Bouma,et al.  On the control of eye saccades in reading , 1974 .

[83]  Ralf Engbert,et al.  The zoom lens of attention: Simulating shuffled versus normal text reading using the SWIFT model , 2012, Visual cognition.

[84]  Dorothea Heiss-Czedik,et al.  An Introduction to Genetic Algorithms. , 1997, Artificial Life.

[85]  J. D. Gould,et al.  Eye movements during visual search and memory search. , 1973, Journal of experimental psychology.

[86]  G. Zelinsky A theory of eye movements during target acquisition. , 2008, Psychological review.

[87]  E. Matin Saccadic suppression: a review and an analysis. , 1974, Psychological bulletin.

[88]  K. Rayner,et al.  Eye movements of older and younger readers when reading disappearing text. , 2011, Psychology and aging.

[89]  K. Rayner,et al.  Eye Movement Control during Reading: Evidence for Direct Control , 1981, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[90]  Jonathan Vaughan,et al.  Delay of stimulus presentation after the saccade in visual search , 1977 .

[91]  J. Schall,et al.  Neural selection and control of visually guided eye movements. , 1999, Annual review of neuroscience.

[92]  F. C. Volkmann,et al.  Time course of visual inhibition during voluntary saccades. , 1968, Journal of the Optical Society of America.

[93]  K. Rayner,et al.  Lexical complexity and fixation times in reading: Effects of word frequency, verb complexity, and lexical ambiguity , 1986, Memory & cognition.

[94]  Erik D. Reichle,et al.  Direct lexical control of eye movements in reading: Evidence from a survival analysis of fixation durations , 2012, Cognitive Psychology.

[95]  G. McConkie,et al.  Asymmetry of the perceptual span in reading , 1976 .

[96]  M. Just,et al.  The psychology of reading and language comprehension , 1986 .

[97]  J. Henderson,et al.  High-level scene perception. , 1999, Annual review of psychology.

[98]  V. Lamme,et al.  The distinct modes of vision offered by feedforward and recurrent processing , 2000, Trends in Neurosciences.

[99]  G. V. Simpson,et al.  Flow of activation from V1 to frontal cortex in humans , 2001, Experimental Brain Research.

[100]  John M Henderson,et al.  Stable individual differences across images in human saccadic eye movements. , 2008, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[101]  N. P. Bichot,et al.  Continuous processing in macaque frontal cortex during visual search , 2001, Neuropsychologia.

[102]  T. Salthouse,et al.  Determinants of eye-fixation duration. , 1980, The American journal of psychology.

[103]  E. C. Poulton,et al.  Human Manual Control , 2011 .

[104]  Antonio Torralba,et al.  Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. , 2006, Psychological review.

[105]  Reinhold Kliegl,et al.  Mathematical models of eye movements in reading: a possible role for autonomous saccades , 2001, Biological Cybernetics.

[106]  M. Brysbaert,et al.  Eye Movement Control during Reading: Foveal Load and Parafoveal Processing , 1999, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[107]  P. W. Kerr,et al.  Eye movement control during reading: I. The location of initial eye fixations on words , 1987, Vision Research.

[108]  Ralf Engbert,et al.  Control of fixation duration during scene viewing by interaction of foveal and peripheral processing. , 2013, Journal of vision.

[109]  Alan M. Wing,et al.  Modeling variability and dependence in timing , 1996 .

[110]  Reinhold Kliegl,et al.  Post-interpretive processes influence interpretive processing during reading: evidence from eye movements , 2007 .

[111]  G. McConkie,et al.  Eye movements during reading: a theory of saccade initiation times , 2001, Vision Research.

[112]  S. Amari Dynamics of pattern formation in lateral-inhibition type neural fields , 1977, Biological Cybernetics.

[113]  Ralf Engbert,et al.  Eye movements during reading of randomly shuffled text , 2010, Vision Research.

[114]  D. Ballard,et al.  Task constraints in visual working memory , 1997, Vision Research.

[115]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[116]  T Ishida,et al.  Temporal properties of information extraction in reading studied by a text-mask replacement technique. , 1989, Journal of the Optical Society of America. A, Optics and image science.

[117]  Simon P. Liversedge,et al.  Eye movements when reading disappearing text: The importance of the word to the right of fixation , 2006, Vision Research.

[118]  Keith Rayner,et al.  Reading Disappearing Text , 2003, Psychological science.

[119]  J. H. Bertera,et al.  Latency of sequential eye movements: implications for reading. , 1983, Journal of experimental psychology. Human perception and performance.

[120]  Stefanie I. Becker Determinants of Dwell Time in Visual Search: Similarity or Perceptual Difficulty? , 2011, PloS one.

[121]  Ralf Engbert,et al.  Self-Consistent Estimation of Mislocated Fixations during Reading , 2008, PloS one.

[122]  A. Bowers,et al.  Eye movements and reading with simulated visual impairment , 1997, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[123]  Björn N.S. Vlaskamp,et al.  Crowding degrades saccadic search performance , 2005 .

[124]  Ralf Engbert,et al.  Fixation durations before word skipping in reading , 2005, Psychonomic bulletin & review.

[125]  G. Schöner,et al.  Dynamic Field Theory of Movement Preparation , 2022 .

[126]  Alexander Pollatsek,et al.  Asymmetries in the perceptual span for Israeli readers , 1981, Brain and Language.

[127]  A W Inhoff,et al.  Is the processing of words during eye fixations in reading strictly serial? , 2000, Perception & psychophysics.

[128]  J. Findlay,et al.  Active Vision: The Psychology of Looking and Seeing , 2003 .

[129]  Ralf Engbert,et al.  A dynamical model of saccade generation in reading based on spatially distributed lexical processing , 2002, Vision Research.

[130]  Andreas A. Ioannides,et al.  Precise mapping of early visual responses in space and time , 2007, NeuroImage.

[131]  C. Koch,et al.  Probabilistic modeling of eye movement data during conjunction search via feature-based attention. , 2007, Journal of vision.

[132]  J. Henderson,et al.  How are eye fixation durations controlled during scene viewing? Further evidence from a scene onset delay paradigm , 2009 .

[133]  Christopher M. Harris,et al.  The distribution of fixation durations in infants and naive adults , 1988, Vision Research.

[134]  Gary Feng,et al.  Time Course and Hazard Function: A Distributional Analysis of Fixation Duration in Reading , 2009 .

[135]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[136]  K. Rayner Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[137]  A. Jacobs Eye-movement control in visual search: How direct is visual span control? , 1986, Perception & psychophysics.

[138]  Bernhard Schölkopf,et al.  Center-surround patterns emerge as optimal predictors for human saccade targets. , 2009, Journal of vision.

[139]  Ralf Engbert,et al.  Eye movements in a sequential scanning task: evidence for distributed processing. , 2012, Journal of vision.

[140]  Ralf Engbert,et al.  Tracking the mind during reading: the influence of past, present, and future words on fixation durations. , 2006, Journal of experimental psychology. General.

[141]  C. J. Erkelens,et al.  PII: S0042-6989(97)00287-3 , 2003 .

[142]  Wilson S. Geisler,et al.  Optimal eye movement strategies in visual search , 2005, Nature.

[143]  Robert W. Kentridge,et al.  Eye movements when reading disappearing text: is there a gap effect in reading? , 2004, Vision Research.

[144]  K Rayner,et al.  Reading without a fovea. , 1979, Science.

[145]  D. Sherrington Stochastic Processes in Physics and Chemistry , 1983 .

[146]  J. Henderson,et al.  Does gravity matter? Effects of semantic and syntactic inconsistencies on the allocation of attention during scene perception. , 2009, Journal of vision.

[147]  Ilpo Kojo,et al.  Effect of stimulus contrast on performance and eye movements in visual search , 2001, Vision Research.

[148]  Carrick C. Williams,et al.  Searching for an O in an array of Cs: Eye movements track moment-to-moment processing in visual search , 2007, Perception & psychophysics.

[149]  Erik D. Reichle,et al.  Eye Movement Control during Reading: Effects of Word Frequency and Orthographic Familiarity Word Frequency Effects , 2022 .

[150]  Ralf Engbert,et al.  Readers Use Bayesian Estimation for Eye Movement Control , 2010, Psychological science.

[151]  Ralf Engbert,et al.  Length, frequency, and predictability effects of words on eye movements in reading , 2004 .