The prominence of behavioural biases in eye guidance

When attempting to understand where people look during scene perception, researchers typically focus on the relative contributions of low- and high-level cues. Computational models of the contribution of low-level features to fixation selection, with modifications to incorporate top-down sources of information have been abundant in recent research. However, we are still some way from a model that can explain many of the complexities of eye movement behaviour. Here we show that understanding biases in how we move the eyes can provide powerful new insights into the decision about where to look in complex scenes. A model based solely on these biases and therefore blind to current visual information outperformed popular salience-based approaches. Our data show that incorporating an understanding of oculomotor behavioural biases into models of eye guidance is likely to significantly improve our understanding of where we choose to fixate in natural scenes.

[1]  R. C. Langford How People Look at Pictures, A Study of the Psychology of Perception in Art. , 1936 .

[2]  H. Burian,et al.  A study of separation difficulty. Its relationship to visual acuity in normal and amblyopic eyes. , 1962, American journal of ophthalmology.

[3]  D. Robinson The mechanics of human smooth pursuit eye movement. , 1965, The Journal of physiology.

[4]  H. BOUMA,et al.  Interaction Effects in Parafoveal Letter Recognition , 1970, Nature.

[5]  E. Matin Saccadic suppression: a review and an analysis. , 1974, Psychological bulletin.

[6]  L. Stark,et al.  Most naturally occurring human saccades have magnitudes of 15 degrees or less. , 1975, Investigative ophthalmology.

[7]  R. Carpenter,et al.  Movements of the Eyes , 1978 .

[8]  P. Viviani,et al.  The curvature of oblique saccades , 1977, Vision Research.

[9]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[10]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[11]  J. V. Gisbergen,et al.  A parametric analysis of human saccades in different experimental paradigms , 1987, Vision Research.

[12]  H. Collewijn,et al.  Binocular co‐ordination of human vertical saccadic eye movements. , 1988, The Journal of physiology.

[13]  J. Duncan,et al.  Visual search and stimulus similarity. , 1989, Psychological review.

[14]  W. Becker,et al.  Human oblique saccades: Quantitative analysis of the relation between horizontal and vertical components , 1990, Vision Research.

[15]  A. Hendrickson,et al.  Human photoreceptor topography , 1990, The Journal of comparative neurology.

[16]  D H Ballard,et al.  Hand-eye coordination during sequential tasks. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[17]  D. Burr,et al.  Selective suppression of the magnocellular visual pathway during saccadic eye movements , 1994, Nature.

[18]  D. S. Wooding,et al.  Fixation sequences made during visual examination of briefly presented 2D images. , 1997, Spatial vision.

[19]  Roland Baddeley,et al.  The Correlational Structure of Natural Images and the Calibration of Spatial Representations , 1997, Cogn. Sci..

[20]  K. Hoffmann,et al.  Optokinetic eye movements elicited by radial optic flow in the macaque monkey. , 1998, Journal of neurophysiology.

[21]  L. P. O'Keefe,et al.  The influence of fixational eye movements on the response of neurons in area MT of the macaque , 1998, Visual Neuroscience.

[22]  J. Wolfe,et al.  What Can 1 Million Trials Tell Us About Visual Search? , 1998 .

[23]  B. C. Motter,et al.  The guidance of eye movements during active visual search , 1998, Vision Research.

[24]  M. Land,et al.  The Roles of Vision and Eye Movements in the Control of Activities of Daily Living , 1998, Perception.

[25]  P Reinagel,et al.  Natural scene statistics at the centre of gaze. , 1999, Network.

[26]  G. Hauske,et al.  Object and scene analysis by saccadic eye-movements: an investigation with higher-order statistics. , 2000, Spatial vision.

[27]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[28]  M. Hayhoe,et al.  In what ways do eye movements contribute to everyday activities? , 2001, Vision Research.

[29]  Sabrina Pitzalis,et al.  Spatial Anisotropy of Saccadic Latency in Normal Subjects and Brain-Damaged Patients , 2001, Cortex.

[30]  J. Pelz,et al.  Oculomotor behavior and perceptual strategies in complex tasks , 2001, Vision Research.

[31]  N. Badler,et al.  Eyes Alive Eyes Alive Eyes Alive Figure 1: Sample Images of an Animated Face with Eye Movements , 2022 .

[32]  Derrick J. Parkhurst,et al.  Modeling the role of salience in the allocation of overt visual attention , 2002, Vision Research.

[33]  Li Zhaoping,et al.  The distribution of visual objects on the retina: connecting eye movements and cone distributions. , 2003, Journal of vision.

[34]  Mary M Hayhoe,et al.  Visual memory and motor planning in a natural task. , 2003, Journal of vision.

[35]  Antonio Torralba,et al.  Statistics of natural image categories , 2003, Network.

[36]  Derrick J. Parkhurst,et al.  Scene content selected by active vision. , 2003, Spatial vision.

[37]  Michael F. Land,et al.  The coordination of rotations of the eyes, head and trunk in saccadic turns produced in natural situations , 2004, Experimental Brain Research.

[38]  P. König,et al.  Interactions between eye movement systems in cats and humans , 2004, Experimental Brain Research.

[39]  John K. Tsotsos,et al.  Proceedings of the Second international conference on Attention and Performance in Computational Vision , 2004 .

[40]  J. Wolfe,et al.  What attributes guide the deployment of visual attention and how do they do it? , 2004, Nature Reviews Neuroscience.

[41]  Michael L. Mack,et al.  Human Gaze Control in RealWorld Search , 2004, WAPCV.

[42]  Antonio Torralba,et al.  Contextual Priming for Object Detection , 2003, International Journal of Computer Vision.

[43]  Konrad Paul Kording,et al.  Bayesian integration in sensorimotor learning , 2004, Nature.

[44]  Wilson S. Geisler,et al.  Optimal eye movement strategies in visual search , 2005, Nature.

[45]  L. Itti,et al.  Modeling the influence of task on attention , 2005, Vision Research.

[46]  I. Hooge,et al.  Inhibition of return is not a foraging facilitator in saccadic search and free viewing , 2005, Vision Research.

[47]  B. Velichkovsky,et al.  Time course of information processing during scene perception: The relationship between saccade amplitude and fixation duration , 2005 .

[48]  Iain D. Gilchrist,et al.  Visual correlates of fixation selection: effects of scale and time , 2005, Vision Research.

[49]  R. Baddeley,et al.  The long and the short of it: Spatial statistics at fixation vary with saccade amplitude and task , 2006, Vision Research.

[50]  M. Land Eye movements and the control of actions in everyday life , 2006, Progress in Retinal and Eye Research.

[51]  Roland J. Baddeley,et al.  High frequency edges (but not contrast) predict where we fixate: A Bayesian system identification analysis , 2006, Vision Research.

[52]  T. Foulsham,et al.  Quarterly Journal of Experimental Psychology: in press Visual saliency and semantic incongruency influence eye movements when , 2022 .

[53]  T. Foulsham,et al.  Eye movements during scene inspection: A test of the saliency map hypothesis , 2006 .

[54]  Antonio Torralba,et al.  Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. , 2006, Psychological review.

[55]  Christof Koch,et al.  Modeling attention to salient proto-objects , 2006, Neural Networks.

[56]  I. Gilchrist,et al.  Evidence for a systematic component within scan paths in visual search , 2006 .

[57]  Preeti Verghese,et al.  Where to look next? Eye movements reduce local uncertainty. , 2007, Journal of vision.

[58]  P. Wurtz,et al.  Size Matters: Saccades during Scene Perception , 2007, Perception.

[59]  Iain D. Gilchrist,et al.  Investigating a space-variant weighted salience account of visual selection , 2007, Vision Research.

[60]  Carrick C. Williams,et al.  Eye movements during information processing tasks: Individual differences and cultural effects , 2007, Vision Research.

[61]  Dana H. Ballard,et al.  Modeling embodied visual behaviors , 2007, TAP.

[62]  M. Kenward,et al.  An Introduction to the Bootstrap , 2007 .

[63]  Benjamin W Tatler,et al.  The central fixation bias in scene viewing: selecting an optimal viewing position independently of motor biases and image feature distributions. , 2007, Journal of vision.

[64]  Michael L. Mack,et al.  VISUAL SALIENCY DOES NOT ACCOUNT FOR EYE MOVEMENTS DURING VISUAL SEARCH IN REAL-WORLD SCENES , 2007 .

[65]  Konrad Paul Kording,et al.  The statistics of natural hand movements , 2008, Experimental Brain Research.

[66]  Benjamin W. Tatler,et al.  Systematic tendencies in scene viewing , 2008 .

[67]  Nuno Vasconcelos,et al.  On the plausibility of the discriminant center-surround hypothesis for visual saliency. , 2008, Journal of vision.

[68]  Marcus Nyström,et al.  Semantic override of low-level features in image viewing - both initially and overall , 2008 .

[69]  F. Hamker,et al.  About the influence of post-saccadic mechanisms for visual stability on peri-saccadic compression of object location. , 2008, Journal of vision.

[70]  Jiri Najemnik,et al.  Eye movement statistics in humans are consistent with an optimal search strategy. , 2008, Journal of vision.

[71]  C. Koch,et al.  Task-demands can immediately reverse the effects of sensory-driven saliency in complex visual stimuli. , 2008, Journal of vision.

[72]  T. Foulsham,et al.  What can saliency models predict about eye movements? Spatial and sequential aspects of fixations during encoding and recognition. , 2008, Journal of vision.

[73]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[74]  Matthew H Tong,et al.  SUN: Top-down saliency using natural statistics , 2009, Visual cognition.

[75]  Krista A. Ehinger,et al.  Modelling search for people in 900 scenes: A combined source model of eye guidance , 2009 .

[76]  Donald Morrill SACCADES , 2010, Fourth Genre: Explorations in Nonfiction.