The saccadic flow baseline: Accounting for image-independent biases in fixation behavior.

Much effort has been made to explain eye guidance during natural scene viewing. However, a substantial component of fixation placement appears to be a set of consistent biases in eye movement behavior. We introduce the concept of saccadic flow, a generalization of the central bias that describes the image-independent conditional probability of making a saccade to (xi+1, yi+1), given a fixation at (xi, yi). We suggest that saccadic flow can be a useful prior when carrying out analyses of fixation locations, and can be used as a submodule in models of eye movements during scene viewing. We demonstrate the utility of this idea by presenting bias-weighted gaze landscapes, and show that there is a link between the likelihood of a saccade under the flow model, and the salience of the following fixation. We also present a minor improvement to our central bias model (based on using a multivariate truncated Gaussian), and investigate the leftwards and coarse-to-fine biases in scene viewing.

[1]  E. Reichle,et al.  Coarse-to-fine eye movement behavior during visual search , 2014, Psychonomic bulletin & review.

[2]  Tom Troscianko,et al.  Regional effects of clutter on human target detection performance. , 2013, Journal of vision.

[3]  P. Viviani,et al.  The curvature of oblique saccades , 1977, Vision Research.

[4]  J. Antes.  The time course of picture viewing. , 1974, Journal of experimental psychology.

[5]  J. V. Gisbergen,et al.  A parametric analysis of human saccades in different experimental paradigms , 1987, Vision Research.

[6]  K. Heilman,et al.  Pseudoneglect: Effects of hemispace on a tactile line bisection task , 1980, Neuropsychologia.

[7]  Frédo Durand,et al.  Learning to predict where humans look , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[8]  Ali Borji,et al.  State-of-the-Art in Visual Attention Modeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Laurence T. Maloney,et al.  Human Visual Search Does Not Maximize the Post-Saccadic Probability of Identifying Targets , 2012, PLoS Comput. Biol..

[10]  Lester C. Loschky,et al.  What Would Jaws Do? The Tyranny of Film and the Relationship between Gaze and Higher-Level Narrative Film Comprehension , 2015, PloS one.

[11]  M. Hayhoe,et al.  In what ways do eye movements contribute to everyday activities? , 2001, Vision Research.

[12]  Michael D. Dodd,et al.  Novelty Is Not Always the Best Policy , 2009, Psychological science.

[13]  Benjamin W. Tatler,et al.  Systematic tendencies in scene viewing , 2008 .

[14]  A. Kingstone,et al.  Get real! Resolving the debate about equivalent social stimuli , 2009 .

[15]  Amelia R Hunt,et al.  Human search for a target on a textured background is consistent with a stochastic model. , 2016, Journal of vision.

[16]  B. Tatler,et al.  Deriving an appropriate baseline for describing fixation behaviour , 2014, Vision Research.

[17]  Yifan Peng,et al.  Studying Relationships between Human Gaze, Description, and Computer Vision , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  A. Pouget,et al.  Behavior and neural basis of near-optimal visual search , 2011, Nature Neuroscience.

[19]  Ali Borji,et al.  CAT2000: A Large Scale Fixation Dataset for Boosting Saliency Research , 2015, ArXiv.

[20]  Qi Zhao,et al.  Saliency in Crowd , 2014, ECCV.

[21]  G. Zelinsky.  Using Eye Saccades to Assess the Selectivity of Search Movements , 1996, Vision Research.

[22]  A. Nuthmann,et al.  Time course of pseudoneglect in scene viewing , 2014, Cortex.

[23]  Amelia R Hunt,et al.  Failure of Intuition When Choosing Whether to Invest in a Single Goal or Split Resources Between Two Goals , 2016, Psychological science.

[24]  Amelia R Hunt,et al.  Inhibition of return across eye and object movements: the role of prediction. , 2013, Journal of experimental psychology. Human perception and performance.

[25]  Tom Foulsham,et al.  Asymmetries in the direction of saccades during perception of scenes and fractals: Effects of image type and image features , 2010, Vision Research.

[26]  N. Badler,et al.  Eyes Alive Eyes Alive Eyes Alive Figure 1: Sample Images of an Animated Face with Eye Movements , 2022 .

[27]  Moreno I. Coco,et al.  The impact of attentional, linguistic, and visual features during object naming , 2013, Front. Psychol..

[28]  J. Fuller,et al.  Eye position and target amplitude effects on human visual saccadic latencies , 1996, Experimental Brain Research.

[29]  Behavioural asymmetries on the greyscales task: The influence of native reading direction , 2014, Culture and brain.

[30]  Kenneth C. Scott-Brown,et al.  Behavioral biases when viewing multiplexed scenes: scene structure and frames of reference for inspection , 2013, Front. Psychol..

[31]  R. Klein,et al.  Inhibition of Return is a Foraging Facilitator in Visual Search , 1999 .

[32]  Tom Foulsham,et al.  Turning the world around: Patterns in saccade direction vary with picture orientation , 2008, Vision Research.

[33]  Matthew D. Hilchey,et al.  Driving forces in free visual search: An ethology , 2014, Attention, perception & psychophysics.

[34]  Norman I. Badler,et al.  Eyes alive , 2002, ACM Trans. Graph..

[35]  J. Helmert,et al.  Visual Fixation Durations and Saccade Amplitudes: Shifting Relationship in a Variety of Conditions , 2008 .

[36]  R. Klein,et al.  Aftereffects of Saccades Explored in a Dynamic Neural Field Model of the Superior Colliculus , 2011 .

[37]  Jeff B. Pelz,et al.  High-level aspects of oculomotor control during viewing of natural-task images , 2003, IS&T/SPIE Electronic Imaging.

[38]  P. Wurtz,et al.  Size Matters: Saccades during Scene Perception , 2007, Perception.

[39]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[40]  Michael D. Dodd,et al.  Examining the influence of task set on eye movements and fixations. , 2011, Journal of vision.

[41]  Iain D. Gilchrist,et al.  Visual correlates of fixation selection: effects of scale and time , 2005, Vision Research.

[42]  A. Yagi,et al.  Inhibitory tagging in visual search can be found if search stimuli remain visible , 2000, Perception & psychophysics.

[43]  C. Erkelens,et al.  Coarse-to-fine eye movement strategy in visual search , 2007, Vision Research.

[44]  Nicolas Riche,et al.  RARE2012: A multi-scale rarity-based saliency detection with its comparative statistical analysis , 2013, Signal Process. Image Commun..

[45]  Michelle R. Greene,et al.  Reconsidering Yarbus: A failure to predict observers’ task from eye movement patterns , 2012, Vision Research.

[46]  Víctor Leborán,et al.  On the relationship between optical variability, visual saliency, and eye fixations: a computational approach. , 2012, Journal of vision.

[47]  Antonio Torralba,et al.  Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. , 2006, Psychological review.

[48]  Krista A. Ehinger,et al.  Modelling search for people in 900 scenes: A combined source model of eye guidance , 2009 .

[49]  Shenmin Zhang,et al.  What do saliency models predict? , 2014, Journal of vision.

[50]  A. Hunt,et al.  Human visual search behaviour is far from ideal , 2017, Proceedings of the Royal Society B: Biological Sciences.

[51]  D. Mackay,et al.  The psychology of seeing. , 1973, Transactions of the ophthalmological societies of the United Kingdom.

[52]  I. Gilchrist,et al.  Evidence for a systematic component within scan paths in visual search , 2006 .

[53]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[54]  B. Tatler,et al.  The prominence of behavioural biases in eye guidance , 2009 .

[55]  Frédo Durand,et al.  A Benchmark of Computational Models of Saliency to Predict Human Fixations , 2012 .

[56]  K. Hoffmann,et al.  Optokinetic eye movements elicited by radial optic flow in the macaque monkey. , 1998, Journal of neurophysiology.

[57]  O. Meur,et al.  Introducing context-dependent and spatially-variant viewing biases in saccadic models , 2016, Vision Research.

[58]  L. Itti,et al.  Quantifying center bias of observers in free viewing of dynamic natural scenes. , 2009, Journal of vision.

[59]  A. Hunt,et al.  Failure of intuition when presented with a choice between investing in a single goal or splitting resources between two goals , 2015 .

[60]  Benjamin W Tatler,et al.  The central fixation bias in scene viewing: selecting an optimal viewing position independently of motor biases and image feature distributions. , 2007, Journal of vision.

[61]  P. Perona,et al.  Objects predict fixations better than early saliency. , 2008, Journal of vision.

[62]  B. Velichkovsky,et al.  Time course of information processing during scene perception: The relationship between saccade amplitude and fixation duration , 2005 .

[63]  Boris M. Velichkovsky,et al.  Towards an express-diagnostics for level of processing and hazard perception , 2002 .

[64]  Christopher A. Dickinson,et al.  Spatial asymmetries in viewing and remembering scenes: Consequences of an attentional bias? , 2009, Attention, perception & psychophysics.

[65]  D. Ballard,et al.  Eye guidance in natural vision: reinterpreting salience. , 2011, Journal of vision.

[66]  Thierry Baccino,et al.  New insights into ambient and focal visual fixations using an automatic classification algorithm , 2011, i-Perception.

[67]  R. C. Langford.  How People Look at Pictures, A Study of the Psychology of Perception in Art. , 1936 .

[68]  P. König,et al.  Spatial biases in viewing behavior. , 2014, Journal of vision.

[69]  Alasdair D F Clarke,et al.  Modeling visual search on a rough surface. , 2009, Journal of vision.

[70]  Jiri Najemnik,et al.  Eye movement statistics in humans are consistent with an optimal search strategy. , 2008, Journal of vision.

[71]  Michael L. Mack,et al.  VISUAL SALIENCY DOES NOT ACCOUNT FOR EYE MOVEMENTS DURING VISUAL SEARCH IN REAL-WORLD SCENES , 2007 .

[72]  Derrick J. Parkhurst,et al.  Modeling the role of salience in the allocation of overt visual attention , 2002, Vision Research.

[73]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .