Human Visual Search Does Not Maximize the Post-Saccadic Probability of Identifying Targets

Researchers have conjectured that eye movements during visual search are selected to minimize the number of saccades. The optimal Bayesian eye movement strategy minimizing saccades does not simply direct the eye to whichever location is judged most likely to contain the target but makes use of the entire retina as an information gathering device during each fixation. Here we show that human observers do not minimize the expected number of saccades in planning saccades in a simple visual search task composed of three tokens. In this task, the optimal eye movement strategy varied, depending on the spacing between tokens (in the first experiment) or the size of tokens (in the second experiment), and changed abruptly once the separation or size surpassed a critical value. None of our observers changed strategy as a function of separation or size. Human performance fell far short of ideal, both qualitatively and quantitatively.

[1]  Melchi M. Michel,et al.  Michel Gaze Contingent Displays : Analysis of Saccadic Plasticity in Visual Search , 2009 .

[2]  Preeti Verghese,et al.  The psychophysics of visual search , 2000, Vision Research.

[3]  Eric Castet,et al.  Dynamics of attentional deployment during saccadic programming. , 2006, Journal of vision.

[4]  C. Moss,et al.  Flying in silence: Echolocating bats cease vocalizing to avoid sonar jamming , 2008, Proceedings of the National Academy of Sciences.

[5]  F. Ottes,et al.  Latency dependence of colour-based target vs nontarget discrimination by the saccadic system , 1985, Vision Research.

[6]  Eileen Kowler,et al.  The role of location probability in the programming of saccades: Implications for “center-of-gravity” tendencies , 1989, Vision Research.

[7]  H. Deubel,et al.  Saccade target selection and object recognition: Evidence for a common attentional mechanism , 1996, Vision Research.

[8]  Wilson S. Geisler,et al.  Optimal eye movement strategies in visual search , 2005, Nature.

[9]  Asha Iyer,et al.  Components of bottom-up gaze allocation in natural images , 2005, Vision Research.

[10]  Derrick J. Parkhurst,et al.  Modeling the role of salience in the allocation of overt visual attention , 2002, Vision Research.

[11]  R. Selten,et al.  Bounded rationality: The adaptive toolbox , 2000 .

[12]  M. Eckstein,et al.  Quantifying the Performance Limits of Human Saccadic Targeting during Visual Search , 2001, Perception.

[13]  Mary M Hayhoe,et al.  Visual memory and motor planning in a natural task. , 2003, Journal of vision.

[14]  Susan J. Lederman,et al.  Extracting object properties through haptic exploration. , 1993, Acta psychologica.

[15]  L. Hogben.  Introduction to the Theory of Statistics , 1951 .

[16]  Rajesh P. N. Rao,et al.  PSYCHOLOGICAL SCIENCE Research Article EYE MOVEMENTS REVEAL THE SPATIOTEMPORAL DYNAMICS OE VISUAL SEARCH , 2022 .

[17]  Iain D. Gilchrist,et al.  Visual correlates of fixation selection: effects of scale and time , 2005, Vision Research.

[18]  L. Maloney,et al.  Bayesian decision theory as a model of human visual perception: Testing Bayesian transfer , 2009, Visual Neuroscience.

[19]  J. Henderson.  Human gaze control during real-world scene perception , 2003, Trends in Cognitive Sciences.

[20]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[21]  B. Tatler,et al.  The prominence of behavioural biases in eye guidance , 2009 .

[22]  Benjamin W Tatler,et al.  The central fixation bias in scene viewing: selecting an optimal viewing position independently of motor biases and image feature distributions. , 2007, Journal of vision.

[23]  N. L. Johnson,et al.  Continuous Univariate Distributions. , 1995 .

[24]  Robin L. Hill,et al.  Eye movements : a window on mind and brain , 2007 .

[25]  H. Simon.  Bounded Rationality and Organizational Learning , 1991 .

[26]  D. Ballard,et al.  Eye movements in natural behavior , 2005, Trends in Cognitive Sciences.

[27]  R. Klein,et al.  Searching for inhibition of return in visual search: A review , 2010, Vision Research.

[28]  B. Cole,et al.  Imperfectly optimal animals , 1981, Behavioral Ecology and Sociobiology.

[29]  A. L. I︠A︡rbus.  Eye Movements and Vision , 1967 .

[30]  Preeti Verghese,et al.  Where to look next? Eye movements reduce local uncertainty. , 2007, Journal of vision.

[31]  J. Wolfowitz,et al.  An Introduction to the Theory of Statistics , 1951, Nature.

[32]  Michael L. Mack,et al.  VISUAL SALIENCY DOES NOT ACCOUNT FOR EYE MOVEMENTS DURING VISUAL SEARCH IN REAL-WORLD SCENES , 2007 .

[33]  W. Geisler.  Sequential ideal-observer analysis of visual discriminations. , 1989, Psychological review.

[34]  Marcus Nyström,et al.  Semantic override of low-level features in image viewing - both initially and overall , 2008 .

[35]  Wilson S. Geisler,et al.  Simple summation rule for optimal fixation selection in visual search , 2009, Vision Research.

[36]  Debasish Biswas,et al.  Visualization of unsteady viscous flow around turbine blade , 2008, J. Vis..

[37]  Mitra J. Hartmann,et al.  c ○ 2001 Kluwer Academic Publishers. Manufactured in The Netherlands. Active Sensing Capabilities of the Rat Whisker System , 2022 .

[38]  Franklin A. Graybill,et al.  Introduction to the Theory of Statistics, 3rd ed. , 1974 .

[39]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[40]  P. Perona,et al.  Objects predict fixations better than early saliency. , 2008, Journal of vision.

[41]  D. Ballard,et al.  Eye guidance in natural vision: reinterpreting salience. , 2011, Journal of vision.

[42]  B. Dosher,et al.  The role of attention in the programming of saccades , 1995, Vision Research.

[43]  M. Land,et al.  The Roles of Vision and Eye Movements in the Control of Activities of Daily Living , 1998, Perception.

[44]  Raymond Klein,et al.  Inhibition of return , 2000, Trends in Cognitive Sciences.