Modelling the role of task in the control of gaze

Gaze changes and the resultant fixations that orchestrate the sequential acquisition of information from the visual environment are the central feature of primate vision. How are we to understand their function? For the most part, theories of fixation targets have been image based: The hypothesis being that the eye is drawn to places in the scene that contain discontinuities in image features such as motion, colour, and texture. But are these features the cause of the fixations, or merely the result of fixations that have been planned to serve some visual function? This paper examines the issue and reviews evidence from various image-based and task-based sources. Our conclusion is that the evidence is overwhelmingly in favour of fixation control being essentially task based.

[1]  B. Erdmann,et al.  Psychologische Untersuchungen über das Lesen: Auf experimenteller Grundlage , 1899 .

[2]  Nancy Millette,et al.  How People Look at Pictures , 1935 .

[3]  M. Tinker.  How People Look at Pictures. , 1936 .

[4]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[5]  A. L. I︠A︡rbus.  Eye Movements and Vision , 1967 .

[6]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[7]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[8]  N. Mai,et al.  Selective disturbance of movement vision after bilateral brain damage. , 1983, Brain : a journal of neurology.

[9]  S. Ullman.  Visual routines , 1984, Cognition.

[10]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[11]  J. Wolfe,et al.  Guided Search 2.0 A revised model of visual search , 1994, Psychonomic bulletin & review.

[12]  David P. Miller,et al.  Experiences with an architecture for intelligent, reactive agents , 1995, J. Exp. Theor. Artif. Intell..

[13]  D. Ballard,et al.  Memory Representations in Natural Tasks , 1995, Journal of Cognitive Neuroscience.

[14]  Rajesh P. N. Rao,et al.  Embodiment is the foundation, not a level , 1996, Behavioral and Brain Sciences.

[15]  D. Ballard,et al.  Task constraints in visual working memory , 1997, Vision Research.

[16]  Pieter R. Roelfsema,et al.  Object-based attention in the primary visual cortex of the macaque monkey , 1998, Nature.

[17]  C. Gilbert,et al.  Attention Modulates Contextual Influences in the Primary Visual Cortex of Alert Monkeys , 1999, Neuron.

[18]  Michael F. Land,et al.  From eye movements to actions: how batsmen hit the ball , 2000, Nature Neuroscience.

[19]  M. Hayhoe,et al.  What controls attention in natural environments? , 2001, Vision Research.

[20]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[21]  Refractor.  Vision , 2000, The Lancet.

[22]  Rajesh P. N. Rao,et al.  Eye movements in iconic visual search , 2002, Vision Research.

[23]  J. Hoffman,et al.  Spatial breakdown in spatial construction: Evidence from eye fixations in children with Williams syndrome , 2003, Cognitive Psychology.

[24]  D. Ballard,et al.  What you see is what you need. , 2003, Journal of vision.

[25]  Mary M Hayhoe,et al.  Visual memory and motor planning in a natural task. , 2003, Journal of vision.

[26]  Pieter R Roelfsema,et al.  Subtask sequencing in the primary visual cortex , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[27]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[28]  Miguel P Eckstein,et al.  The time course of visual information accrual guiding eye movement decisions. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[29]  L. Itti,et al.  Modeling the influence of task on attention , 2005, Vision Research.

[30]  Jason A. Droll,et al.  Task demands control acquisition and storage of visual information. , 2005, Journal of experimental psychology. Human perception and performance.

[31]  Mary M Hayhoe,et al.  Spatial memory and saccadic targeting in a natural task. , 2005, Journal of vision.

[32]  Dana H. Ballard,et al.  Behavior Recognition in Human Object Interactions with a Task Model , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[33]  A. Bovik,et al.  Visual search in noise: revealing the influence of structural cues by gaze-contingent classification image analysis. , 2006, Journal of vision.

[34]  Mary Hayhoe,et al.  Control of attention and gaze in complex environments. , 2006, Journal of vision.

[35]  Antonio Torralba,et al.  Building the gist of a scene: the role of global image features in recognition. , 2006, Progress in brain research.

[36]  Dana H. Ballard,et al.  Modeling embodied visual behaviors , 2007, TAP.

[37]  J. Henderson.  Regarding Scenes , 2007 .

[38]  Mary M Hayhoe,et al.  Task and context determine where you look. , 2016, Journal of vision.

[39]  Benjamin W Tatler,et al.  The central fixation bias in scene viewing: selecting an optimal viewing position independently of motor biases and image feature distributions. , 2007, Journal of vision.

[40]  Mary M Hayhoe,et al.  Trade-offs between gaze and working memory use. , 2007, Journal of experimental psychology. Human perception and performance.

[41]  W. Geisler.  Visual perception and the statistical properties of natural scenes. , 2008, Annual review of psychology.

[42]  Marcus Nyström,et al.  Semantic override of low-level features in image viewing - both initially and overall , 2008 .

[43]  F. Hamker,et al.  About the influence of post-saccadic mechanisms for visual stability on peri-saccadic compression of object location. , 2008, Journal of vision.

[44]  C. Koch,et al.  Task-demands can immediately reverse the effects of sensory-driven saliency in complex visual stimuli. , 2008, Journal of vision.

[45]  T. Foulsham,et al.  What can saliency models predict about eye movements? Spatial and sequential aspects of fixations during encoding and recognition. , 2008, Journal of vision.

[46]  Pierre Baldi,et al.  Bayesian surprise attracts human attention , 2005, Vision Research.

[47]  Mary Hayhoe,et al.  Pro-active gaze control in squash , 2010 .