Image statistics at the point of gaze during human navigation

Theories of efficient sensory processing have considered the regularities of image properties due to the structure of the environment in order to explain properties of neuronal representations of the visual world. The regularities imposed on the input to the visual system due to the regularities of the active selection process mediated by the voluntary movements of the eyes have been considered to a much lesser degree. This is surprising, given that the active nature of vision is well established. The present article investigates statistics of image features at the center of gaze of human subjects navigating through a virtual environment and avoiding and approaching different objects. The analysis shows that contrast can be significantly higher or lower at fixation location compared to random locations, depending on whether subjects avoid or approach targets. Similarly, significant differences in the distribution of responses of model simple and complex cells between horizontal and vertical orientations are found over timescales of tens of seconds. By clustering the model simple cell responses, it is established that gaze was directed toward three distinct features of intermediate complexity the vast majority of time. Thus, this study demonstrates and quantifies how the visuomotor tasks of approaching and avoiding objects during navigation determine feature statistics of the input to the visual system through the combined influence on body and eye movements.

[1]  Robin L. Hill,et al.  Eye movements : a window on mind and brain , 2007 .

[2]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[3]  A. Borst Seeing smells: imaging olfactory learning in bees , 1999, Nature Neuroscience.

[4]  Robert A. Frazor,et al.  Local luminance and contrast in natural images , 2006, Vision Research.

[5]  Derrick J. Parkhurst,et al.  Scene content selected by active vision. , 2003, Spatial vision.

[6]  P Reinagel,et al.  Natural scene statistics at the centre of gaze. , 1999, Network.

[7]  Dana H. Ballard,et al.  Animate Vision , 1991, Artif. Intell..

[8]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[9]  Mary M Hayhoe,et al.  Visual memory and motor planning in a natural task. , 2003, Journal of vision.

[10]  A. L. I︠A︡rbus Eye Movements and Vision , 1967 .

[11]  William Bialek,et al.  Statistics of Natural Images: Scaling in the Woods , 1993, NIPS.

[12]  L. Itti Author address: , 1999 .

[13]  J. Gallant,et al.  Natural Stimulus Statistics Alter the Receptive Field Structure of V1 Neurons , 2004, The Journal of Neuroscience.

[14]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[15]  Petre Stoica,et al.  Introduction to spectral analysis , 1997 .

[16]  J. Henderson,et al.  High-level scene perception. , 1999, Annual review of psychology.

[17]  D. S. Wooding,et al.  The relationship between the locations of spatial features and those of fixations made during visual examination of briefly presented images. , 1996, Spatial vision.

[18]  Rajesh P. N. Rao,et al.  Embodiment is the foundation, not a level , 1996, Behavioral and Brain Sciences.

[19]  Hermann Wagner,et al.  Visual depth encoding in populations of neurons with localized receptive fields , 2002, Biological Cybernetics.

[20]  D. Ballard,et al.  Memory Representations in Natural Tasks , 1995, Journal of Cognitive Neuroscience.

[21]  H. Basford,et al.  Optimal eye movement strategies in visual search , 2005 .

[22]  M. Hayhoe,et al.  In what ways do eye movements contribute to everyday activities? , 2001, Vision Research.

[23]  R. Johansson,et al.  Eye–Hand Coordination in Object Manipulation , 2001, The Journal of Neuroscience.

[24]  Michael L. Mack,et al.  VISUAL SALIENCY DOES NOT ACCOUNT FOR EYE MOVEMENTS DURING VISUAL SEARCH IN REAL-WORLD SCENES , 2007 .

[25]  M. Webster,et al.  Visual adaptation: Neural, psychological and computational aspects , 2007, Vision Research.

[26]  F. Attneave Some informational aspects of visual perception. , 1954, Psychological review.

[27]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[28]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[29]  David N. Lee,et al.  Where we look when we steer , 1994, Nature.

[30]  D. Tolhurst,et al.  Calculating the contrasts that retinal ganglion cells and LGN neurones encounter in natural scenes , 2000, Vision Research.

[31]  A. Noë,et al.  A sensorimotor account of vision and visual consciousness. , 2001, The Behavioral and brain sciences.

[32]  S. Laughlin A Simple Coding Procedure Enhances a Neuron's Information Capacity , 1981, Zeitschrift fur Naturforschung. Section C, Biosciences.

[33]  M. A. Repucci,et al.  Spatial Structure and Symmetry of Simple-Cell Receptive Fields in Macaque Primary Visual Cortex , 2002 .

[34]  D. Ruderman,et al.  Statistics of cone responses to natural images: implications for visual coding , 1998 .

[35]  Edward H. Adelson,et al.  The Design and Use of Steerable Filters , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[37]  Eero P. Simoncelli,et al.  Natural signal statistics and sensory gain control , 2001, Nature Neuroscience.

[38]  L. Itti,et al.  Search Goal Tunes Visual Features Optimally , 2007, Neuron.

[39]  Bruno A. Olshausen,et al.  Book Review , 2003, Journal of Cognitive Neuroscience.

[40]  J. H. Hateren,et al.  Independent component filters of natural images compared with simple cells in primary visual cortex , 1998 .

[41]  J. Findlay,et al.  Active Vision: The Psychology of Looking and Seeing , 2003 .

[42]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[43]  Song-Chun Zhu,et al.  Statistical Modeling and Conceptualization of Visual Patterns , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[44]  Hanspeter A. Mallot Computational Vision: Information Processing in Perception and Visual Behavior , 2000 .

[45]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[46]  D. Ballard,et al.  Eye movements in natural behavior , 2005, Trends in Cognitive Sciences.

[47]  Michel Vidal-Naquet,et al.  Visual features of intermediate complexity and their use in classification , 2002, Nature Neuroscience.

[48]  N. Grzywacz,et al.  Power spectra and distribution of contrasts of natural images from different habitats , 2003, Vision Research.

[49]  J. Daugman Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[50]  Shimon Ullman,et al.  Mutual information of image fragments predicts categorization in humans: Electrophysiological and behavioral evidence , 2007, Vision Research.

[51]  L. Abbott,et al.  Responses of neurons in primary and inferior temporal visual cortices to natural scenes , 1997, Proceedings of the Royal Society of London. Series B: Biological Sciences.