Scene content selected by active vision.

The primate visual system actively selects visual information from the environment for detailed processing through mechanisms of visual attention and saccadic eye movements. This study examines the statistical properties of the scene content selected by active vision. Eye movements were recorded while participants free-viewed digitized images of natural and artificial scenes. Fixation locations were determined for each image and image patches were extracted around the observed fixation locations. Measures of local contrast, local spatial correlation and spatial frequency content were calculated on the extracted image patches. Replicating previous results, local contrast was found to be greater at the points of fixation when compared to either the contrast for image patches extracted at random locations or at the observed fixation locations using an image-shuffled database. Contrary to some results and in agreement with other results in the literature, a significant decorrelation of image intensity is observed between the locations of fixation and other neighboring locations. A discussion and analysis of methodological techniques is given that provides an explanation for the discrepancy in results. The results of our analyses indicate that both the local contrast and correlation at the points of fixation are a function of image type and, furthermore, that the magnitude of these effects depend on the levels of contrast and correlation present overall in the images. Finally, the largest effect sizes in local contrast and correlation are found at distances of approximately 1 deg of visual angle, which agrees well with measures of optimal spatial scale selectivity in the visual periphery where visual information for potential saccade targets is processed.

[1]  R. C. Langford.  How People Look at Pictures, A Study of the Psychology of Perception in Art. , 1936 .

[2]  D. Robinson.  The mechanics of human saccadic eye movement , 1964, The Journal of physiology.

[3]  N. Mackworth,et al.  The gaze selects informative details within pictures , 1967 .

[4]  A. L. I︠A︡rbus.  Eye Movements and Vision , 1967 .

[5]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[6]  D. Noton,et al.  Eye movements and visual perception. , 1971, Scientific American.

[7]  L. Stark,et al.  Scanpaths in Eye Movements during Pattern Perception , 1971, Science.

[8]  J. Antes.  The time course of picture viewing. , 1974, Journal of experimental psychology.

[9]  N. Mackworth,et al.  Cognitive determinants of fixation location during picture viewing. , 1978, Journal of experimental psychology. Human perception and performance.

[10]  S. Yantis,et al.  Abrupt visual onsets and selective attention: evidence from visual search. , 1984, Journal of experimental psychology. Human perception and performance.

[11]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[12]  P. de Graef,et al.  Perceptual effects of scene context on object identification , 1990, Psychological research.

[13]  Behavior research methods, instruments, & computers , 1991 .

[14]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[15]  William Bialek,et al.  Statistics of Natural Images: Scaling in the Woods , 1993, NIPS.

[16]  Dave M. Stampe,et al.  Heuristic filtering and reliable calibration methods for video-based pupil-tracking systems , 1993 .

[17]  D. Burr,et al.  Selective suppression of the magnocellular visual pathway during saccadic eye movements , 1994, Nature.

[18]  David N. Lee,et al.  Where we look when we steer , 1994, Nature.

[19]  Christof Koch,et al.  Control of Selective Visual Attention: Modeling the Where Pathway , 1995, NIPS.

[20]  D. S. Wooding,et al.  Automatic control of saccadic eye movements made in visual inspection of briefly presented 2-D images. , 1995, Spatial vision.

[21]  D. S. Wooding,et al.  The relationship between the locations of spatial features and those of fixations made during visual examination of briefly presented images. , 1996, Spatial vision.

[22]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[23]  D. S. Wooding,et al.  Fixation sequences made during visual examination of briefly presented 2D images. , 1997, Spatial vision.

[24]  Andrew Hollingworth,et al.  Eye Movements During Scene Viewing: An Overview , 1998 .

[25]  P Reinagel,et al.  Natural scene statistics at the centre of gaze. , 1999, Network.

[26]  J. Henderson,et al.  The effects of semantic consistency on eye movements during complex scene viewing , 1999 .

[27]  G. Hauske,et al.  Object and scene analysis by saccadic eye-movements: an investigation with higher-order statistics. , 2000, Spatial vision.

[28]  J L Gallant,et al.  Sparse coding and decorrelation in primary visual cortex during natural vision. , 2000, Science.

[29]  Derrick J. Parkhurst,et al.  Modeling the role of salience in the allocation of overt visual attention , 2002, Vision Research.

[30]  J. Rovamo,et al.  Visual resolution, contrast sensitivity, and the cortical magnification factor , 2004, Experimental Brain Research.