Fixational eye movements, natural image statistics, and fine spatial vision

Perception and motor control are often regarded as two separate branches of neuroscience. Like most species, however, humans are not passively exposed to the incoming flow of sensory data, but actively seek useful information. By shaping input signals in ways that simplify perceptual tasks, behavior might play an important role in establishing efficient sensory representations in the brain. Under natural viewing conditions, the main source of motion of the stimulus on the retina is not the scene but our own behavior. The retinal image is never still, even during visual fixation, when small eye movements combine with movements of the head and body to continually perturb the location of gaze. This article examines the impact of the fixational motion of the retinal image on the statistics of visual input and the neural encoding of visual information. Building upon recent theoretical and experimental results, it is argued that an unstable fixation constitutes an efficient strategy for acquiring information from natural scenes. According to this theory, the fluctuations of luminance caused by the incessant motion of the eye equalize the power present at different spatial frequencies in the spatiotemporal stimulus on the retina. This phenomenon yields compact neural representations, emphasizes fine spatial detail, and might enable a temporal multiplexing of visual information from the retina to the cortex. This theory posits motor contributions to early visual representations and suggests that perception and behavior are more intimately tied than commonly thought.

[1]  D. Robinson,et al.  Motion of the eye immediately after a saccade , 2004, Experimental Brain Research.

[2]  F. W. Weymouth,et al.  Visual perception and the retinal mosaic. II. The influence of eye-movements on the displacement threshold. , 1925 .

[3]  J. H. van Hateren,et al.  A theory of maximizing sensory information , 2004, Biological Cybernetics.

[4]  David J. Field,et al.  What Is the Goal of Sensory Coding? , 1994, Neural Computation.

[5]  Michele Rucci,et al.  Decorrelation of neural activity during fixational instability: Possible implications for the refinement of V1 receptive fields , 2004, Visual Neuroscience.

[6]  E. Kaplan,et al.  The receptive field of the primate P retinal ganglion cell, II: Nonlinear dynamics , 1997, Visual Neuroscience.

[7]  Patrick Cavanagh,et al.  A jitter after-effect reveals motion-based stabilization of vision , 1998, Nature.

[8]  R C Reid,et al.  Efficient Coding of Natural Scenes in the Lateral Geniculate Nucleus: Experimental Test of a Computational Theory , 1996, The Journal of Neuroscience.

[9]  Stephen A. Baccus,et al.  Segregation of object and background motion in the retina , 2003, Nature.

[10]  R. Reid,et al.  Synchronous activity in the visual system. , 1999, Annual review of physiology.

[11]  R. Steinman,et al.  Voluntary Control of Microsaccades during Maintained Monocular Fixation , 1967, Science.

[12]  Florentin Wörgötter,et al.  Eye Micro-movements Improve Stimulus Detection Beyond the Nyquist Limit in the Peripheral Retina , 2003, NIPS.

[13]  Nicole C. Rust,et al.  Do We Know What the Early Visual System Does? , 2005, The Journal of Neuroscience.

[14]  Michele Rucci,et al.  Fixational instability and natural image statistics: Implications for early visual representations , 2005, Network.

[15]  H. Collewijn,et al.  Binocular retinal image motion during active head rotation , 1980, Vision Research.

[16]  Joseph J. Atick,et al.  Towards a Theory of Early Visual Processing , 1990, Neural Computation.

[17]  Michael N. Shadlen,et al.  Synchrony Unbound A Critical Evaluation of the Temporal Binding Hypothesis , 1999, Neuron.

[18]  D. Snodderly,et al.  Studying striate cortex neurons in behaving monkeys: Benefits of image stabilization , 1987, Vision Research.

[19]  Xoana G. Troncoso,et al.  Microsaccades Counteract Visual Fading during Fixation , 2005, Neuron.

[20]  D H Kelly,et al.  Motion and vision. I. Stabilized images of stationary gratings. , 1979, Journal of the Optical Society of America.

[21]  W Singer,et al.  Visual feature integration and the temporal correlation hypothesis. , 1995, Annual review of neuroscience.

[22]  Martina Poletti,et al.  Oculomotor synchronization of visual responses in modeled populations of retinal ganglion cells. , 2008, Journal of vision.

[23]  R. Pritchard Stabilized images on the retina. , 1961, Scientific American.

[24]  A. L. I︠A︡rbus Eye Movements and Vision , 1967 .

[25]  J R Lishman,et al.  Temporal Integration of Spatially Filtered Visual Images , 1992, Perception.

[26]  H. Sompolinsky,et al.  A Neural Computation for Visual Acuity in the Presence of Eye Movements , 2007, PLoS biology.

[27]  P. Lennie,et al.  Spatial and temporal contrast sensitivities of neurones in lateral geniculate nucleus of macaque. , 1984, The Journal of physiology.

[28]  Michele Rucci,et al.  Effects of ISI and flash duration on the identification of briefly flashed stimuli. , 2005, Spatial vision.

[29]  F. Best,et al.  Ueber die Grenzen der Sehschärfe , 1901 .

[30]  M. Rucci,et al.  Contributions of fixational eye movements to the discrimination of briefly presented stimuli. , 2003, Journal of vision.

[31]  R. W. Ditchburn,et al.  Vision with controlled movements of the retinal image , 1959, The Journal of physiology.

[32]  D. Navon Forest before trees: The precedence of global features in visual perception , 1977, Cognitive Psychology.

[33]  L. Riggs,et al.  Involuntary motions of the eye during monocular fixation. , 1950, Journal of experimental psychology.

[34]  Nicholas Costen,et al.  One extreme or the other or perhaps the golden mean? Issues of spatial resolution in face processing , 1999 .

[35]  C. J. Erkelens,et al.  PII: S0042-6989(97)00287-3 , 2003 .

[36]  A. Oliva,et al.  From Blobs to Boundary Edges: Evidence for Time- and Spatial-Scale-Dependent Scene Recognition , 1994 .

[37]  E. Kaplan,et al.  The dynamics of primate M retinal ganglion cells , 1999, Visual Neuroscience.

[38]  B. Jacobs,et al.  Behavioral correlates of dopaminergic unit activity in freely moving cats , 1983, Brain Research.

[39]  E. Kaplan,et al.  The receptive field of the primate P retinal ganglion cell, I: Linear dynamics , 1997, Visual Neuroscience.

[40]  L. Riggs,et al.  The disappearance of steadily fixated visual test objects. , 1953, Journal of the Optical Society of America.

[41]  Ehud Ahissar,et al.  Figuring Space by Time , 2001, Neuron.

[42]  L. Arend Spatial differential and integral operations in human vision: implications of stabilized retinal image fading. , 1973, Psychological review.

[43]  S. Laughlin,et al.  Predictive coding: a fresh view of inhibition in the retina , 1982, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[44]  Steinman Rm,et al.  The role of eye movement in the detection of contrast and spatial detail. , 1990 .

[45]  J J Koenderink,et al.  Contrast enhancement and the negative afterimage. , 1972, Journal of the Optical Society of America.

[46]  D. Coppola,et al.  Idiosyncratic characteristics of saccadic eye movements when viewing different visual environments , 1999, Vision Research.

[47]  R. Reid,et al.  Precisely correlated firing in cells of the lateral geniculate nucleus , 1996, Nature.

[48]  R. W. DITCHBURN,et al.  Vision with a Stabilized Retinal Image , 1952, Nature.

[49]  A. A. Skavenski,et al.  Quality of retinal image stabilization during small natural and artificial body rotations in man , 1979, Vision Research.

[50]  O. Pompeiano,et al.  Neurobiology of the locus coeruleus , 1991 .

[51]  R. Steinman,et al.  Small saccades serve no useful purpose: Reply to a letter by R. W. Ditchburn , 1980, Vision Research.

[52]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[53]  L. Croner,et al.  Receptive fields of P and M ganglion cells across the primate retina , 1995, Vision Research.

[54]  M. Rucci,et al.  A model of the dynamics of retinal activity during natural visual fixation , 2007, Visual Neuroscience.

[55]  R. Steinman,et al.  The role of eye movement in the detection of contrast and spatial detail. , 1990, Reviews of oculomotor research.

[56]  U. Tulunay-Keesey,et al.  Fading of stabilized retinal images. , 1982, Journal of the Optical Society of America.

[57]  Joseph J. Atick,et al.  What Does the Retina Know about Natural Scenes? , 1992, Neural Computation.

[58]  L. P. O'Keefe,et al.  The influence of fixational eye movements on the response of neurons in area MT of the macaque , 1998, Visual Neuroscience.

[59]  Wolf Singer,et al.  Time as coding space? , 1999, Current Opinion in Neurobiology.

[60]  Robert Michael Jones,et al.  The effect of micromovements of the eye and exposure duration on contrast sensitivity , 1976, Vision Research.

[61]  Markus Bongard,et al.  Retinal ganglion cell synchronization by fixational eye movements improves feature estimation , 2002, Nature Neuroscience.

[62]  Antonino Casile,et al.  A Theoretical Analysis of the Influence of Fixational Instability on the Development of Thalamocortical Connectivity , 2006, Neural Computation.

[63]  F. Attneave Some informational aspects of visual perception. , 1954, Psychological review.

[64]  A. A. Skavenski,et al.  Miniature eye movement. , 1973, Science.

[65]  Martina Poletti,et al.  Miniature eye movements enhance fine spatial detail , 2007, Nature.

[66]  D. Hubel,et al.  The role of fixational eye movements in visual perception , 2004, Nature Reviews Neuroscience.

[67]  R. W. Ditchburn The function of small saccades , 1980, Vision Research.

[68]  Eileen Kowler Eye movements and their role in visual and cognitive processes. , 1990, Reviews of oculomotor research.

[69]  C. Gray The Temporal Correlation Hypothesis of Visual Feature Integration Still Alive and Well , 1999, Neuron.

[70]  D. Balota,et al.  Inferences about eye movement control from the perceptual span in reading , 1986, Perception & psychophysics.

[71]  Michele Rucci,et al.  EyeRIS: A general-purpose system for eye-movement-contingent display control , 2007, Behavior research methods.

[72]  Nikos K. Logothetis,et al.  Microsaccades differentially modulate neural activity in the striate and extrastriate visual cortex , 1998, Experimental Brain Research.

[73]  R. Reid,et al.  Synaptic Interactions between Thalamic Inputs to Simple Cells in Cat Visual Cortex , 2000, The Journal of Neuroscience.

[74]  P. E. Hallett,et al.  Power spectra for ocular drift and tremor , 1985, Vision Research.

[75]  Victor A. F. Lamme,et al.  Synchrony and covariation of firing rates in the primary visual cortex during contour grouping , 2004, Nature Neuroscience.

[76]  D. Snodderly,et al.  Selective activation of visual cortex neurons by fixational eye movements: Implications for neural coding , 2001, Visual Neuroscience.

[77]  G. Aston-Jones,et al.  Discharge of noradrenergic locus coeruleus neurons in behaving rats and monkeys suggests a role in vigilance. , 1991, Progress in brain research.

[78]  L. Abbott,et al.  Synaptic Depression and Cortical Gain Control , 1997, Science.

[79]  G. Edelman,et al.  Modeling LGN Responses during Free-Viewing: A Possible Role of Microscopic Eye Movements in the Refinement of Cortical Orientation Selectivity , 2000, The Journal of Neuroscience.