Variance normalisation: a key mechanism for temporal adaptation in natural vision?

A major problem in natural vision is how neurons in the early visual system encode the widely varying visual input with the limited dynamic range of their activity. Recent experiments suggest that retinal neurons adapt their response not only to the temporal mean but also to the temporal variance of the visual input. Inspired by these results, we propose a simple model in which temporal adaptation can be achieved by a transformation consisting of a linear filtering followed by a variance normalisation. We show that such transformation efficiently adapts to the temporal statistics of natural time series of intensities by removing most of its redundancy, while no linear transformation alone achieves the same goal. Results reproduce important features of temporal adaptation in real vision.

[1]  William H. Press,et al.  Numerical recipes , 1990 .

[2]  R. Masland,et al.  Spatial scale and cellular substrate of contrast adaptation by retinal ganglion cells , 2001, Nature Neuroscience.

[3]  Vision Research , 1961, Nature.

[4]  Adrienne L. Fairhall,et al.  Efficiency and ambiguity in an adaptive neural code , 2001, Nature.

[5]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[6]  J. H. Hateren,et al.  Independent component filters of natural images compared with simple cells in primary visual cortex , 1998 .

[7]  J. H. Hateren,et al.  Theoretical predictions of spatiotemporal receptive fields of fly LMCs, and experimental validation , 1992, Journal of Comparative Physiology A.

[8]  H Barlow,et al.  Redundancy reduction revisited , 2001, Network.

[9]  J D Victor,et al.  Temporal aspects of neural coding in the retina and lateral geniculate. , 1999, Network.

[10]  C. Enroth-Cugell,et al.  Chapter 9 Visual adaptation and retinal gain controls , 1984 .

[11]  Robert F. Engle,et al.  ARCH: Selected Readings , 1995 .

[12]  Adrienne L. Fairhall,et al.  Multiple Timescales of Adaptation in a Neural Code , 2000, NIPS.

[13]  Jonathan B Demb,et al.  Multiple Mechanisms for Contrast Adaptation in the Retina , 2002, Neuron.

[14]  L. Abbott,et al.  Responses of neurons in primary and inferior temporal visual cortices to natural scenes , 1997, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[15]  Jianhua Lin,et al.  Divergence measures based on the Shannon entropy , 1991, IEEE Trans. Inf. Theory.

[16]  Michael J. Berry,et al.  Adaptation of retinal processing to image contrast and spatial scale , 1997, Nature.

[17]  Joseph J. Atick,et al.  What Does the Retina Know about Natural Scenes? , 1992, Neural Computation.

[18]  E. Chichilnisky,et al.  Adaptation to Temporal Contrast in Primate and Salamander Retina , 2001, The Journal of Neuroscience.

[19]  Eero P. Simoncelli,et al.  Natural signal statistics and sensory gain control , 2001, Nature Neuroscience.

[20]  V. Hateren,et al.  Processing of natural time series of intensities by the visual system of the blowfly , 1997, Vision Research.

[21]  D. Ruderman.  The statistics of natural images , 1994 .

[22]  J. Victor.  The dynamics of the cat retinal X cell centre. , 1987, The Journal of physiology.

[23]  M. Meister,et al.  Fast and Slow Contrast Adaptation in Retinal Circuitry , 2002, Neuron.

[24]  V. Arshavsky,et al.  What are the mechanisms of photoreceptor adaptation , 1995 .

[25]  Kerry J. Kim,et al.  Temporal Contrast Adaptation in the Input and Output Signals of Salamander Retinal Ganglion Cells , 2001, The Journal of Neuroscience.

[26]  S. Laughlin,et al.  Predictive coding: a fresh view of inhibition in the retina , 1982, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[27]  R. Baddeley,et al.  Searching for filters with 'interesting' output distributions: an uninteresting direction to explore? , 1996, Network.

[28]  I. Grosse,et al.  Analysis of symbolic sequences using the Jensen-Shannon divergence. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[29]  F. Attneave.  Some informational aspects of visual perception. , 1954, Psychological review.

[30]  J. Atick,et al.  Temporal decorrelation: a theory of lagged and nonlagged responses in the lateral geniculate nucleus , 1995 .

[31]  Daniel L. Ruderman,et al.  Origins of scaling in natural images , 1996, Vision Research.

[32]  J. Movshon,et al.  Linearity and Normalization in Simple Cells of the Macaque Primary Visual Cortex , 1997, The Journal of Neuroscience.

[33]  William Bialek,et al.  Adaptive Rescaling Maximizes Information Transmission , 2000, Neuron.

[34]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[35]  William Bialek,et al.  Statistics of Natural Images: Scaling in the Woods , 1993, NIPS.

[36]  J. Atick,et al.  STATISTICS OF NATURAL TIME-VARYING IMAGES , 1995 .

[37]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.