Pattern Adaptation and Normalization Reweighting

Adaptation to an oriented stimulus changes both the gain and preferred orientation of neural responses in V1. Neurons tuned near the adapted orientation are suppressed, and their preferred orientations shift away from the adapter. We propose a model in which weights of divisive normalization are dynamically adjusted to homeostatically maintain response products between pairs of neurons. We demonstrate that this adjustment can be performed by a very simple learning rule. Simulations of this model closely match existing data from visual adaptation experiments. We consider several alternative models, including variants based on homeostatic maintenance of response correlations or covariance, as well as feedforward gain-control models with multiple layers, and we demonstrate that homeostatic maintenance of response products provides the best account of the physiological data. SIGNIFICANCE STATEMENT Adaptation is a phenomenon throughout the nervous system in which neural tuning properties change in response to changes in environmental statistics. We developed a model of adaptation that combines normalization (in which a neuron's gain is reduced by the summed responses of its neighbors) and Hebbian learning (in which synaptic strength, in this case divisive normalization, is increased by correlated firing). The model is shown to account for several properties of adaptation in primary visual cortex in response to changes in the statistics of contour orientation.

[1]  L. Maffei,et al.  Neural Correlate of Perceptual Adaptation to Gratings , 1973, Science.

[2]  M. Carandini,et al.  Normalization as a canonical neural computation , 2011, Nature Reviews Neuroscience.

[3]  Joseph J. Atick,et al.  Towards a Theory of Early Visual Processing , 1990, Neural Computation.

[4]  P. Dayan,et al.  Space and time in visual context , 2007, Nature Reviews Neuroscience.

[5]  H. B. Barlow,et al.  Possible Principles Underlying the Transformations of Sensory Messages , 2012 .

[6]  Alessandra Angelucci,et al.  Different Orientation Tuning of Near- and Far-Surround Suppression in Macaque Primary Visual Cortex Mirrors Their Tuning in Human Perception , 2013, The Journal of Neuroscience.

[7]  M. Cynader,et al.  Synaptic depression in visual cortex tissue slices: an in vitro model for cortical neuron adaptation , 2004, Experimental Brain Research.

[8]  J. Movshon,et al.  Pattern adaptation and cross-orientation interactions in the primary visual cortex , 1998, Neuropharmacology.

[9]  Yang Dan,et al.  Dynamic Modification of Cortical Orientation Tuning Mediated by Recurrent Connections , 2002, Neuron.

[10]  Eero P. Simoncelli,et al.  Efficient Sensory Encoding and Bayesian Inference with Heterogeneous Neural Populations , 2014, Neural Computation.

[11]  Y. Dan,et al.  Stimulus Timing-Dependent Plasticity in Cortical Processing of Orientation , 2001, Neuron.

[12]  A. Kohn,et al.  Distinct Effects of Brief and Prolonged Adaptation on Orientation Tuning in Primary Visual Cortex , 2013, The Journal of Neuroscience.

[13]  I. Ohzawa,et al.  Contrast gain control in the cat visual cortex , 1982, Nature.

[14]  M. Meister,et al.  Dynamic predictive coding by the retina , 2005, Nature.

[15]  R. Shapley,et al.  The effect of contrast on the transfer properties of cat retinal ganglion cells. , 1978, The Journal of physiology.

[16]  Y. Dan,et al.  Intracortical mechanism of stimulus-timing-dependent plasticity in visual cortical orientation tuning. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[17]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[18]  J. Movshon,et al.  Adaptation changes the direction tuning of macaque MT neurons , 2004, Nature Neuroscience.

[19]  N. Qian,et al.  V1 orientation plasticity is explained by broadly tuned feedforward inputs and intracortical sharpening , 2010, Visual Neuroscience.

[20]  Eero P. Simoncelli,et al.  A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients , 2000, International Journal of Computer Vision.

[21]  G. Orban,et al.  Practising orientation identification improves orientation coding in V1 neurons , 2001, Nature.

[22]  W. Levy,et al.  Temporal contiguity requirements for long-term associative potentiation/depression in the hippocampus , 1983, Neuroscience.

[23]  P. Lennie,et al.  Profound Contrast Adaptation Early in the Visual Pathway , 2004, Neuron.

[24]  S. Nelson,et al.  Short-Term Depression at Thalamocortical Synapses Contributes to Rapid Adaptation of Cortical Sensory Responses In Vivo , 2002, Neuron.

[25]  Eero P. Simoncelli,et al.  Natural signal statistics and sensory gain control , 2001, Nature Neuroscience.

[26]  J. Movshon,et al.  Linearity and Normalization in Simple Cells of the Macaque Primary Visual Cortex , 1997, The Journal of Neuroscience.

[27]  D. Heeger,et al.  Center-surround interactions in foveal and peripheral vision , 2000, Vision Research.

[28]  D. Heeger Half-squaring in responses of cat striate cells , 1992, Visual Neuroscience.

[29]  J. Touryan,et al.  Contextual modulation of orientation tuning contributes to efficient processing of natural stimuli , 2005, Network.

[30]  Peter Földiák,et al.  Adaptation and decorrelation in the cortex , 1989 .

[31]  L. P. O'Keefe,et al.  Adaptation to contingencies in macaque primary visual cortex. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[32]  Adam Kohn,et al.  The influence of surround suppression on adaptation effects in primary visual cortex. , 2012, Journal of neurophysiology.

[33]  M. Carandini,et al.  Adaptation maintains population homeostasis in primary visual cortex , 2013, Nature Neuroscience.

[34]  M. Sur,et al.  Adaptation-Induced Plasticity of Orientation Tuning in Adult Visual Cortex , 2000, Neuron.

[35]  Edward H. Adelson,et al.  Shiftable multiscale transforms , 1992, IEEE Trans. Inf. Theory.

[36]  Eero P. Simoncelli,et al.  Efficient Coding of Spatial Information in the Primate Retina , 2012, The Journal of Neuroscience.

[37]  P. Lennie,et al.  Multiple Adaptable Mechanisms Early in the Primate Visual Pathway , 2011, The Journal of Neuroscience.

[38]  Eero P. Simoncelli,et al.  Natural image statistics and divisive normalization: Modeling nonlinearity and adaptation in cortical neurons , 2002 .

[39]  M. Carandini,et al.  A tonic hyperpolarization underlying contrast adaptation in cat visual cortex. , 1997, Science.

[40]  R. Shapley,et al.  Nonlinear spatial summation and the contrast gain control of cat retinal ganglion cells. , 1979, The Journal of physiology.

[41]  M. Sur,et al.  Foci of orientation plasticity in visual cortex , 2001, Nature.

[42]  R C Reid,et al.  Efficient Coding of Natural Scenes in the Lateral Geniculate Nucleus: Experimental Test of a Computational Theory , 1996, The Journal of Neuroscience.

[43]  N. Qian,et al.  Learning and adaptation in a recurrent model of V1 orientation selectivity. , 2003, Journal of neurophysiology.

[44]  S. Solomon,et al.  Moving Sensory Adaptation beyond Suppressive Effects in Single Neurons , 2014, Current Biology.

[45]  Xue-Xin Wei,et al.  Efficient coding provides a direct link between prior and likelihood in perceptual Bayesian inference , 2012, NIPS.

[46]  D. Heeger Normalization of cell responses in cat striate cortex , 1992, Visual Neuroscience.

[47]  Matteo Carandini,et al.  Cascaded Effects of Spatial Adaptation in the Early Visual System , 2014, Neuron.

[48]  S. Molotchnikoff,et al.  Long adaptation reveals mostly attractive shifts of orientation tuning in cat primary visual cortex , 2009, Neuroscience.

[49]  Maria V. Sanchez-Vives,et al.  Membrane Mechanisms Underlying Contrast Adaptation in Cat Area 17In Vivo , 2000, The Journal of Neuroscience.

[50]  Matthias Bethge,et al.  Temporal Adaptation Enhances Efficient Contrast Gain Control on Natural Images , 2012, PLoS Comput. Biol..

[51]  Eero P. Simoncelli,et al.  Cardinal rules: Visual orientation perception reflects knowledge of environmental statistics , 2011, Nature Neuroscience.

[52]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[53]  P. Glimcher,et al.  Dynamic Divisive Normalization Predicts Time-Varying Value Coding in Decision-Related Circuits , 2014, The Journal of Neuroscience.

[54]  P. Lennie,et al.  Rapid adaptation in visual cortex to the structure of images. , 1999, Science.

[55]  I. Ohzawa,et al.  Contrast gain control in the cat's visual system. , 1985, Journal of neurophysiology.

[56]  P. Lennie,et al.  Pattern-selective adaptation in visual cortical neurones , 1979, Nature.

[57]  J. Movshon,et al.  Selectivity and spatial distribution of signals from the receptive field surround in macaque V1 neurons. , 2002, Journal of neurophysiology.

[58]  Johannes Burge,et al.  Optimal defocus estimation in individual natural images , 2011, Proceedings of the National Academy of Sciences.