Temporal Contingencies Determine Whether Adaptation Strengthens or Weakens Normalization

A fundamental and nearly ubiquitous feature of sensory encoding is that neuronal responses are strongly influenced by recent experience, or adaptation. Theoretical and computational studies have proposed that many adaptation effects may result in part from changes in the strength of normalization signals. Normalization is a “canonical” computation in which a neuron's response is modulated (normalized) by the pooled activity of other neurons. Here, we test whether adaptation can alter the strength of cross-orientation suppression, or masking, a paradigmatic form of normalization evident in primary visual cortex (V1). We made extracellular recordings of V1 neurons in anesthetized male macaques and measured responses to plaid stimuli composed of two overlapping, orthogonal gratings before and after prolonged exposure to two distinct adapters. The first adapter was a plaid consisting of orthogonal gratings and led to stronger masking. The second adapter presented the same orthogonal gratings in an interleaved manner and led to weaker masking. The strength of adaptation's effects on masking depended on the orientation of the test stimuli relative to the orientation of the adapters, but was independent of neuronal orientation preference. Changes in masking could not be explained by altered neuronal responsivity. Our results suggest that normalization signals can be strengthened or weakened by adaptation depending on the temporal contingencies of the adapting stimuli. Our findings reveal an interplay between two widespread computations in cortical circuits, adaptation and normalization, that enables flexible adjustments to the structure of the environment, including the temporal relationships among sensory stimuli. SIGNIFICANCE STATEMENT Two fundamental features of sensory responses are that they are influenced by adaptation and that they are modulated by the activity of other nearby neurons via normalization. Our findings reveal a strong interaction between these two aspects of cortical computation. Specifically, we show that cross-orientation masking, a form of normalization, can be strengthened or weakened by adaptation depending on the temporal contingencies between sensory inputs. Our findings support theoretical proposals that some adaptation effects may involve altered normalization and offer a network-based explanation for how cortex adjusts to current sensory demands.

[1]  Fred Rieke,et al.  Review the Challenges Natural Images Pose for Visual Adaptation , 2022 .

[2]  Nicholas J. Priebe,et al.  Mechanisms underlying cross-orientation suppression in cat visual cortex , 2006, Nature Neuroscience.

[3]  R. Freeman,et al.  Origins of cross-orientation suppression in the visual cortex. , 2006, Journal of neurophysiology.

[4]  Jiri Najemnik,et al.  Eye movement statistics in humans are consistent with an optimal search strategy. , 2008, Journal of vision.

[5]  Eero P. Simoncelli,et al.  Natural signal statistics and sensory gain control , 2001, Nature Neuroscience.

[6]  R. Over,et al.  Color Adaptation of Spatial Frequency Detectors in the Human Visual System , 1972, Science.

[7]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[8]  Daniel B. Rubin,et al.  The Stabilized Supralinear Network: A Unifying Circuit Motif Underlying Multi-Input Integration in Sensory Cortex , 2015, Neuron.

[9]  Frank Sengpiel,et al.  PII: S0042-6989(97)00413-6 , 1998 .

[10]  Zachary M. Westrick,et al.  Pattern Adaptation and Normalization Reweighting , 2016, The Journal of Neuroscience.

[11]  A. Fairhall,et al.  Sensory adaptation , 2007, Current Opinion in Neurobiology.

[12]  I. Ohzawa,et al.  Contrast gain control in the cat's visual system. , 1985, Journal of neurophysiology.

[13]  C. McCollough Color Adaptation of Edge-Detectors in the Human Visual System , 1965, Science.

[14]  C. Olson,et al.  Statistical learning of visual transitions in monkey inferotemporal cortex , 2011, Proceedings of the National Academy of Sciences.

[15]  M C Corballis,et al.  Motion Perception: A Color-Contingent Aftereffect , 1972, Science.

[16]  M. Carandini,et al.  A tonic hyperpolarization underlying contrast adaptation in cat visual cortex. , 1997, Science.

[17]  N. Hepler Color: A Motion-Contingent Aftereffect , 1968, Science.

[18]  Adam Kohn,et al.  The influence of surround suppression on adaptation effects in primary visual cortex. , 2012, Journal of neurophysiology.

[19]  P. Lennie,et al.  Multiple Adaptable Mechanisms Early in the Primate Visual Pathway , 2011, The Journal of Neuroscience.

[20]  M. Webster Visual Adaptation. , 2015, Annual review of vision science.

[21]  Peter Földiák,et al.  Adaptation and decorrelation in the cortex , 1989 .

[22]  Eero P. Simoncelli,et al.  Noise characteristics and prior expectations in human visual speed perception , 2006, Nature Neuroscience.

[23]  A. B. Bonds Role of Inhibition in the Specification of Orientation Selectivity of Cells in the Cat Striate Cortex , 1989, Visual Neuroscience.

[24]  J. Anthony Movshon,et al.  Neuronal Responses to Texture-Defined Form in Macaque Visual Area V2 , 2011, The Journal of Neuroscience.

[25]  Michael S. Landy,et al.  Contingent adaptation in masking and surround suppression , 2018, Vision Research.

[26]  O. Schwartz,et al.  Specificity and timescales of cortical adaptation as inferences about natural movie statistics , 2016, Journal of vision.

[27]  P. Dayan,et al.  Space and time in visual context , 2007, Nature Reviews Neuroscience.

[28]  M. Sur,et al.  Adaptation-Induced Plasticity of Orientation Tuning in Adult Visual Cortex , 2000, Neuron.

[29]  J. Movshon,et al.  Pattern adaptation and cross-orientation interactions in the primary visual cortex , 1998, Neuropharmacology.

[30]  Maria V. Sanchez-Vives,et al.  Membrane Mechanisms Underlying Contrast Adaptation in Cat Area 17In Vivo , 2000, The Journal of Neuroscience.

[31]  J. Anthony Movshon,et al.  Comparison of Recordings from Microelectrode Arrays and Single Electrodes in the Visual Cortex , 2007, The Journal of Neuroscience.

[32]  J. Movshon,et al.  Adaptation changes the direction tuning of macaque MT neurons , 2004, Nature Neuroscience.

[33]  A. Pouget,et al.  Marginalization in Neural Circuits with Divisive Normalization , 2011, The Journal of Neuroscience.

[34]  R. Born,et al.  Input-Gain Control Produces Feature-Specific Surround Suppression , 2015, The Journal of Neuroscience.

[35]  Y. Zhou,et al.  Adaptation of visually evoked responses of relay cells in the dorsal lateral geniculate nucleus of the cat following prolonged exposure to drifting gratings , 1996, Visual Neuroscience.

[36]  M. Carandini,et al.  Normalization as a canonical neural computation , 2011, Nature Reviews Neuroscience.

[37]  B. Dreher,et al.  Relationship between contrast adaptation and orientation tuning in V1 and V2 of cat visual cortex. , 2006, Journal of neurophysiology.

[38]  P. Lennie,et al.  Pattern-selective adaptation in visual cortical neurones , 1979, Nature.

[39]  M. Cohen,et al.  Relating normalization to neuronal populations across cortical areas. , 2016, Journal of neurophysiology.

[40]  P. Lennie,et al.  Early and Late Mechanisms of Surround Suppression in Striate Cortex of Macaque , 2005, The Journal of Neuroscience.

[41]  L. P. O'Keefe,et al.  Adaptation to contingencies in macaque primary visual cortex. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[42]  A. Kohn,et al.  Similar adaptation effects in primary visual cortex and area MT of the macaque monkey under matched stimulus conditions. , 2014, Journal of neurophysiology.

[43]  J. Movshon,et al.  Nature and interaction of signals from the receptive field center and surround in macaque V1 neurons. , 2002, Journal of neurophysiology.

[44]  Peter Dayan,et al.  Cortical Surround Interactions and Perceptual Salience via Natural Scene Statistics , 2012, PLoS Comput. Biol..

[45]  D. Heeger,et al.  The Normalization Model of Attention , 2009, Neuron.

[46]  Ryan V. Ringer,et al.  Impairing the useful field of view in natural scenes: Tunnel vision versus general interference. , 2016, Journal of vision.

[47]  Joonyeol Lee,et al.  A Normalization Model of Attentional Modulation of Single Unit Responses , 2009, PloS one.

[48]  Michael C. Avery,et al.  Optogenetic Activation of Normalization in Alert Macaque Visual Cortex , 2015, Neuron.

[49]  A. Kohn,et al.  Distinct Effects of Brief and Prolonged Adaptation on Orientation Tuning in Primary Visual Cortex , 2013, The Journal of Neuroscience.

[50]  P. Schwindt,et al.  Slow conductances in neurons from cat sensorimotor cortex in vitro and their role in slow excitability changes. , 1988, Journal of neurophysiology.

[51]  Maria V. Sanchez-Vives,et al.  Cellular Mechanisms of Long-Lasting Adaptation in Visual Cortical Neurons In Vitro , 2000, The Journal of Neuroscience.

[52]  J. Movshon,et al.  Linearity and Normalization in Simple Cells of the Macaque Primary Visual Cortex , 1997, The Journal of Neuroscience.

[53]  H. Barlow Vision: A theory about the functional role and synaptic mechanism of visual after-effects , 1991 .

[54]  R Held,et al.  Color- and Edge-Sensitive Channels in the Human Visual System: Tuning for Orientation , 1971, Science.

[55]  E. Vul,et al.  The McCollough effect reflects permanent and transient adaptation in early visual cortex. , 2008, Journal of vision.

[56]  Tatsuo K Sato,et al.  An excitatory basis for divisive normalization in visual cortex , 2016, Nature Neuroscience.

[57]  BsnNr C. Srorn,et al.  CLASSIFYING SIMPLE AND COMPLEX CELLS ON THE BASIS OF RESPONSE MODULATION , 2002 .

[58]  Maria V. Sanchez-Vives,et al.  Impact of cortical network activity on short-term synaptic depression. , 2006, Cerebral cortex.

[59]  F. Sengpiel,et al.  Orientation specificity of contrast adaptation in visual cortical pinwheel centres and iso‐orientation domains , 2002, The European journal of neuroscience.

[60]  Eero P. Simoncelli,et al.  Natural image statistics and divisive normalization: Modeling nonlinearity and adaptation in cortical neurons , 2002 .

[61]  M. Carandini,et al.  Suppression without Inhibition in Visual Cortex , 2002, Neuron.

[62]  Nicholas J. Priebe,et al.  Short-Term Depression in Thalamocortical Synapses of Cat Primary Visual Cortex , 2005, The Journal of Neuroscience.

[63]  O. Schwartz,et al.  Flexible Gating of Contextual Influences in Natural Vision , 2015, Nature Neuroscience.

[64]  Ralph D Freeman,et al.  Spatial frequency-specific contrast adaptation originates in the primary visual cortex. , 2007, Journal of neurophysiology.

[65]  M. Webster,et al.  Visual adaptation: Neural, psychological and computational aspects , 2007, Vision Research.

[66]  U. Ernst,et al.  Perceptual Inference Predicts Contextual Modulations of Sensory Responses , 2012, The Journal of Neuroscience.

[67]  P. Lennie,et al.  Profound Contrast Adaptation Early in the Visual Pathway , 2004, Neuron.

[68]  M. Meister,et al.  Dynamic predictive coding by the retina , 2005, Nature.

[69]  John M. Foley,et al.  Analysis of the effect of pattern adaptation on pattern pedestal effects: A two-process model , 1997, Vision Research.

[70]  M. Carandini,et al.  A Synaptic Explanation of Suppression in Visual Cortex , 2002, The Journal of Neuroscience.

[71]  D. Heeger Normalization of cell responses in cat striate cortex , 1992, Visual Neuroscience.

[72]  L. Abbott,et al.  Synaptic computation , 2004, Nature.

[73]  Rufin Vogels,et al.  Divisive Normalization Predicts Adaptation-Induced Response Changes in Macaque Inferior Temporal Cortex , 2016, The Journal of Neuroscience.

[74]  R. Freeman,et al.  Cross-orientation suppression: monoptic and dichoptic mechanisms are different. , 2005, Journal of neurophysiology.

[75]  M. Carandini,et al.  Adaptation maintains population homeostasis in primary visual cortex , 2013, Nature Neuroscience.

[76]  A. Kohn Visual adaptation: physiology, mechanisms, and functional benefits. , 2007, Journal of neurophysiology.

[77]  L. Abbott,et al.  Synaptic plasticity: taming the beast , 2000, Nature Neuroscience.

[78]  Chris Tailby,et al.  Adaptable Mechanisms That Regulate the Contrast Response of Neurons in the Primate Lateral Geniculate Nucleus , 2009, The Journal of Neuroscience.

[79]  P. Lennie,et al.  Rapid adaptation in visual cortex to the structure of images. , 1999, Science.

[80]  S. Nelson,et al.  Temporal interactions in the cat visual system. I. Orientation- selective suppression in the visual cortex , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[81]  M. Cynader,et al.  The time course of direction-selective adaptation in simple and complex cells in cat striate cortex. , 1993, Journal of neurophysiology.

[82]  I. Ohzawa,et al.  Organization of suppression in receptive fields of neurons in cat visual cortex. , 1992, Journal of neurophysiology.

[83]  S. Solomon,et al.  Moving Sensory Adaptation beyond Suppressive Effects in Single Neurons , 2014, Current Biology.

[84]  D. Burr,et al.  Functional implications of cross-orientation inhibition of cortical visual cells. I. Neurophysiological evidence , 1982, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[85]  Michael W. Spratling Predictive Coding as a Model of Response Properties in Cortical Area V1 , 2010, The Journal of Neuroscience.

[86]  Markus Bauer,et al.  No evidence for widespread synchronized networks in binocular rivalry: MEG frequency tagging entrains primarily early visual cortex. , 2008, Journal of vision.