Dissociable Neural Effects of Long-term Stimulus–Reward Pairing in Macaque Visual Cortex

It has been proposed that perceptual learning may occur through a reinforcement process, in which consistently pairing stimuli with reward is sufficient for learning. We tested whether stimulus–reward pairing is sufficient to increase the sensorial representation of a stimulus by recording local field potentials (LFPs) in macaque extrastriate area V4 with chronically implanted electrodes. Two oriented gratings were repeatedly presented; one was paired with a fluid reward, whereas no reward was given at any other time. During the course of conditioning the LFP increased for the rewarded compared to the unrewarded orientation. The time course of the effect of stimulus–reward pairing and its reversal differed between an early and late interval of the LFP response: a fast change in the later part of the neural response that was dissociated from a slower change in the early part of the response. The fast change of the late interval LFP suggests that this late LFP change is related to enhanced attention during the presentation of the rewarded stimulus. The slower time course of the early interval response suggests an effect of sensorial learning. Thus, simple stimulus–reward pairing is sufficient to strengthen stimulus representations in visual cortex and does this by means of two dissociable mechanisms.

[1]  Ernst Niebur,et al.  Effect of Stimulus Intensity on the Spike–Local Field Potential Relationship in the Secondary Somatosensory Cortex , 2008, The Journal of Neuroscience.

[2]  S. Hochstein,et al.  Attentional control of early perceptual learning. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[3]  Marc M. Van Hulle,et al.  Decoding Stimulus-Reward Pairing From Local Field Potentials Recorded From Monkey Visual Cortex , 2010, IEEE Transactions on Neural Networks.

[4]  Aaron R. Seitz,et al.  A unified model for perceptual learning , 2005, Trends in Cognitive Sciences.

[5]  R. Desimone,et al.  Spectral properties of V4 neurons in the macaque , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[6]  Pieter R. Roelfsema,et al.  Attention-Gated Reinforcement Learning of Internal Representations for Classification , 2005, Neural Computation.

[7]  N. Logothetis,et al.  The Effect of Learning on the Function of Monkey Extrastriate Visual Cortex , 2004, PLoS biology.

[8]  R. Vogels,et al.  Practicing Coarse Orientation Discrimination Improves Orientation Signals in Macaque Cortical Area V4 , 2011, Current Biology.

[9]  Michael M Merzenich,et al.  Perceptual Learning Directs Auditory Cortical Map Reorganization through Top-Down Influences , 2006, The Journal of Neuroscience.

[10]  Takeo Watanabe,et al.  Perceptual learning without perception , 2001, Nature.

[11]  J. Maunsell,et al.  Physiological correlates of perceptual learning in monkey V1 and V2. , 2002, Journal of neurophysiology.

[12]  W. Newsome,et al.  Matching Behavior and the Representation of Value in the Parietal Cortex , 2004, Science.

[13]  C. Gilbert,et al.  Perceptual learning and top-down influences in primary visual cortex , 2004, Nature Neuroscience.

[14]  C. Connor,et al.  Shape representation in area V4: position-specific tuning for boundary conformation. , 2001, Journal of neurophysiology.

[15]  M. Merzenich,et al.  Experience-Dependent Adult Cortical Plasticity Requires Cognitive Association between Sensation and Reward , 2006, Neuron.

[16]  G. Orban,et al.  Practising orientation identification improves orientation coding in V1 neurons , 2001, Nature.

[17]  Michael L. Platt,et al.  Neural correlates of decision variables in parietal cortex , 1999, Nature.

[18]  David L. Sheinberg,et al.  Effects of familiarity on neural activity in monkey inferior temporal lobe. , 2008, Cerebral cortex.

[19]  Aaron R. Seitz,et al.  A common framework for perceptual learning , 2007, Current Opinion in Neurobiology.

[20]  M. Bear,et al.  Reward Timing in the Primary Visual Cortex , 2006, Science.

[21]  Daniel Yoshor,et al.  Spatial Attention Does Not Strongly Modulate Neuronal Responses in Early Human Visual Cortex , 2007, The Journal of Neuroscience.

[22]  C. Gilbert,et al.  Attention and Perceptual Learning Modulate Contextual Influences on Visual Perception , 1998, Neuron.

[23]  C. Gilbert,et al.  Learning to see: experience and attention in primary visual cortex , 2001, Nature Neuroscience.

[24]  Christopher J. Aura,et al.  Divergence of fMRI and neural signals in V1 during perceptual suppression in the awake monkey , 2008, Nature Neuroscience.

[25]  M. Shadlen,et al.  Effect of Expected Reward Magnitude on the Response of Neurons in the Dorsolateral Prefrontal Cortex of the Macaque , 1999, Neuron.

[26]  Ralf Engbert,et al.  Microsaccades uncover the orientation of covert attention , 2003, Vision Research.

[27]  K. Sasaki,et al.  Development and change of cortical field potentials during learning processes of visually initiated hand movements in the monkey , 2004, Experimental Brain Research.

[28]  R. Desimone,et al.  The Effects of Visual Stimulation and Selective Visual Attention on Rhythmic Neuronal Synchronization in Macaque Area V4 , 2008, The Journal of Neuroscience.

[29]  Stephen Grossberg,et al.  Low-level sensory plasticity during task-irrelevant perceptual learning: Evidence from conventional and double training procedures , 2010, Vision Research.

[30]  W. Freiwald,et al.  Coherent oscillatory activity in monkey area v4 predicts successful allocation of attention. , 2005, Cerebral cortex.

[31]  C. Connor,et al.  Responses to contour features in macaque area V4. , 1999, Journal of neurophysiology.

[32]  Hujun Yin,et al.  Information Quantification of Empirical Mode Decomposition and Applications to Field Potentials , 2011, Int. J. Neural Syst..

[33]  R. Freeman,et al.  Neurometabolic coupling in cerebral cortex reflects synaptic more than spiking activity , 2007, Nature Neuroscience.

[34]  Aaron R. Seitz,et al.  Psychophysics: Is subliminal learning really passive? , 2003, Nature.

[35]  Aaron R. Seitz,et al.  Rewards Evoke Learning of Unconsciously Processed Visual Stimuli in Adult Humans , 2009, Neuron.

[36]  Leslie G. Ungerleider,et al.  Contour, color and shape analysis beyond the striate cortex , 1985, Vision Research.

[37]  J. Maunsell,et al.  The Effect of Perceptual Learning on Neuronal Responses in Monkey Visual Area V4 , 2004, The Journal of Neuroscience.

[38]  G. Orban,et al.  The effect of practice on the oblique effect in line orientation judgments , 1985, Vision Research.

[39]  Rufin Vogels,et al.  Stimulus repetition probability does not affect repetition suppression in macaque inferior temporal cortex. , 2011, Cerebral cortex.

[40]  Arthur Gretton,et al.  Low-Frequency Local Field Potentials and Spikes in Primary Visual Cortex Convey Independent Visual Information , 2008, The Journal of Neuroscience.

[41]  N. Logothetis The Underpinnings of the BOLD Functional Magnetic Resonance Imaging Signal , 2003, The Journal of Neuroscience.

[42]  O. Bertrand,et al.  Oscillatory gamma activity in humans and its role in object representation , 1999, Trends in Cognitive Sciences.

[43]  S. Zeki Uniformity and diversity of structure and function in rhesus monkey prestriate visual cortex. , 1978, The Journal of physiology.

[44]  Aaron R Seitz Perceptual Learning: Stimulus-Specific Learning from Low-Level Visual Plasticity? , 2011, Current Biology.

[45]  Keiji Tanaka,et al.  Reward Association Affects Neuronal Responses to Visual Stimuli in Macaque TE and Perirhinal Cortices , 2006, The Journal of Neuroscience.

[46]  G. Orban,et al.  Learning to See the Difference Specifically Alters the Most Informative V4 Neurons , 2006, The Journal of Neuroscience.

[47]  M. Merzenich,et al.  Cortical remodelling induced by activity of ventral tegmental dopamine neurons , 2001, Nature.

[48]  R. Desimone,et al.  Modulation of Oscillatory Neuronal Synchronization by Selective Visual Attention , 2001, Science.

[49]  Robert L. Goldstone,et al.  Definition , 1960, A Philosopher Looks at Sport.

[50]  O. Hikosaka,et al.  Visual and Anticipatory Bias in Three Cortical Eye Fields of the Monkey during an Adaptive Decision-Making Task , 2002, The Journal of Neuroscience.

[51]  Christoph Kayser,et al.  Effects of Training on Neuronal Activity and Interactions in Primary and Higher Visual Cortices in the Alert Cat , 2004, The Journal of Neuroscience.

[52]  P. Redgrave,et al.  Functional properties of the basal ganglia's re-entrant loop architecture: selection and reinforcement , 2011, Neuroscience.

[53]  A. Thiele,et al.  Comparison of spatial integration and surround suppression characteristics in spiking activity and the local field potential in macaque V1 , 2008, The European journal of neuroscience.

[54]  Yuko Yotsumoto,et al.  Defining a Link between Perceptual Learning and Attention , 2008, PLoS biology.