Extinction reveals that primary sensory cortex predicts reinforcement outcome

Primary sensory cortices are traditionally regarded as stimulus analysers. However, studies of associative learning‐induced plasticity in the primary auditory cortex (A1) indicate involvement in learning, memory and other cognitive processes. For example, the area of representation of a tone becomes larger for stronger auditory memories and the magnitude of area gain is proportional to the degree that a tone becomes behaviorally important. Here, we used extinction to investigate whether ‘behavioral importance’ specifically reflects a sound’s ability to predict reinforcement (reward or punishment) vs. to predict any significant change in the meaning of a sound. If the former, then extinction should reverse area gains as the signal no longer predicts reinforcement. Rats (n = 11) were trained to bar‐press to a signal tone (5.0 kHz) for water‐rewards, to induce signal‐specific area gains in A1. After subsequent withdrawal of reward, A1 was mapped to determine representational areas. Signal‐specific area gains, estimated from a previously established brain–behavior quantitative function, were reversed, supporting the ‘reinforcement prediction’ hypothesis. Area loss was specific to the signal tone vs. test tones, further indicating that withdrawal of reinforcement, rather than unreinforced tone presentation per se, was responsible for area loss. Importantly, the amount of area loss was correlated with the amount of extinction (r = 0.82, P < 0.01). These findings show that primary sensory cortical representation can encode behavioral importance as a signal’s value to predict reinforcement, and that the number of cells tuned to a stimulus can dictate its ability to command behavior.

[1]  M. Kilgard,et al.  Cortical map reorganization enabled by nucleus basalis activity. , 1998, Science.

[2]  C. Woolsey,et al.  Auditory areas I, II, and Ep: cochlear representation, afferent paths and interconnections. , 1960, Bulletin of the Johns Hopkins Hospital.

[3]  I. Tetko,et al.  Spatiotemporal activity patterns of rat cortical neurons predict responses in a conditioned task. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[4]  Michael M Merzenich,et al.  Intensive training in adults refines A1 representations degraded in an early postnatal critical period , 2007, Proceedings of the National Academy of Sciences.

[5]  Á. Pascual-Leone,et al.  The metamodal organization of the brain. , 2001, Progress in brain research.

[6]  M. Kossut,et al.  Short-lasting classical conditioning induces reversible changes of representational maps of vibrissae in mouse SI cortex--a 2DG study. , 1996, Cerebral cortex.

[7]  P. Heil,et al.  Auditory cortical onset responses revisited. II. Response strength. , 1997, Journal of neurophysiology.

[8]  Michael M Merzenich,et al.  Successive-signal biasing for a learned sound sequence , 2010, Proceedings of the National Academy of Sciences.

[9]  M. E. Pedreira,et al.  Mismatch between what is expected and what actually occurs triggers memory reconsolidation or extinction. , 2004, Learning & memory.

[10]  H. Scheich,et al.  Dopaminergic Modulation of Auditory Cortex-Dependent Memory Consolidation through mTOR , 2008, Cerebral cortex.

[11]  Osamu Hoshino,et al.  Enhanced Sound Perception by Widespread-Onset Neuronal Responses in Auditory Cortex , 2007, Neural Computation.

[12]  J. Fritz,et al.  Differential Dynamic Plasticity of A1 Receptive Fields during Multiple Spectral Tasks , 2005, The Journal of Neuroscience.

[13]  F. Ohl,et al.  Differential Frequency Conditioning Enhances Spectral Contrast Sensitivity of Units in Auditory Cortex (Field Al) of the Alert Mongolian Gerbil , 1996, The European journal of neuroscience.

[14]  A. R. Wagner SOP: A Model of Automatic Memory Processing in Animal Behavior , 2014 .

[15]  E. Fischer Conditioned Reflexes , 1942, American journal of physical medicine.

[16]  J. Disterhoft,et al.  Trial sequence of changed unit activity in auditory system of alert rat during conditioned response acquisition and extinction. , 1976, Journal of neurophysiology.

[17]  W. Cn,et al.  Auditory areas I, II, and Ep: cochlear representation, afferent paths and interconnections. , 1960 .

[18]  D. Diamond,et al.  Physiological plasticity in auditory cortex: Rapid induction by learning , 1987, Progress in Neurobiology.

[19]  M. Zellner,et al.  How conditioned stimuli acquire the ability to activate VTA dopamine cells: A proposed neurobiological component of reward-related learning , 2010, Neuroscience & Biobehavioral Reviews.

[20]  M. Jung,et al.  Behavioral Neuroscience , 2022 .

[21]  H. Scheich,et al.  Learning-induced dynamic receptive field changes in primary auditory cortex of the unanaesthetized Mongolian gerbil , 1997, Journal of Comparative Physiology A.

[22]  J. Kelly,et al.  Organization of auditory cortex in the albino rat: sound frequency. , 1988, Journal of neurophysiology.

[23]  Kyle S. Smith,et al.  Corticostriatal Interactions during Learning, Memory Processing, and Decision Making , 2009, The Journal of Neuroscience.

[24]  Tadashi Yamazaki,et al.  Sound frequency representation in cat auditory cortex , 2004, NeuroImage.

[25]  Edgar H Vogel,et al.  Stimulus representation in SOP: I Theoretical rationalization and some implications , 2003, Behavioural Processes.

[26]  S. Williams Resistance to extinction as a function of the number of reinforcements. , 1938 .

[27]  S. David,et al.  Adaptive, behaviorally-gated, persistent encoding of task-relevant auditory information in ferret frontal cortex , 2010, Nature Neuroscience.

[28]  G. Ehret,et al.  The auditory cortex of the house mouse: left-right differences, tonotopic organization and quantitative analysis of frequency representation , 1997, Journal of Comparative Physiology A.

[29]  M. Merzenich,et al.  Plasticity in the frequency representation of primary auditory cortex following discrimination training in adult owl monkeys , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[30]  N. Suga,et al.  Experience-dependent corticofugal adjustment of midbrain frequency map in bat auditory system. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[31]  F. Morrell,et al.  Electrographic studies of the formation of temporary connections in the brain. , 1956, Electroencephalography and clinical neurophysiology.

[32]  F. Ohl,et al.  Behavioral semantics of learning and crossmodal processing in auditory cortex: The semantic processor concept , 2011, Hearing Research.

[33]  M M Merzenich,et al.  Cochleotopic organization of primary auditory cortex in the cat. , 1973, Brain research.

[34]  Ralph R. Miller,et al.  Information processing in animals : memory mechanisms , 1983 .

[35]  J. Hollerman,et al.  Reward processing in primate orbitofrontal cortex and basal ganglia. , 2000, Cerebral cortex.

[36]  Shaowen Bao,et al.  Cortical Plasticity as a Mechanism for Storing Bayesian Priors in Sensory Perception , 2010, PloS one.

[37]  D. Rasmusson,et al.  Inactivation of prefrontal cortex abolishes cortical acetylcholine release evoked by sensory or sensory pathway stimulation in the rat , 2007, Neuroscience.

[38]  Henning Scheich,et al.  Neural substrates for tone-conditioned bradycardia demonstrated with 2-deoxyglucose. I. Activation of auditory nuclei , 1984, Behavioural Brain Research.

[39]  Larry E. Roberts,et al.  Plastic changes in the auditory cortex induced by intensive frequency discrimination training , 2000, Neuroreport.

[40]  M. Dimyan,et al.  Basal forebrain stimulation induces discriminative receptive field plasticity in the auditory cortex. , 1999, Behavioral neuroscience.

[41]  N Suga,et al.  Effects of acetylcholine and atropine on plasticity of central auditory neurons caused by conditioning in bats. , 2001, Journal of neurophysiology.

[42]  Norman M. Weinberger,et al.  Remodeling the cortex in memory: Increased use of a learning strategy increases the representational area of relevant acoustic cues , 2010, Neurobiology of Learning and Memory.

[43]  D. Irvine,et al.  The posterior field P of cat auditory cortex: coding of envelope transients. , 1998, Cerebral cortex.

[44]  R. Galamboš,et al.  Electrophysiological correlates of a conditioned response in cats. , 1956, Science.

[45]  J. Kaas,et al.  Variability in hand surface representations in areas 3b and 1 in adult owl and squirrel monkeys , 1987, The Journal of comparative neurology.

[46]  J. Edeline,et al.  Noradrenergic induction of selective plasticity in the frequency tuning of auditory cortex neurons. , 2004, Journal of neurophysiology.

[47]  Christoph E Schreiner,et al.  Spectrotemporal structure of receptive fields in areas AI and AAF of mouse auditory cortex. , 2003, Journal of neurophysiology.

[48]  N. Weinberger,et al.  Learning strategy determines auditory cortical plasticity , 2008, Neurobiology of Learning and Memory.

[49]  Norman M. Weinberger,et al.  Learning strategy trumps motivational level in determining learning-induced auditory cortical plasticity , 2010, Neurobiology of Learning and Memory.

[50]  T. Wagner,et al.  Categorical discrimination of direction in frequency-modulated tones by Mongolian gerbils , 1998, Behavioural Brain Research.

[51]  D. Blake,et al.  Arc expression and neuroplasticity in primary auditory cortex during initial learning are inversely related to neural activity , 2010, Proceedings of the National Academy of Sciences.

[52]  J. Bakin,et al.  Induction of a physiological memory in the cerebral cortex by stimulation of the nucleus basalis. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[53]  T. Hackett,et al.  Linking Topography to Tonotopy in the Mouse Auditory Thalamocortical Circuit , 2011, The Journal of Neuroscience.

[54]  N. Harel,et al.  Tonotopic mapping in auditory cortex of the chinchilla , 1996, Hearing Research.

[55]  Norman M. Weinberger,et al.  Reconceptualizing the Primary Auditory Cortex: Learning, Memory and Specific Plasticity , 2011 .

[56]  Henning Scheich,et al.  Functional Organization of Auditory Cortex in the Mongolian Gerbil (Meriones unguiculatus). I. Electrophysiological Mapping of Frequency Representation and Distinction of Fields , 1993, The European journal of neuroscience.

[57]  B. Roche,et al.  The Behavior of Organisms? , 1997 .

[58]  J. Konorski Conditioned reflexes and neuron organization. , 1948 .

[59]  Josef P. Rauschecker,et al.  Auditory cortical plasticity: a comparison with other sensory systems , 1999, Trends in Neurosciences.

[60]  Xin-de Sun,et al.  Modulation of frequency receptive field plasticity in rat auditory cortical neurons by electrical stimulation of medial prefrontal cortex. , 2007, Sheng li xue bao : [Acta physiologica Sinica].

[61]  E. Rolls The orbitofrontal cortex and reward. , 2000, Cerebral cortex.

[62]  N Suga,et al.  Experience-dependent plasticity in the auditory cortex and the inferior colliculus of bats: role of the corticofugal system. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[63]  Geoffrey M. Ghose,et al.  Attention directed by expectations enhances receptive fields in cortical area MT , 2010, Vision Research.

[64]  G L Gerstein,et al.  Daily variation and appetitive conditioning‐induced plasticity of auditory cortex receptive fields , 2001, The European journal of neuroscience.

[65]  Akihiro Funamizu,et al.  Progressive plasticity of auditory cortex during appetitive operant conditioning , 2010, Biosyst..

[66]  B. Schreurs,et al.  A functional anatomical study of associative learning in humans. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[67]  Y. Lacasse,et al.  From the authors , 2005, European Respiratory Journal.

[68]  R. Rescorla Savings tests: separating differences in rate of learning from differences in initial levels. , 2002, Journal of experimental psychology. Animal behavior processes.

[69]  Henning Scheich,et al.  Neural substrates for tone-conditioned bradycardia demonstrated with 2-deoxyglucose. II. Auditory cortex plasticity , 1986, Behavioural Brain Research.

[70]  J. O'Doherty,et al.  Encoding Predictive Reward Value in Human Amygdala and Orbitofrontal Cortex , 2003, Science.

[71]  Andreas R. Luft,et al.  Motor learning transiently changes cortical somatotopy , 2008, NeuroImage.

[72]  Norman M. Weinberger,et al.  Classical conditioning induces CS-specific receptive field plasticity in the auditory cortex of the guinea pig , 1990, Brain Research.

[73]  N. Weinberger,et al.  Evoked potential decrements in auditory cortex. II. Critical test for habituation. , 1976, Electroencephalography and clinical neurophysiology.

[74]  N. Weinberger,et al.  Habituation produces frequency-specific plasticity of receptive fields in the auditory cortex. , 1991, Behavioral neuroscience.

[75]  J. E. Rose,et al.  The relations of thalamic connections, cellular structure and evocable electrical activity in the auditory region of the cat , 1949, The Journal of comparative neurology.

[76]  M. Kringelbach The human orbitofrontal cortex: linking reward to hedonic experience , 2005, Nature Reviews Neuroscience.

[77]  Norman M Weinberger,et al.  Encoding of learned importance of sound by magnitude of representational area in primary auditory cortex. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[78]  D. Irvine,et al.  Perceptual learning on an auditory frequency discrimination task by cats: association with changes in primary auditory cortex. , 2004, Cerebral cortex.

[79]  Christoph E. Schreiner,et al.  Spatial Distribution of Responses to Simple and Complex Sounds in the Primary Auditory Cortex , 1998, Audiology and Neurotology.

[80]  J. W. Rudy,et al.  Activation of the infralimbic cortex in a fear context enhances extinction learning. , 2010, Learning & memory.

[81]  A. Zador,et al.  Auditory cortex mediates the perceptual effects of acoustic temporal expectation , 2010, Nature Neuroscience.

[82]  Norman M. Weinberger,et al.  Classical conditioning rapidly induces specific changes in frequency receptive fields of single neurons in secondary and ventral ectosylvian auditory cortical fields , 1986, Brain Research.

[83]  Henning Scheich,et al.  Representation of Reward Feedback in Primate Auditory Cortex , 2011, Front. Syst. Neurosci..

[84]  J. Edeline,et al.  Rapid development of learning-induced receptive field plasticity in the auditory cortex. , 1993, Behavioral neuroscience.

[85]  Karl J. Friston,et al.  Experience–dependent modulation of tonotopic neural responses in human auditory cortex , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[86]  R. Reale,et al.  Tonotopic organization in auditory cortex of the cat , 1980, The Journal of comparative neurology.

[87]  M. Watanabe Prefrontal unit activity during associative learning in the monkey , 2004, Experimental Brain Research.

[88]  Anne K. Churchland,et al.  Neural correlates of instrumental learning in primary auditory cortex , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[89]  G. Quirk,et al.  Neurons in medial prefrontal cortex signal memory for fear extinction , 2002, Nature.

[90]  P. Heil,et al.  Auditory cortical onset responses revisited. I. First-spike timing. , 1997, Journal of neurophysiology.

[91]  N. Weinberger,et al.  Characterisation of multiple physiological fields within the anatomical core of rat auditory cortex , 2003, Hearing Research.

[92]  R. Lubow,et al.  Latent inhibition: the effect of nonreinforced pre-exposure to the conditional stimulus. , 1959, Journal of comparative and physiological psychology.

[93]  Y Sakurai,et al.  Involvement of auditory cortical and hippocampal neurons in auditory working memory and reference memory in the rat , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[94]  M. Leon,et al.  Conditioned tone control of brain reward behavior produces highly specific representational gain in the primary auditory cortex , 2009, Neurobiology of Learning and Memory.

[95]  Norman M. Weinberger,et al.  The level of cholinergic nucleus basalis activation controls the specificity of auditory associative memory , 2006, Neurobiology of Learning and Memory.

[96]  H. Read,et al.  Multiparametric auditory receptive field organization across five cortical fields in the albino rat. , 2007, Journal of neurophysiology.

[97]  M. Merzenich,et al.  Representation of the cochlear partition of the superior temporal plane of the macaque monkey. , 1973, Brain research.

[98]  Michael M Merzenich,et al.  Perceptual Learning Directs Auditory Cortical Map Reorganization through Top-Down Influences , 2006, The Journal of Neuroscience.

[99]  D. P. Phillips,et al.  Central auditory onset responses, and temporal asymmetries in auditory perception , 2002, Hearing Research.

[100]  Michael P. Kilgard,et al.  Cortical Map Plasticity Improves Learning but Is Not Necessary for Improved Performance , 2011, Neuron.

[101]  O. Hikosaka,et al.  Feature-Based Anticipation of Cues that Predict Reward in Monkey Caudate Nucleus , 2002, Neuron.

[102]  N. Weinberger,et al.  Cholinergic modulation of responses to single tones produces tone‐specific receptive field alterations in cat auditory cortex , 1990, Synapse.

[103]  M M Merzenich,et al.  Representation of cochlea within primary auditory cortex in the cat. , 1975, Journal of neurophysiology.

[104]  Norman M Weinberger,et al.  Increased lipolysis and altered lipid homeostasis protect γ-synuclein – null mutant mice from diet-induced obesity , 2013 .

[105]  P. Knight,et al.  Representation of the cochlea within the anterior auditory field (AAF) of the cat , 1977, Brain Research.

[106]  F. Morrell,et al.  Electrophysiological contributions to the neural basis of learning. , 1961, Physiological reviews.

[107]  J. Fritz,et al.  Rapid task-related plasticity of spectrotemporal receptive fields in primary auditory cortex , 2003, Nature Neuroscience.

[108]  J. Fritz,et al.  Adaptive changes in cortical receptive fields induced by attention to complex sounds. , 2007, Journal of neurophysiology.

[109]  N. Weinberger Auditory associative memory and representational plasticity in the primary auditory cortex , 2007, Hearing Research.

[110]  N. Schneiderman,et al.  Auditory cortex lesions prevent the extinction of Pavlovian differential heart rate conditioning to tonal stimuli in rabbits , 1989, Brain Research.

[111]  J. Bakin,et al.  Suprathreshold auditory cortex activation visualized by intrinsic signal optical imaging. , 1996, Cerebral cortex.

[112]  W. Schultz Book Review: Reward Signaling by Dopamine Neurons , 2001, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[113]  Xiaoqin Wang,et al.  Sustained firing in auditory cortex evoked by preferred stimuli , 2005, Nature.