Lesions of the nucleus accumbens disrupt reinforcement omission effects in rats

The reinforcement omission effects (ROEs) have been attributed to both motivational and attentional consequences of the surprising reinforcement omission. Some studies have been showed amygdala is part of a circuit involved in the ROEs modulation. The view that amygdala lesions interfere with the ROEs is supported by evidence involving amygdala in responses correlated with motivational processes. These processes depend on the operation of separate amygdala areas and their connections with other brain systems. It has been suggested the interaction between the amygdala and the nucleus accumbens (NAC) is important to the modulation of motivational processes. Recent neuroimaging studies in human revealed reward delivery enhances activity of subcortical structures (NAC and amygdala), whereas reward omission reduces the activity in these same structures. The present study aimed to clarify whether the mechanisms related to ROEs depend on NAC. Prior to acquisition training, rats received bilateral excitotoxic lesions of NAC (NAC group) or sham lesions (Sham group). Following postoperative recovery, the rats were trained on a fixed-interval with limited hold signaled schedule of reinforcement. After acquisition of stable performance, the training was changed from 100% to 50% schedule of reinforcement. Both NAC and Sham groups presented the ROEs. However, after nonreinforcement, the response rates of the NAC group were lower than those registered in the Sham group. The performance of the NAC group decreased in the period following nonreinforcement when compared to the period preceding reinforcement omission. These findings suggest the NAC is part of the neural substrate involved in the ROEs modulation.

[1]  B. Balleine,et al.  Parallel incentive processing: an integrated view of amygdala function , 2006, Trends in Neurosciences.

[2]  Wolfgang Hauber,et al.  The rat nucleus accumbens is involved in guiding of instrumental responses by stimuli predicting reward magnitude , 2003, The European journal of neuroscience.

[3]  A. Farrar,et al.  Nucleus accumbens lesions decrease sensitivity to rapid changes in the delay to reinforcement , 2006, Behavioural Brain Research.

[4]  M. Papini.  Comparative Psychology of Surprising Nonreward , 2003, Brain, Behavior and Evolution.

[5]  P. Henke,et al.  Lesions in the amygdala and the frustration effect. , 1973, Physiology & behavior.

[6]  Brian Knutson,et al.  Dissociation of reward anticipation and outcome with event-related fMRI , 2001, Neuroreport.

[7]  E. Rolls,et al.  Abstract reward and punishment representations in the human orbitofrontal cortex , 2001, Nature Neuroscience.

[8]  T. F. Tavares,et al.  Role of the amygdala in the reinforcement omission effect , 2012 .

[9]  Fixed-interval limited-hold avoidance with and without signalled reinforcement. , 1972, Journal of the experimental analysis of behavior.

[10]  J. Deakin,et al.  Effect of quinolinic acid-induced lesions of the nucleus accumbens core on performance on a progressive ratio schedule of reinforcement: implications for inter-temporal choice , 2008, Psychopharmacology.

[11]  T. Robbins,et al.  The effects of ibotenic acid lesions of the nucleus accumbens on spatial learning and extinction in the rat , 1989, Behavioural Brain Research.

[12]  Inga L. Kröger,et al.  Indices of extinction-induced “depression” after operant learning using a runway vs. a cued free-reward delivery schedule , 2012, Neurobiology of Learning and Memory.

[13]  P. Holland,et al.  Dissociation of attention in learning and action: effects of lesions of the amygdala central nucleus, medial prefrontal cortex, and posterior parietal cortex. , 2007, Behavioral neuroscience.

[14]  F. Manning,et al.  The effects of lesions in amygdala or dorsomedial frontal cortex on reinforcement omission and noncontingent reinforcement in rats. , 1979 .

[15]  Basolateral amygdala lesions do not prevent memory of context-footshock training. , 2003, Learning & memory.

[16]  R. Cardinal,et al.  Nucleus accumbens core lesions retard instrumental learning and performance with delayed reinforcement in the rat , 2005, BMC Neuroscience.

[17]  T. Robbins,et al.  Impulsive Choice Induced in Rats by Lesions of the Nucleus Accumbens Core , 2001, Science.

[18]  P. Henke.  Dissociation of the frustration effect and the partial reinforcement extinction effect after limbic lesions in rats. , 1977 .

[19]  T. F. Tavares,et al.  Involvement of the basolateral complex and central nucleus of amygdala in the omission effects of different magnitudes of reinforcement , 2012, Behavioural Brain Research.

[20]  J. Huston,et al.  Toward an animal model of extinction-induced despair: focus on aging and physiological indices , 2009, Journal of Neural Transmission.

[21]  J. Huston,et al.  Animal models of extinction-induced depression: Loss of reward and its consequences , 2013, Neuroscience & Biobehavioral Reviews.

[22]  D. Kahneman,et al.  Functional Imaging of Neural Responses to Expectancy and Experience of Monetary Gains and Losses tasks with monetary payoffs , 2001 .

[23]  Gary H. Glover,et al.  Sensitivity of the nucleus accumbens to violations in expectation of reward , 2007, NeuroImage.

[24]  A. Amsel,et al.  Motivational properties of frustration. I. Effect on a running response of the addition of frustration to the motivational complex. , 1952, Journal of experimental psychology.

[25]  W. Hauber,et al.  Involvement of NMDA and AMPA/KA receptors in the nucleus accumbens core in instrumental learning guided by reward‐predictive cues , 2005, The European journal of neuroscience.

[26]  J. Huston,et al.  Antidepressants reduce extinction-induced withdrawal and biting behaviors: a model for depressive-like behavior , 2012, Neuroscience.

[27]  Douglas L. Jones,et al.  From motivation to action: Functional interface between the limbic system and the motor system , 1980, Progress in Neurobiology.

[28]  James L McGaugh,et al.  Glucocorticoid Effects on Memory Consolidation Depend on Functional Interactions between the Medial Prefrontal Cortex and Basolateral Amygdala , 2009, The Journal of Neuroscience.

[29]  G. E. Alexander,et al.  Basal ganglia-thalamocortical circuits: parallel substrates for motor, oculomotor, "prefrontal" and "limbic" functions. , 1990, Progress in brain research.

[30]  B. Everitt,et al.  The contribution of the amygdala, nucleus accumbens, and prefrontal cortex to emotion and motivated behaviour , 2003 .

[31]  E. Murray,et al.  The amygdala and reward , 2002, Nature Reviews Neuroscience.

[32]  P. Holland,et al.  Amygdala circuitry in attentional and representational processes , 1999, Trends in Cognitive Sciences.

[33]  L. Nystrom,et al.  Tracking the hemodynamic responses to reward and punishment in the striatum. , 2000, Journal of neurophysiology.

[34]  Influence of the reinforcement magnitude on omission effects , 2011, Behavioural Processes.

[35]  Joseph E LeDoux.  Emotion Circuits in the Brain , 2000 .

[36]  M. MacDonald,et al.  Reversal of a full-length mutant huntingtin neuronal cell phenotype by chemical inhibitors of polyglutamine-mediated aggregation , 2005, BMC Neuroscience.

[37]  M. Papini,et al.  Consequences of Surprising Reward Omissions , 1997 .

[38]  J. D. McGaugh,et al.  Basolateral Amygdala–Nucleus Accumbens Interactions in Mediating Glucocorticoid Enhancement of Memory Consolidation , 2001, The Journal of Neuroscience.

[39]  José Lino Oliveira Bueno,et al.  Neurobiologia dos efeitos de expectativa e omissão de reforço sobre o comportamento , 2013 .

[40]  R. B. Jones,et al.  The role of prefeeding in an apparent frustration effect. , 1957, Journal of experimental psychology.

[41]  J. Staddon.  Temporal control, attention, and memory. , 1974 .

[42]  J. O'Doherty,et al.  Reward representations and reward-related learning in the human brain: insights from neuroimaging , 2004, Current Opinion in Neurobiology.