Neural bases of food-seeking: Affect, arousal and reward in corticostriatolimbic circuits

[1]  P. Holland.  Relations between Pavlovian-instrumental transfer and reinforcer devaluation. , 2004, Journal of experimental psychology. Animal behavior processes.

[2]  D. Paré,et al.  Infralimbic cortex activation increases c-fos expression in intercalated neurons of the amygdala , 2005, Neuroscience.

[3]  E. Murray,et al.  Excitotoxic Lesions of the Amygdala Fail to Produce Impairment in Visual Learning for Auditory Secondary Reinforcement But Interfere with Reinforcer Devaluation Effects in Rhesus Monkeys , 1997, The Journal of Neuroscience.

[4]  S. Kiefer,et al.  The gustatory neocortex of the rat , 1982 .

[5]  B. Balleine,et al.  Motivational control of goal-directed action , 1994 .

[6]  J. Mirenowicz,et al.  Dissociation of Pavlovian and instrumental incentive learning under dopamine antagonists. , 2000, Behavioral neuroscience.

[7]  P. Calabresi,et al.  Long‐term Potentiation in the Striatum is Unmasked by Removing the Voltage‐dependent Magnesium Block of NMDA Receptor Channels , 1992, The European journal of neuroscience.

[8]  Christopher D. Adams,et al.  Instrumental Responding following Reinforcer Devaluation , 1981 .

[9]  A. Grace,et al.  Dopaminergic modulation of limbic and cortical drive of nucleus accumbens in goal-directed behavior , 2005, Nature Neuroscience.

[10]  B. Skinner,et al.  Principles of Behavior , 1944 .

[11]  A. Dickinson,et al.  Involvement of the central nucleus of the amygdala and nucleus accumbens core in mediating Pavlovian influences on instrumental behaviour , 2001, The European journal of neuroscience.

[12]  S. Klein,et al.  Handbook of contemporary learning theories , 2000 .

[13]  A. Dickinson,et al.  Omission Learning after Instrumental Pretraining , 1998 .

[14]  W. Schultz,et al.  Influence of expectation of different rewards on behavior-related neuronal activity in the striatum. , 2001, Journal of neurophysiology.

[15]  Nora D Volkow,et al.  Similarity Between Obesity and Drug Addiction as Assessed by Neurofunctional Imaging , 2004, Journal of addictive diseases.

[16]  E. Holman.  Some conditions for the dissociation of consummatory and instrumental behavior in rats , 1975 .

[17]  Nora D Volkow,et al.  The role of dopamine in motivation for food in humans: implications for obesity , 2002, Expert opinion on therapeutic targets.

[18]  J. Partridge,et al.  Plastic Control of Striatal Glutamatergic Transmission by Ensemble Actions of Several Neurotransmitters and Targets for Drugs of Abuse , 2003, Annals of the New York Academy of Sciences.

[19]  Christopher D. Adams,et al.  The Effect of the Instrumental Training Contingency on Susceptibility to Reinforcer Devaluation , 1983 .

[20]  E. Rolls,et al.  Sensory-specific and motivation-specific satiety for the sight and taste of food and water in man , 1983, Physiology & Behavior.

[21]  K. Berridge,et al.  Relation of consummatory responses and preabsorptive insulin release to palatability and learned taste aversions. , 1981, Journal of comparative and physiological psychology.

[22]  Thomas J. H. Chen,et al.  The Reward Deficiency Syndrome: A Biogenetic Model for the Diagnosis and Treatment of Impulsive, Addictive and Compulsive Behaviors , 2000, Journal of psychoactive drugs.

[23]  R. Reep,et al.  The associative striatum: Organization of cortical projections to the dorsocentral striatum in rats , 2003, The Journal of comparative neurology.

[24]  H. Groenewegen,et al.  The anatomical relationships of the prefrontal cortex with limbic structures and the basal ganglia , 1997, Journal of psychopharmacology.

[25]  P. Holland,et al.  Amygdalo-Hypothalamic Circuit Allows Learned Cues to Override Satiety and Promote Eating , 2002, The Journal of Neuroscience.

[26]  S. Smith‐Roe,et al.  Response-reinforcement learning is dependent on N-methyl-D-aspartate receptor activation in the nucleus accumbens core. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[27]  S. Woods,et al.  Food intake and the regulation of body weight. , 2000, Annual review of psychology.

[28]  B. Balleine,et al.  Cholecystokinin attenuates incentive learning in rats. , 1995, Behavioral neuroscience.

[29]  R. Rescorla,et al.  Two-process learning theory: Relationships between Pavlovian conditioning and instrumental learning. , 1967, Psychological review.

[30]  H. Groenewegen,et al.  Topographical organization and relationship with ventral striatal compartments of prefrontal corticostriatal projections in the rat , 1992, The Journal of comparative neurology.

[31]  R. Norgren,et al.  Activity in the hypothalamus, amygdala, and cortex generates bilateral and convergent modulation of pontine gustatory neurons. , 2004, Journal of neurophysiology.

[32]  S. Woods,et al.  Behavioral, endocrine, and hypothalamic responses to involuntary overfeeding. , 1996, The American journal of physiology.

[33]  A. Dickinson,et al.  Alcohol Seeking by Rats: Action or Habit? , 2002, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[34]  P R Killeen,et al.  Incentive theory. , 1982, Nebraska Symposium on Motivation. Nebraska Symposium on Motivation.

[35]  R. J. McDonald,et al.  A triple dissociation of memory systems: hippocampus, amygdala, and dorsal striatum. , 1993, Behavioral neuroscience.

[36]  T. Robbins,et al.  Limbic-Striatal Memory Systems and Drug Addiction , 2002, Neurobiology of Learning and Memory.

[37]  L. Squire,et al.  Structure and function of declarative and nondeclarative memory systems. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[38]  J. Wickens,et al.  A cellular mechanism of reward-related learning , 2001, Nature.

[39]  T. Powell,et al.  The connexions of the striatum and globus pallidus: synthesis and speculation. , 1971, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[40]  H. Groenewegen,et al.  Patterns of overlap and segregation between insular cortical, intermediodorsal thalamic and basal amygdaloid afferents in the nucleus accumbens of the rat , 1996, Neuroscience.

[41]  D. Comings,et al.  The D2 Dopamine Receptor Gene as a Determinant of Reward Deficiency Syndrome , 1996, Journal of the Royal Society of Medicine.

[42]  T. Yamamoto,et al.  Functional relations between the cortical gustatory area and the amygdala: Electrophysiological and behavioral studies in rats , 2004, Experimental Brain Research.

[43]  B. Balleine,et al.  The role of incentive learning in instrumental outcome revaluation by sensory-specific satiety , 1998 .

[44]  Leonard S. Zegans,et al.  Neurology and psychiatry : a meeting of minds , 1989 .

[45]  L. Swanson,et al.  Structural Evidence for Functional Domains in the Rat Hippocampus , 1996, Science.

[46]  T. Powley,et al.  Gastric satiation is volumetric, intestinal satiation is nutritive , 2004, Physiology & Behavior.

[47]  B. Balleine,et al.  Instrumental Outcome Devaluation is Attenuated by the Anti-emetic Ondansetron , 1995, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[48]  B. Balleine.  Asymmetrical Interactions between Thirst and Hunger in Pavlovian-Instrumental Transfer , 1994, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[49]  J. Hollerman,et al.  Involvement of basal ganglia and orbitofrontal cortex in goal-directed behavior. , 2000, Progress in brain research.

[50]  R. Wise,et al.  Dopamine and glutamate release in the nucleus accumbens and ventral tegmental area of rat following lateral hypothalamic self-stimulation , 2001, Neuroscience.

[51]  K. Nakano,et al.  Neural circuits and functional organization of the striatum , 2000, Journal of Neurology.

[52]  A. Dickinson,et al.  Pavlovian Processes in the Motivational Control of Instrumental Performance , 1987 .

[53]  G. E. Alexander,et al.  Parallel organization of functionally segregated circuits linking basal ganglia and cortex. , 1986, Annual review of neuroscience.

[54]  C. L. Hull.  Principles of Behavior , 1945 .

[55]  B. Balleine,et al.  Lesions of mediodorsal thalamus and anterior thalamic nuclei produce dissociable effects on instrumental conditioning in rats , 2003, The European journal of neuroscience.

[56]  N. White,et al.  Parallel Information Processing in the Dorsal Striatum: Relation to Hippocampal Function , 1999, The Journal of Neuroscience.

[57]  P. Holland,et al.  Double dissociation of the effects of lesions of basolateral and central amygdala on conditioned stimulus‐potentiated feeding and Pavlovian‐instrumental transfer , 2003, The European journal of neuroscience.

[58]  B. Balleine,et al.  Goal-directed instrumental action: contingency and incentive learning and their cortical substrates , 1998, Neuropharmacology.

[59]  J. D. McGaugh,et al.  Inactivation of Hippocampus or Caudate Nucleus with Lidocaine Differentially Affects Expression of Place and Response Learning , 1996, Neurobiology of Learning and Memory.

[60]  P. Holland,et al.  The effects of amygdala lesions on conditioned stimulus-potentiated eating in rats , 2002, Physiology & Behavior.

[61]  W M Baum,et al.  The correlation-based law of effect. , 1973, Journal of the experimental analysis of behavior.

[62]  K. Berridge,et al.  Pimozide Does Not Shift Palatability: Separation of Anhedonia from Sensorimotor Suppression by Taste Reactivity , 1997, Pharmacology Biochemistry and Behavior.

[63]  D. Bernstein.  Response structure and organization , 1982 .

[64]  Joseph E LeDoux,et al.  Reply — reconsolidation: The labile nature of consolidation theory , 2000, Nature Reviews Neuroscience.

[65]  C. Gallistel.  The role of the dopaminergic projections in MFB self-stimulation , 1986, Behavioural Brain Research.

[66]  B. Balleine,et al.  The Role of the Nucleus Accumbens in Instrumental Conditioning: Evidence of a Functional Dissociation between Accumbens Core and Shell , 2001, The Journal of Neuroscience.

[67]  H Eichenbaum,et al.  Functional organization of the hippocampal memory system. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[68]  Jean Logan,et al.  Brain dopamine and obesity , 2001, The Lancet.

[69]  A. Damasio.  The somatic marker hypothesis and the possible functions of the prefrontal cortex. , 1996, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[70]  B. Balleine,et al.  Double Dissociation of Basolateral and Central Amygdala Lesions on the General and Outcome-Specific Forms of Pavlovian-Instrumental Transfer , 2005, The Journal of Neuroscience.

[71]  B. Balleine,et al.  Lesions of Medial Prefrontal Cortex Disrupt the Acquisition But Not the Expression of Goal-Directed Learning , 2005, The Journal of Neuroscience.

[72]  K. Berridge.  Measuring hedonic impact in animals and infants: microstructure of affective taste reactivity patterns , 2000, Neuroscience & Biobehavioral Reviews.

[73]  G. Quirk,et al.  Electrical stimulation of medial prefrontal cortex reduces conditioned fear in a temporally specific manner. , 2004, Behavioral neuroscience.

[74]  B. Balleine,et al.  The Effect of Lesions of the Insular Cortex on Instrumental Conditioning: Evidence for a Role in Incentive Memory , 2000, The Journal of Neuroscience.

[75]  B. Balleine,et al.  Role of cholecystokinin in the motivational control of instrumental action in rats. , 1994, Behavioral neuroscience.

[76]  W. Nauta.  Reciprocal Links of the Corpus striatum with the Cerebral Cortex and Limbic System: A Common Substrate for Movement and Thought? , 1993 .

[77]  D. Comings,et al.  Association of polymorphisms of dopamine D2 receptor (DRD2), and dopamine transporter (DAT1) genes with schizoid/avoidant behaviors (SAB) , 1997, Molecular Psychiatry.

[78]  B. Balleine,et al.  The Effect of Lesions of the Basolateral Amygdala on Instrumental Conditioning , 2003, The Journal of Neuroscience.

[79]  G. Koob.  Neural Mechanisms of Drug Reinforcement a , 1992, Annals of the New York Academy of Sciences.

[80]  J. Mirenowicz,et al.  Dissociation of Pavlovian and instrumental incentive learning under dopamine antagonists. , 2000, Behavioral neuroscience.

[81]  R. Rescorla,et al.  Associations between the discriminative stimulus and the reinforcer in instrumental learning. , 1988 .

[82]  B. Balleine,et al.  Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning , 2004, The European journal of neuroscience.

[83]  J. Cornwell.  Consciousness and human identity , 1998 .

[84]  B. Levin.  Arcuate NPY neurons and energy homeostasis in diet-induced obese and resistant rats. , 1999, The American journal of physiology.

[85]  B. Balleine,et al.  The role of prelimbic cortex in instrumental conditioning , 2003, Behavioural Brain Research.

[86]  L. S. Kogan.  Review of Principles of Behavior. , 1943 .

[87]  A. Kelley,et al.  Central amygdalar and dorsal striatal NMDA receptor involvement in instrumental learning and spontaneous behavior. , 2004, Behavioral neuroscience.

[88]  A. Dickinson,et al.  Reinforcer specificity of the suppression of instrumental performance on a non-contingent schedule , 1989, Behavioural Processes.

[89]  A. Kelley.  Ventral striatal control of appetitive motivation: role in ingestive behavior and reward-related learning , 2004, Neuroscience & Biobehavioral Reviews.

[90]  T. Robbins,et al.  The basolateral amygdala-ventral striatal system and conditioned place preference: Further evidence of limbic-striatal interactions underlying reward-related processes , 1991, Neuroscience.

[91]  H. Groenewegen.  The Basal Ganglia and Motor Control , 2003, Neural plasticity.

[92]  George V Rebec,et al.  Behavior-related changes in the activity of substantia nigra pars reticulata neurons in freely moving rats , 1999, Brain Research.

[93]  P. Strick,et al.  Macro-architecture of basal ganglia loops with the cerebral cortex: use of rabies virus to reveal multisynaptic circuits. , 2004, Progress in brain research.

[94]  Barry Setlow,et al.  The basolateral complex of the amygdala is necessary for acquisition but not expression of CS motivational value in appetitive Pavlovian second‐order conditioning , 2002, The European journal of neuroscience.

[95]  Yu-Shin Ding,et al.  Brain dopamine is associated with eating behaviors in humans. , 2003, The International journal of eating disorders.

[96]  Terry Winograd,et al.  FRAME REPRESENTATIONS AND THE DECLARATIVE/PROCEDURAL CONTROVERSY , 1975 .

[97]  B. Balleine,et al.  The Role of the Hippocampus in Instrumental Conditioning , 2000, The Journal of Neuroscience.

[98]  Robert J. McDonald,et al.  Acquisition of a spatial conditioned place preference is impaired by amygdala lesions and improved by fornix lesions , 1993, Behavioural Brain Research.

[99]  V. Routh,et al.  The regulation of glucose-excited neurons in the hypothalamic arcuate nucleus by glucose and feeding-relevant peptides. , 2004, Diabetes.

[100]  W. Nauta,et al.  The amygdalostriatal projection in the rat—an anatomical study by anterograde and retrograde tracing methods , 1982, Neuroscience.

[101]  K. Berridge,et al.  Intra-Accumbens Amphetamine Increases the Conditioned Incentive Salience of Sucrose Reward: Enhancement of Reward “Wanting” without Enhanced “Liking” or Response Reinforcement , 2000, The Journal of Neuroscience.

[102]  B. Williams.  The effects of response contingency and reinforcement identity on response suppression by alternative reinforcement , 1989 .

[103]  B. Balleine,et al.  The role of the dorsomedial striatum in instrumental conditioning , 2005, The European journal of neuroscience.

[104]  Paul Leonard Gabbott,et al.  Differences in the laminar origin of projections from the medial prefrontal cortex to the nucleus accumbens shell and core regions in the rat , 2001, Brain Research.

[105]  B. Everitt,et al.  Neural and psychological mechanisms underlying appetitive learning: links to drug addiction , 2004, Current Opinion in Neurobiology.

[106]  J. D. A. M. E. Bitierman.  OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR DIFFERENTIAL REINFORCEMENT OF OTHER BEHAVIOR ( DRO ) : A YOKED-CONTROL COMPARISON ' , 2005 .

[107]  L. J. Hammond.  The effect of contingency upon the appetitive conditioning of free-operant behavior. , 1980, Journal of the experimental analysis of behavior.

[108]  C. Davis,et al.  Sensitivity to reward: implications for overeating and overweight , 2004, Appetite.

[109]  Kent C. Berridge,et al.  Modulation of taste affect by hunger, caloric satiety, and sensory-specific satiety in the rat , 1991, Appetite.

[110]  W. Estes.  Discriminative conditioning; effects of a Pavlovian conditioned stimulus upon a subsequently established operant response. , 1948, Journal of experimental psychology.

[111]  L. Squire.  "Memory and the hippocampus: A synthesis from findings with rats, monkeys, and humans": Correction. , 1992 .

[112]  B. Balleine,et al.  Consciousness—the interface between affect and cognition , 1998 .

[113]  Jeffery R Wickens,et al.  Inhibitory interactions between spiny projection neurons in the rat striatum. , 2002, Journal of neurophysiology.

[114]  I. Q. Wishaw,et al.  THE BEHAVIOR OF THE LABORATORY RAT A Handbook with Tests , 2004 .

[115]  L. Jarrard,et al.  The hippocampus and motivation revisited: appetite and activity , 2001, Behavioural Brain Research.

[116]  B. Balleine,et al.  Consolidation and Reconsolidation of Incentive Learning in the Amygdala , 2005, The Journal of Neuroscience.

[117]  K. Sripanidkulchai,et al.  The cortical projection of the basolateral amygdaloid nucleus in the rat: A retrograde fluorescent dye study , 1984, The Journal of comparative neurology.

[118]  B. Balleine,et al.  Benzodiazepine-induced outcome revaluation and the motivational control of instrumental action in rats. , 1994, Behavioral neuroscience.

[119]  O. Hikosaka,et al.  Expectation of reward modulates cognitive signals in the basal ganglia , 1998, Nature Neuroscience.

[120]  W. G. Hall,et al.  Evidence that appetitive responses for dehydration and food-deprivation are learned , 2002, Physiology & Behavior.

[121]  L. Swanson.  The Amygdala and Its Place in the Cerebral Hemisphere , 2003, Annals of the New York Academy of Sciences.

[122]  B. Balleine,et al.  Instrumental and Pavlovian incentive processes have dissociable effects on components of a heterogeneous instrumental chain. , 2003, Journal of experimental psychology. Animal behavior processes.

[123]  K. Berridge,et al.  Incentive Sensitization by Previous Amphetamine Exposure: Increased Cue-Triggered “Wanting” for Sucrose Reward , 2001, The Journal of Neuroscience.

[124]  B. Balleine,et al.  Sensitivity to Instrumental Contingency Degradation Is Mediated by the Entorhinal Cortex and Its Efferents via the Dorsal Hippocampus , 2002, The Journal of Neuroscience.

[125]  R. Colwill,et al.  Encoding of the unconditioned stimulus in Pavlovian conditioning , 1994 .

[126]  R. Rescorla,et al.  Associative Structures In Instrumental Learning , 1986 .

[127]  B. Balleine.  Instrumental performance following a shift in primary motivation depends on incentive learning. , 1992, Journal of experimental psychology. Animal behavior processes.

[128]  P. Holland,et al.  Neurotoxic Lesions of Basolateral, But Not Central, Amygdala Interfere with Pavlovian Second-Order Conditioning and Reinforcer Devaluation Effects , 1996, The Journal of Neuroscience.

[129]  A. Dickinson,et al.  Oral cocaine seeking by rats: action or habit? , 2003, Behavioral neuroscience.

[130]  L. Jarrard,et al.  The hippocampus and inhibitory learning: a ‘Gray’ area? , 2004, Neuroscience & Biobehavioral Reviews.

[131]  A. Mcgeorge,et al.  The organization of the projection from the cerebral cortex to the striatum in the rat , 1989, Neuroscience.

[132]  S. Killcross,et al.  Coordination of actions and habits in the medial prefrontal cortex of rats. , 2003, Cerebral cortex.

[133]  J. Konorski.  Integrative activity of the brain , 1967 .

[134]  Karim Nader,et al.  Memory consolidation of Pavlovian fear conditioning: a cellular and molecular perspective , 2001, Trends in Neurosciences.

[135]  E. Kiyatkin.  Dopamine in the nucleus accumbens: cellular actions, drug- and behavior-associated fluctuations, and a possible role in an organism's adaptive activity , 2002, Behavioural Brain Research.

[136]  D. Ramsay,et al.  Pavlovian influences over food and drug intake , 2000, Behavioural Brain Research.

[137]  Barry Setlow,et al.  Disconnection of the basolateral amygdala complex and nucleus accumbens impairs appetitive pavlovian second-order conditioned responses. , 2002, Behavioral neuroscience.

[138]  T. Davidson,et al.  A Pavlovian approach to the problem of obesity , 2004, International Journal of Obesity.

[139]  J. Bureš,et al.  Differential involvement of gustatory insular cortex and amygdala in the acquisition and retrieval of conditioned taste aversion in rats , 1992, Behavioural Brain Research.

[140]  K. Berridge,et al.  What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? , 1998, Brain Research Reviews.

[141]  B. Balleine,et al.  Blockade of NMDA receptors in the dorsomedial striatum prevents action–outcome learning in instrumental conditioning , 2005, The European journal of neuroscience.

[142]  Joaquín M. Fuster,et al.  Executive frontal functions , 2000, Experimental Brain Research.

[143]  B. Balleine,et al.  The Role of Learning in the Operation of Motivational Systems , 2002 .