Neural substrates of cognitive inflexibility after chronic cocaine exposure

Cognitive changes in addicts and animals exposed to addictive drugs have been extensively investigated over the past decades. One advantage of studying addiction using cognitive paradigms is that neural processing in addicts or drug-exposed animals can be compared to that in normal subjects. Tests of cognitive flexibility that measure the ability to change responding to a previously rewarded or punished stimulus are of potential interest in the study of addiction, because addiction can itself be viewed as an inability to change responding to stimuli previously associated with drug reward. One such test is reversal learning, which is impaired in cocaine addicts and animals that have chronically self-administered or been exposed to cocaine. A circuit including orbitofrontal cortex, basolateral amygdala and striatum subserves reversal learning. In rats that have been previously exposed to cocaine, neurons in these regions show selective and distinct changes in how they encode information during reversal learning. These changes suggest that in these rats, orbitofrontal cortex loses the ability to signal expected outcomes, and basolateral amygdala becomes inflexible in its encoding of cue significance. These changes could explain cocaine-induced impairments to cognitive flexibility and may have theoretical importance in addiction.

[1]  H. Yin,et al.  The role of the basal ganglia in habit formation , 2006, Nature Reviews Neuroscience.

[2]  G. Schoenbaum,et al.  Encoding Predicted Outcome and Acquired Value in Orbitofrontal Cortex during Cue Sampling Depends upon Input from Basolateral Amygdala , 2003, Neuron.

[3]  H. Teitelbaum A COMPARISON OF EFFECTS OF ORBITOFRONTAL AND HIPPOCAMPAL LESIONS UPON DISCRIMINATION LEARNING AND REVERSAL IN THE CAT. , 1964, Experimental neurology.

[4]  Tomoyuki Furuyashiki,et al.  Rat Orbitofrontal Cortex Separately Encodes Response and Outcome Information during Performance of Goal-Directed Behavior , 2008, The Journal of Neuroscience.

[5]  Lin Lu,et al.  Cocaine seeking over extended withdrawal periods in rats: different time courses of responding induced by cocaine cues versus cocaine priming over the first 6 months , 2004, Psychopharmacology.

[6]  M. Roesch,et al.  Neuronal activity in primate orbitofrontal cortex reflects the value of time. , 2005, Journal of neurophysiology.

[7]  G. Schoenbaum,et al.  Orbitofrontal Cortex and Representation of Incentive Value in Associative Learning , 1999, The Journal of Neuroscience.

[8]  Steven W Anderson,et al.  Decision-making deficits, linked to a dysfunctional ventromedial prefrontal cortex, revealed in alcohol and stimulant abusers , 2001, Neuropsychologia.

[9]  B. Everitt,et al.  Disrupting Reconsolidation of Drug Memories Reduces Cocaine-Seeking Behavior , 2005, Neuron.

[10]  B. Everitt,et al.  Cocaine Seeking Habits Depend upon Dopamine-Dependent Serial Connectivity Linking the Ventral with the Dorsal Striatum , 2008, Neuron.

[11]  JaneR . Taylor,et al.  Impulsivity resulting from frontostriatal dysfunction in drug abuse: implications for the control of behavior by reward-related stimuli , 1999, Psychopharmacology.

[12]  M. Roesch,et al.  Cocaine Exposure Shifts the Balance of Associative Encoding from Ventral to Dorsolateral Striatum , 2007, Frontiers in integrative neuroscience.

[13]  J S Fowler,et al.  Changes in brain glucose metabolism in cocaine dependence and withdrawal. , 1991, The American journal of psychiatry.

[14]  M. Mishkin,et al.  Effects of orbital frontal and anterior cingulate lesions on object and spatial memory in rhesus monkeys , 1997, Neuropsychologia.

[15]  J. Price,et al.  Effects of excitotoxic lesions in the ventral striatopallidal–thalamocortical pathway on odor reversal learning: inability to extinguish an incorrect response , 2000, Experimental Brain Research.

[16]  J. O'Doherty,et al.  Encoding Predictive Reward Value in Human Amygdala and Orbitofrontal Cortex , 2003, Science.

[17]  G. Schoenbaum,et al.  Neural Encoding in Orbitofrontal Cortex and Basolateral Amygdala during Olfactory Discrimination Learning , 1999, The Journal of Neuroscience.

[18]  R. See,et al.  Differential Contributions of the Basolateral and Central Amygdala in the Acquisition and Expression of Conditioned Relapse to Cocaine-Seeking Behavior , 2001, The Journal of Neuroscience.

[19]  T. Robbins,et al.  Drug addiction: bad habits add up , 1999, Nature.

[20]  F. Weiss,et al.  Stimuli associated with a single cocaine experience elicit long-lasting cocaine-seeking , 2004, Nature Neuroscience.

[21]  T. Robbins,et al.  Dissociation in prefrontal cortex of affective and attentional shifts , 1996, Nature.

[22]  S. J. Gatley,et al.  Decreased striatal dopaminergic responsiveness in detoxified cocaine-dependent subjects , 1997, Nature.

[23]  Peter Olausson,et al.  Impairments of Reversal Learning and Response Perseveration after Repeated, Intermittent Cocaine Administrations to Monkeys , 2002, Neuropsychopharmacology.

[24]  A. Leshner Addiction is a brain disease, and it matters. , 1997, Science.

[25]  G. Schoenbaum,et al.  Basolateral Amygdala Lesions Abolish Orbitofrontal-Dependent Reversal Impairments , 2007, Neuron.

[26]  R. A. Fuchs,et al.  The role of the basolateral amygdala in stimulus–reward memory and extinction memory consolidation and in subsequent conditioned cued reinstatement of cocaine seeking , 2006, The European journal of neuroscience.

[27]  J. Morton,et al.  Choosing the Lesser of Two Evils, the Better of Two Goods: Specifying the Roles of Ventromedial Prefrontal Cortex and Dorsal Anterior Cingulate in Object Choice , 2006, The Journal of Neuroscience.

[28]  Trevor W Robbins,et al.  Investigating the neurocognitive deficits associated with chronic drug misuse , 2001, Current Opinion in Neurobiology.

[29]  J. Fuster,et al.  Reactivity of limbic neurons of the monkey to appetitive and aversive signals. , 1971, Electroencephalography and clinical neurophysiology.

[30]  Joseph E LeDoux,et al.  Fear conditioning enhances short-latency auditory responses of lateral amygdala neurons: Parallel recordings in the freely behaving rat , 1995, Neuron.

[31]  R. A. Fuchs,et al.  Muscarinic receptor antagonism in the basolateral amygdala blocks acquisition of cocaine-stimulus association in a model of relapse to cocaine-seeking behavior in rats , 2003, Neuroscience.

[32]  B. Everitt,et al.  Behavioral and neural mechanisms of compulsive drug seeking. , 2005, European journal of pharmacology.

[33]  F. Weiss,et al.  Enduring Resistance to Extinction of Cocaine-Seeking Behavior Induced by Drug-Related Cues , 2001, Neuropsychopharmacology.

[34]  J. M. Warren,et al.  THE FRONTAL GRANULAR CORTEX AND BEHAVIOR , 1964 .

[35]  B. Balleine,et al.  Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning , 2004, The European journal of neuroscience.

[36]  R. Carelli,et al.  Basolateral Amygdala Neurons Encode Cocaine Self-Administration and Cocaine-Associated Cues , 2003, The Journal of Neuroscience.

[37]  T. Robinson Addicted Rats , 2004, Science.

[38]  M. Roesch,et al.  Previous Cocaine Exposure Makes Rats Hypersensitive to Both Delay and Reward Magnitude , 2007, The Journal of Neuroscience.

[39]  T. Robbins,et al.  Neural systems of reinforcement for drug addiction: from actions to habits to compulsion , 2005, Nature Neuroscience.

[40]  E. Rolls,et al.  Orbitofrontal cortex neurons: role in olfactory and visual association learning. , 1996, Journal of neurophysiology.

[41]  H. Nishijo,et al.  Rat amygdaloid neuron responses during auditory discrimination , 1993, Neuroscience.

[42]  K. Brady,et al.  Impulsivity and rapid discounting of delayed hypothetical rewards in cocaine-dependent individuals. , 2003, Experimental and clinical psychopharmacology.

[43]  E. Murray,et al.  Bilateral Orbital Prefrontal Cortex Lesions in Rhesus Monkeys Disrupt Choices Guided by Both Reward Value and Reward Contingency , 2004, The Journal of Neuroscience.

[44]  Geoffrey Schoenbaum,et al.  Rapid Associative Encoding in Basolateral Amygdala Depends on Connections with Orbitofrontal Cortex , 2005, Neuron.

[45]  J S Fowler,et al.  Low level of brain dopamine D2 receptors in methamphetamine abusers: association with metabolism in the orbitofrontal cortex. , 2001, The American journal of psychiatry.

[46]  W. Schultz,et al.  Relative reward preference in primate orbitofrontal cortex , 1999, Nature.

[47]  J. O'Doherty,et al.  Neural Responses during Anticipation of a Primary Taste Reward , 2002, Neuron.

[48]  Geoffrey Schoenbaum,et al.  Different Roles for Orbitofrontal Cortex and Basolateral Amygdala in a Reinforcer Devaluation Task , 2003, The Journal of Neuroscience.

[49]  Carlo Contoreggi,et al.  Drug abusers show impaired performance in a laboratory test of decision making , 2000, Neuropsychologia.

[50]  David Belin,et al.  Evidence for Addiction-like Behavior in the Rat , 2004, Science.

[51]  Wolfgang Hauber,et al.  Orbital prefrontal cortex and guidance of instrumental behaviour in rats under reversal conditions , 2003, Behavioural Brain Research.

[52]  Geoffrey Schoenbaum,et al.  Lesions of orbitofrontal cortex and basolateral amygdala complex disrupt acquisition of odor-guided discriminations and reversals. , 2003, Learning & memory.

[53]  J. Metcalfe,et al.  Neural Systems and Cue-Induced Cocaine Craving , 2002, Neuropsychopharmacology.

[54]  E. Rolls,et al.  Emotion-related learning in patients with social and emotional changes associated with frontal lobe damage. , 1994, Journal of neurology, neurosurgery, and psychiatry.

[55]  D Bindra,et al.  Responses of amygdala single units to odors in the rat. , 1972, Experimental neurology.

[56]  F. Weiss,et al.  Cocaine-predictive stimulus induces drug-seeking behavior and neural activation in limbic brain regions after multiple months of abstinence: reversal by D(1) antagonists. , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[57]  G. Chiara Drug addiction as dopamine-dependent associative learning disorder , 1999 .

[58]  E. Rolls,et al.  Visual responses of neurons in the dorsolateral amygdala of the alert monkey , 1979, Experimental Neurology.

[59]  E T Rolls,et al.  Olfactory neuronal responses in the primate orbitofrontal cortex: analysis in an olfactory discrimination task. , 1996, Journal of neurophysiology.

[60]  Seth J. Ramus,et al.  Cocaine‐experienced rats exhibit learning deficits in a task sensitive to orbitofrontal cortex lesions , 2004, The European journal of neuroscience.

[61]  N. Volkow,et al.  Cocaine Cues and Dopamine in Dorsal Striatum: Mechanism of Craving in Cocaine Addiction , 2006, The Journal of Neuroscience.

[62]  S. Mizumori,et al.  Role of the dorsomedial striatum in behavioral flexibility for response and visual cue discrimination learning. , 2002, Behavioral neuroscience.

[63]  K. Berridge,et al.  The neural basis of drug craving: An incentive-sensitization theory of addiction , 1993, Brain Research Reviews.

[64]  Jerald D. Kralik,et al.  Rhesus monkeys with orbital prefrontal cortex lesions can learn to inhibit prepotent responses in the reversed reward contingency task. , 2006, Cerebral cortex.

[65]  Geoffrey Schoenbaum,et al.  The Role of Orbitofrontal Cortex in Drug Addiction: A Review of Preclinical Studies , 2008, Biological Psychiatry.

[66]  J S Fowler,et al.  Association of methylphenidate-induced craving with changes in right striato-orbitofrontal metabolism in cocaine abusers: implications in addiction. , 1999, The American journal of psychiatry.

[67]  S. Thorpe,et al.  The orbitofrontal cortex: Neuronal activity in the behaving monkey , 2004, Experimental Brain Research.

[68]  S. Killcross,et al.  Amphetamine Exposure Enhances Habit Formation , 2006, The Journal of Neuroscience.

[69]  Stephen Maren,et al.  Auditory fear conditioning increases CS‐elicited spike firing in lateral amygdala neurons even after extensive overtraining , 2000, The European journal of neuroscience.

[70]  H Nishijo,et al.  Single neuron responses in amygdala of alert monkey during complex sensory stimulation with affective significance , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[71]  Geoffrey Schoenbaum,et al.  Orbitofrontal lesions in rats impair reversal but not acquisition of go, no-go odor discriminations , 2002, Neuroreport.

[72]  K. Berridge,et al.  Intra-Accumbens Amphetamine Increases the Conditioned Incentive Salience of Sucrose Reward: Enhancement of Reward “Wanting” without Enhanced “Liking” or Response Reinforcement , 2000, The Journal of Neuroscience.

[73]  B. Everitt,et al.  Drug Seeking Becomes Compulsive After Prolonged Cocaine Self-Administration , 2004, Science.

[74]  T. Robbins,et al.  Chronic cocaine but not chronic amphetamine use is associated with perseverative responding in humans , 2008, Psychopharmacology.

[75]  R. Dolan,et al.  The human amygdala and orbital prefrontal cortex in behavioural regulation , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[76]  A. Roberts,et al.  Primate orbitofrontal cortex and adaptive behaviour , 2006, Trends in Cognitive Sciences.

[77]  M. Roesch,et al.  Abnormal associative encoding in orbitofrontal neurons in cocaine‐experienced rats during decision‐making , 2006, The European journal of neuroscience.

[78]  A. Kelley Memory and Addiction Shared Neural Circuitry and Molecular Mechanisms , 2004, Neuron.

[79]  B. Everitt,et al.  Cue-Induced Cocaine Seeking and Relapse Are Reduced by Disruption of Drug Memory Reconsolidation , 2006, The Journal of Neuroscience.

[80]  M. Roesch,et al.  Neuronal Activity Related to Reward Value and Motivation in Primate Frontal Cortex , 2004, Science.

[81]  M. Reivich,et al.  Limbic activation during cue-induced cocaine craving. , 1999, The American journal of psychiatry.

[82]  M. Roesch,et al.  Encoding of Time-Discounted Rewards in Orbitofrontal Cortex Is Independent of Value Representation , 2006, Neuron.

[83]  M. Roesch,et al.  Orbitofrontal cortex, decision-making and drug addiction , 2006, Trends in Neurosciences.

[84]  Bryan Kolb,et al.  Structural plasticity associated with exposure to drugs of abuse , 2004, Neuropharmacology.

[85]  F. Weiss Neurobiology of craving, conditioned reward and relapse. , 2005, Current opinion in pharmacology.

[86]  G. Schoenbaum,et al.  Neural Encoding in Ventral Striatum during Olfactory Discrimination Learning , 2003, Neuron.

[87]  Masataka Watanabe,et al.  Long‐ and short‐range reward expectancy in the primate orbitofrontal cortex , 2004, The European journal of neuroscience.

[88]  M. Fillmore,et al.  Polydrug abusers display impaired discrimination-reversal learning in a model of behavioural control , 2006, Journal of psychopharmacology.

[89]  M. Roesch,et al.  Cocaine-induced decision-making deficits are mediated by miscoding in basolateral amygdala , 2007, Nature Neuroscience.

[90]  Hisao Nishijo,et al.  Neuronal responses of the rat amygdala during extinction and reassociation learning in elementary and configural associative tasks , 2002, The European journal of neuroscience.

[91]  J S Fowler,et al.  Addiction, a disease of compulsion and drive: involvement of the orbitofrontal cortex. , 2000, Cerebral cortex.

[92]  Joseph J. Paton,et al.  The primate amygdala represents the positive and negative value of visual stimuli during learning , 2006, Nature.

[93]  G. Schoenbaum,et al.  Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning , 1998, Nature Neuroscience.

[94]  A. Bechara,et al.  Decision-making and addiction (part II): myopia for the future or hypersensitivity to reward? , 2002, Neuropsychologia.

[95]  T. Robbins,et al.  Dissociable Contributions of the Orbitofrontal and Infralimbic Cortex to Pavlovian Autoshaping and Discrimination Reversal Learning: Further Evidence for the Functional Heterogeneity of the Rodent Frontal Cortex , 2003, The Journal of Neuroscience.

[96]  S. Hyman,et al.  Addiction and the brain: The neurobiology of compulsion and its persistence , 2001, Nature Reviews Neuroscience.

[97]  V. Brown,et al.  Orbital prefrontal cortex mediates reversal learning and not attentional set shifting in the rat , 2003, Behavioural Brain Research.

[98]  C. I. Connolly,et al.  Building neural representations of habits. , 1999, Science.

[99]  M. Quirk,et al.  Representation of Spatial Goals in Rat Orbitofrontal Cortex , 2006, Neuron.

[100]  T. Robbins,et al.  Dissociable Deficits in the Decision-Making Cognition of Chronic Amphetamine Abusers, Opiate Abusers, Patients with Focal Damage to Prefrontal Cortex, and Tryptophan-Depleted Normal Volunteers: Evidence for Monoaminergic Mechanisms , 1999, Neuropsychopharmacology.

[101]  P. Holland,et al.  Neurotoxic Lesions of Basolateral, But Not Central, Amygdala Interfere with Pavlovian Second-Order Conditioning and Reinforcer Devaluation Effects , 1996, The Journal of Neuroscience.

[102]  G. Schoenbaum,et al.  Cocaine makes actions insensitive to outcomes but not extinction: implications for altered orbitofrontal-amygdalar function. , 2005, Cerebral cortex.

[103]  M. Mishkin,et al.  Limbic lesions and the problem of stimulus--reinforcement associations. , 1972, Experimental neurology.

[104]  Donna J. Calu,et al.  Withdrawal from cocaine self-administration produces long-lasting deficits in orbitofrontal-dependent reversal learning in rats. , 2007, Learning & memory.

[105]  Michael E. Ragozzino,et al.  The involvement of the orbitofrontal cortex in learning under changing task contingencies , 2005, Neurobiology of Learning and Memory.

[106]  A. Redish,et al.  Neuronal activity in the rodent dorsal striatum in sequential navigation: separation of spatial and reward responses on the multiple T task. , 2004, Journal of neurophysiology.

[107]  T L Faber,et al.  Neural activity related to drug craving in cocaine addiction. , 2001, Archives of general psychiatry.