Lesion to the Nigrostriatal Dopamine System Disrupts Stimulus-Response Habit Formation

Acquisition and performance of instrumental actions are assumed to require both action-outcome and stimulus-response (S-R) habit processes. Over the course of extended training, control over instrumental performance shifts from goal-directed action-outcome associations to S-R associations that progressively gain domination over behavior. Lesions of the lateral part of the dorsal striatum disrupt this process, and rats with lesions to the lateral striatum showed selective sensitivity to devaluation of the instrumental outcome (Yin et al., 2004), indicating that this area is necessary for habit formation. The present experiment further explored the basis of this dysfunction by examining the ability of rats subjected to bilateral 6-hydroxydopamine lesions of the nigrostriatal dopaminergic pathway to develop behavioral autonomy with overtraining. Rats were given extended training on two cued instrumental tasks associating a stimulus (a tone or a light) with an instrumental action (lever press or chain pull) and a food reward (pellets or sucrose). Both tasks were run daily in separate sessions. Overtraining was followed by a test of goal sensitivity by satiety-specific devaluation of the reward. In control animals, one action (lever press) was insensitive to reward devaluation, indicating that it became a habit, whereas the second action (chain pull) was still sensitive to goal devaluation. This result provides evidence that the development of habit learning may depend on the characteristics of the response. In dopamine-depleted rats, lever press and chain pull remained sensitive to reward devaluation, evidencing a role of striatal dopamine transmission in habit formation.

[1]  W. Beatty,et al.  Comparative effects of septo-hippocampal and caudate lesions on avoidance behavior in rats. , 1967, Journal of comparative and physiological psychology.

[2]  R. Kirkby Caudate Nucleus Lesions Impair Spontaneous Alternation , 1969, Perceptual and Motor Skills.

[3]  S. Polgar,et al.  Active avoidance in the laboratory rat following lesions of the dorsal or ventral caudate nucleus , 1974 .

[4]  G. Winocur Functional dissociation within the caudate nucleus of rats. , 1974, Journal of comparative and physiological psychology.

[5]  A. Dickinson Conditioning and associative learning. , 1981, British medical bulletin.

[6]  P. Milner,et al.  Response involvement in brain stimulation reward , 1981, Physiology & Behavior.

[7]  Christopher D. Adams Variations in the Sensitivity of Instrumental Responding to Reinforcer Devaluation , 1982 .

[8]  Ralph R. Miller,et al.  Information processing in animals : memory mechanisms , 1983 .

[9]  G. Paxinos,et al.  The Rat Brain in Stereotaxic Coordinates , 1983 .

[10]  A. Dickinson Actions and habits: the development of behavioural autonomy , 1985 .

[11]  N. White A functional hypothesis concerning the striatal matrix and patches: mediation of S-R memory and reward. , 1989, Life sciences.

[12]  W. Schultz,et al.  Dopamine neurons of the monkey midbrain: contingencies of responses to active touch during self-initiated arm movements. , 1990, Journal of neurophysiology.

[13]  M. Packard,et al.  Lesions of the caudate nucleus selectively impair "reference memory" acquisition in the radial maze. , 1990, Behavioral and neural biology.

[14]  T. Robbins,et al.  Effects of dopamine depletion from the caudate-putamen and nucleus accumbens septi on the acquisition and performance of a conditional discrimination task , 1990, Behavioural Brain Research.

[15]  T. Robbins,et al.  Dissociable roles of the ventral, medial and lateral striatum on the acquisition and performance of a complex visual stimulus-response habit , 1991, Behavioural Brain Research.

[16]  H. Okamura,et al.  Degeneration of the nigral dopamine neurons after 6-hydroxydopamine injection into the rat striatum , 1991, Brain Research.

[17]  M. Le Moal,et al.  Asymmetrical effects of cortical ablation on brain monoamines in mice. , 1991, The International journal of neuroscience.

[18]  J. Cadet,et al.  Retrograde degeneration of nigrostriatal neurons induced by intrastriatal 6-hydroxydopamine injection in rats , 1991, Brain Research Bulletin.

[19]  W. Schultz,et al.  Responses of monkey dopamine neurons during learning of behavioral reactions. , 1992, Journal of neurophysiology.

[20]  P. Voorn,et al.  Development of Dopamine - Containing Systems in the CNS , 1992 .

[21]  K. Berridge,et al.  The neural basis of drug craving: An incentive-sensitization theory of addiction , 1993, Brain Research Reviews.

[22]  B. Balleine,et al.  Motivational control of goal-directed action , 1994 .

[23]  G. Hoffman,et al.  cFos immunoreactivity is enhanced with biotin amplification. , 1994, The journal of histochemistry and cytochemistry : official journal of the Histochemistry Society.

[24]  W. Schultz,et al.  Importance of unpredictability for reward responses in primate dopamine neurons. , 1994, Journal of neurophysiology.

[25]  A. Graybiel,et al.  Responses of tonically active neurons in the primate's striatum undergo systematic changes during behavioral sensorimotor conditioning , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[26]  A. Graybiel,et al.  Effect of the nigrostriatal dopamine system on acquired neural responses in the striatum of behaving monkeys. , 1994, Science.

[27]  D. Salmon,et al.  Neurobiology of skill and habit learning , 1995, Current Opinion in Neurobiology.

[28]  D. Togasaki,et al.  Dose-dependent lesions of the dopaminergic nigrostriatal pathway induced by instrastriatal injection of 6-hydroxydopamine , 1995, Neuroscience.

[29]  A. Nieoullon,et al.  Complex Deficits on Reaction Time Performance following Bilateral Intrastriatal 6‐OHDA Infusion in the Rat , 1995, The European journal of neuroscience.

[30]  Jennifer A. Mangels,et al.  A Neostriatal Habit Learning System in Humans , 1996, Science.

[31]  A. Björklund,et al.  Dopaminergic neuronal degeneration and motor impairments following axon terminal lesion by intrastriatal 6-hydroxydopamine in the rat , 1996, Neuroscience.

[32]  J. D. McGaugh,et al.  Inactivation of Hippocampus or Caudate Nucleus with Lidocaine Differentially Affects Expression of Place and Response Learning , 1996, Neurobiology of Learning and Memory.

[33]  E. Vaadia,et al.  Neuronal synchronization of tonically active neurons in the striatum of normal and parkinsonian primates. , 1996, Journal of neurophysiology.

[34]  H. L. Petri,et al.  Dissociation of Hippocampal and Striatal Contributions to Spatial Navigation in the Water Maze , 1996, Neurobiology of Learning and Memory.

[35]  N. White Mnemonic functions of the basal ganglia , 1997, Current Opinion in Neurobiology.

[36]  Contrasting effects of central nucleus of the amygdala and dorsal striatum lesions on active avoidance learning and its contextual modification , 1997 .

[37]  Paul Greengard,et al.  Quantitative immunocytochemistry of DARPP-32-expressing neurons in the rat caudatoputamen , 1998, Brain Research.

[38]  Anders Björklund,et al.  Characterization of Behavioral and Neurodegenerative Changes Following Partial Lesions of the Nigrostriatal Dopamine System Induced by Intrastriatal 6-Hydroxydopamine in the Rat , 1998, Experimental Neurology.

[39]  Angus C Nairn,et al.  The DARPP-32/protein phosphatase-1 cascade: a model for signal integration 1 Published on the World Wide Web on 22 January 1998. 1 , 1998, Brain Research Reviews.

[40]  Dopamine receptor-mediated mechanisms involved in the expression of learned activity of primate striatal neurons(運動学習に伴うサルの線条体ニューロンの活動の変容におけるドーパミン系の役割) , 1998 .

[41]  J. Salamone,et al.  Nucleus accumbens dopamine depletions make rats more sensitive to high ratio requirements but do not impair primary food reinforcement , 1999, Neuroscience.

[42]  T. Robbins,et al.  Effects of regional striatal lesions on motor, motivational, and executive aspects of progressive-ratio performance in rats. , 1999, Behavioral neuroscience.

[43]  N. White,et al.  Parallel Information Processing in the Dorsal Striatum: Relation to Hippocampal Function , 1999, The Journal of Neuroscience.

[44]  C. I. Connolly,et al.  Building neural representations of habits. , 1999, Science.

[45]  R. J. McDonald,et al.  Effects of medial and lateral caudate-putamen lesions on place- and cue-guided behaviors in the water maze: relation to thigmotaxis , 1999, Behavioural Brain Research.

[46]  N. E. Massioui,et al.  Alleviation of overtraining reversal effect by transient inactivation of the dorsal striatum , 2000, The European journal of neuroscience.

[47]  W. F. Caul,et al.  Schedule-dependent effects of haloperidol and amphetamine: multiple-schedule task shows within-subject effects , 2001, Pharmacology Biochemistry and Behavior.

[48]  R. Kesner,et al.  Role of the Medial and Lateral Caudate-Putamen in Mediating an Auditory Conditional Response Association , 2001, Neurobiology of Learning and Memory.

[49]  F. Chéruel,et al.  Perseverative Behavior Underlying Attentional Set-Shifting Deficits in Rats Chronically Treated with the Neurotoxin 3-Nitropropionic Acid , 2001, Experimental Neurology.

[50]  M. Amalric,et al.  Effect of Bilateral 6-Hydroxydopamine Lesions of the Medial Forebrain Bundle on Reaction Time , 2002, Neuropsychopharmacology.

[51]  W. Schultz Getting Formal with Dopamine and Reward , 2002, Neuron.

[52]  K. Dujardin,et al.  Dysfunction of the human memory systems: role of the dopaminergic transmission , 2003, Current opinion in neurology.

[53]  R. J. McDonald,et al.  Dorsal striatum and stimulus–response learning: lesions of the dorsolateral, but not dorsomedial, striatum impair acquisition of a simple discrimination task , 2004, Behavioural Brain Research.

[54]  J. Salamone,et al.  Accumbens dopamine and the regulation of effort in food-seeking behavior: modulation of work output by different ratio or force requirements , 2004, Behavioural Brain Research.

[55]  B. Balleine,et al.  Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning , 2004, The European journal of neuroscience.