Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning

Habits are controlled by antecedent stimuli rather than by goal expectancy. Interval schedules of feedback have been shown to generate habits, as revealed by the insensitivity of behaviour acquired under this schedule to outcome devaluation treatments. Two experiments were conducted to assess the role of the dorsolateral striatum in habit learning. In Experiment 1, sham operated controls and rats with dorsolateral striatum lesions were trained to press a lever for sucrose under interval schedules. After training, the sucrose was devalued by inducing taste aversion to it using lithium chloride, whereas saline injections were given to the controls. Only rats given the devaluation treatment reduced their consumption of sucrose and this reduction was similar in both the sham and the lesioned groups. All rats were then returned to the instrumental chamber for an extinction test, in which the lever was extended but no sucrose was delivered. In contrast to sham operated controls, rats with dorsolateral striatum lesions refrained from pressing the lever if the outcome was devalued. To assess the specificity of the role of dorsolateral striatum in this effect a second experiment was conducted in which a group with lesions of dorsomedial striatum was added. In relation now to both the sham and the dorsomedial lesioned groups, only rats with lesions of dorsolateral striatum significantly reduced responding after outcome devaluation. In conclusion, this study provides direct evidence that the dorsolateral striatum is necessary for habit formation. Furthermore, it suggests that, when the habit system is disrupted, control over instrumental performance reverts to the system controlling the performance of goal‐directed instrumental actions.

[1]  W M Baum,et al.  The correlation-based law of effect. , 1973, Journal of the experimental analysis of behavior.

[2]  Christopher D. Adams,et al.  Instrumental Responding following Reinforcer Devaluation , 1981 .

[3]  Ray Adams,et al.  Memory for Sentences: The Subject Superiority Effect , 1981 .

[4]  A. Dickinson Contemporary Animal Learning Theory , 1981 .

[5]  Christopher D. Adams Variations in the Sensitivity of Instrumental Responding to Reinforcer Devaluation , 1982 .

[6]  Christopher D. Adams,et al.  The Effect of the Instrumental Training Contingency on Susceptibility to Reinforcer Devaluation , 1983 .

[7]  G. Paxinos,et al.  The Rat Brain in Stereotaxic Coordinates , 1983 .

[8]  A. Dickinson Actions and habits: the development of behavioural autonomy , 1985 .

[9]  A. Dickinson Expectancy theory in animal conditioning. , 1989 .

[10]  Robert A. Rescorla,et al.  Effect of reinforcer devaluation on discriminative control of instrumental behavior. , 1990, Journal of experimental psychology. Animal behavior processes.

[11]  G. Hall,et al.  Context specificity of conditioning in flavor-aversion learning: Extinction and blocking tests , 1990 .

[12]  M. Kimura Behaviorally contingent property of movement-related activity of the primate putamen. , 1990, Journal of neurophysiology.

[13]  A. Graybiel Neurotransmitters and neuromodulators in the basal ganglia , 1990, Trends in Neurosciences.

[14]  D J Woodward,et al.  A region in the dorsolateral striatum of the rat exhibiting single-unit correlations with specific locomotor limb movements. , 1990, Journal of neurophysiology.

[15]  A. Mayes,et al.  Amnesics Have a Disproportionately Severe Memopry Deficit for Interactive Context , 1992, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[16]  B. Balleine,et al.  Incentive Learning Following Reinforcer Devaluation is not Conditional upon the Motivational State during Re-Exposure , 1992, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[17]  M. Kimura Behavioral modulation of sensory responses of primate putamen neurons , 1992, Brain Research.

[18]  R. J. McDonald,et al.  A triple dissociation of memory systems: hippocampus, amygdala, and dorsal striatum. , 1993, Behavioral neuroscience.

[19]  G. Rebec,et al.  Responses of rat striatal neurons during performance of a lever-release version of the conditioned avoidance response task , 1993, Brain Research.

[20]  B. Balleine,et al.  Motivational control of goal-directed action , 1994 .

[21]  B. Balleine,et al.  Effects of ibotenic acid lesions of the Nucleus Accumbens on instrumental action , 1994, Behavioural Brain Research.

[22]  R. Boakes,et al.  Motivational control after extended instrumental training , 1995 .

[23]  Jennifer A. Mangels,et al.  A Neostriatal Habit Learning System in Humans , 1996, Science.

[24]  J. D. McGaugh,et al.  Inactivation of Hippocampus or Caudate Nucleus with Lidocaine Differentially Affects Expression of Place and Response Learning , 1996, Neurobiology of Learning and Memory.

[25]  M. West,et al.  Loss of Lever Press-Related Firing of Rat Striatal Forelimb Neurons after Repeated Sessions in a Lever Pressing Task , 1997, The Journal of Neuroscience.

[26]  A. Graybiel The Basal Ganglia and Chunking of Action Repertoires , 1998, Neurobiology of Learning and Memory.

[27]  B. Balleine,et al.  Goal-directed instrumental action: contingency and incentive learning and their cortical substrates , 1998, Neuropharmacology.

[28]  M. Shadlen,et al.  Effect of Expected Reward Magnitude on the Response of Neurons in the Dorsolateral Prefrontal Cortex of the Macaque , 1999, Neuron.

[29]  N. White,et al.  Parallel Information Processing in the Dorsal Striatum: Relation to Hippocampal Function , 1999, The Journal of Neuroscience.

[30]  C. I. Connolly,et al.  Building neural representations of habits. , 1999, Science.

[31]  R. J. McDonald,et al.  Effects of medial and lateral caudate-putamen lesions on place- and cue-guided behaviors in the water maze: relation to thigmotaxis , 1999, Behavioural Brain Research.

[32]  J. Hollerman,et al.  Involvement of basal ganglia and orbitofrontal cortex in goal-directed behavior. , 2000, Progress in brain research.

[33]  B. Everitt,et al.  Limbic cortical-ventral striatal systems underlying appetitive conditioning. , 2000, Progress in brain research.

[34]  B. Balleine,et al.  The Effect of Lesions of the Insular Cortex on Instrumental Conditioning: Evidence for a Role in Incentive Memory , 2000, The Journal of Neuroscience.

[35]  K. Hikosaka,et al.  Delay activity of orbital and lateral prefrontal neurons of the monkey varying with different rewards. , 2000, Cerebral cortex.

[36]  A. Dickinson,et al.  Involvement of the central nucleus of the amygdala and nucleus accumbens core in mediating Pavlovian influences on instrumental behaviour , 2001, The European journal of neuroscience.

[37]  B. Balleine,et al.  The Role of the Nucleus Accumbens in Instrumental Conditioning: Evidence of a Functional Dissociation between Accumbens Core and Shell , 2001, The Journal of Neuroscience.

[38]  Barry J. Everitt,et al.  Psychomotor Stimulant Addiction: A Neural Systems Perspective , 2002, The Journal of Neuroscience.

[39]  B. Knowlton,et al.  Learning and memory functions of the Basal Ganglia. , 2002, Annual review of neuroscience.

[40]  O. Hikosaka,et al.  Feature-Based Anticipation of Cues that Predict Reward in Monkey Caudate Nucleus , 2002, Neuron.

[41]  J. N. P. Rawlins,et al.  Effects of cytotoxic nucleus accumbens lesions on instrumental conditioning in rats , 2002, Experimental Brain Research.

[42]  B. Balleine,et al.  Lesions of mediodorsal thalamus and anterior thalamic nuclei produce dissociable effects on instrumental conditioning in rats , 2003, The European journal of neuroscience.

[43]  B. Balleine,et al.  The Effect of Lesions of the Basolateral Amygdala on Instrumental Conditioning , 2003, The Journal of Neuroscience.

[44]  S. Killcross,et al.  Coordination of actions and habits in the medial prefrontal cortex of rats. , 2003, Cerebral cortex.

[45]  J. W. Aldridge,et al.  Primate basal ganglia activity in a precued reaching task: preparation for movement , 2004, Experimental Brain Research.

[46]  W. Schultz,et al.  Responses to reward in monkey dorsal and ventral striatum , 2004, Experimental Brain Research.

[47]  M. Kimura,et al.  Activity of primate putamen neurons is selective to the mode of voluntary movement: visually guided, self-initiated or memory-guided , 2004, Experimental Brain Research.

[48]  K. Campbell,et al.  A neural correlate of response bias in monkey caudate nucleus , 2022 .