Different dorsal striatum circuits mediate action discrimination and action generalization

Generalization is an important process that allows animals to extract rules from regularities of past experience and apply them to analogous situations. In particular, the generalization of previously learned actions to novel instruments allows animals to use past experience to act faster and more efficiently in an ever‐changing environment. However, generalization of actions to a dissimilar instrument or situation may also be detrimental. In this study, we investigated the neural bases of action generalization and discrimination in mice trained on a lever‐pressing task. Using specific schedules of reinforcement known to bias animals towards habitual or goal‐directed behaviors, we confirmed that action generalization is more prominent in animals using habitual rather than goal‐directed strategies. We discovered that selective excitotoxic lesions of the dorsolateral and dorsomedial striatum have opposite effects on the generalization of a previously learned action to a novel lever. Whereas lesions of the dorsolateral striatum impair action generalization, dorsomedial striatum lesions affect action discrimination and bias subjects towards action generalization. Importantly, these lesions do not affect the ability of animals to explore or match their lever‐pressing rate to the reinforcement rate, or the ability to distinguish between different levers. The data presented here reveal that dorsolateral and dorsomedial striatal circuits have opposing roles in the generalization of previously learned actions to novel instruments, and suggest that these circuits compete for the expression of generalization in novel situations.

[1]  R J HERRNSTEIN,et al.  Relative and absolute strength of response as a function of frequency of reinforcement. , 1961, Journal of the experimental analysis of behavior.

[2]  Christopher D. Adams,et al.  The Effect of the Instrumental Training Contingency on Susceptibility to Reinforcer Devaluation , 1983 .

[3]  A. Dickinson Actions and habits: the development of behavioural autonomy , 1985 .

[4]  R. Rescorla,et al.  Postconditioning devaluation of a reinforcer affects instrumental responding. , 1985 .

[5]  J. D. McGaugh,et al.  Double dissociation of fornix and caudate nucleus lesions on acquisition of two water maze tasks: further evidence for multiple memory systems. , 1992, Behavioral neuroscience.

[6]  B. Balleine,et al.  Motivational control of goal-directed action , 1994 .

[7]  D. Finch,et al.  Neurophysiology and neuropharmacology of projections from entorhinal cortex to striatum in the rat , 1995, Brain Research.

[8]  O. Hikosaka,et al.  Differential roles of monkey striatum in learning of sequential hand movement , 1997, Experimental Brain Research.

[9]  B. Balleine,et al.  Goal-directed instrumental action: contingency and incentive learning and their cortical substrates , 1998, Neuropharmacology.

[10]  M. Ullman A neurocognitive perspective on language: The declarative/procedural model , 2001, Nature Reviews Neuroscience.

[11]  O. Hikosaka,et al.  Differential activation of monkey striatal neurons in the early and late stages of procedural learning , 2002, Experimental Brain Research.

[12]  R. Poldrack,et al.  Competition among multiple memory systems: converging evidence from animal and human brain studies , 2003, Neuropsychologia.

[13]  B. Balleine,et al.  The Effect of Lesions of the Basolateral Amygdala on Instrumental Conditioning , 2003, The Journal of Neuroscience.

[14]  S. Haber The primate basal ganglia: parallel and integrative networks , 2003, Journal of Chemical Neuroanatomy.

[15]  S. Killcross,et al.  Inactivation of the infralimbic prefrontal cortex reinstates goal-directed responding in overtrained rats , 2003, Behavioural Brain Research.

[16]  B. Knowlton,et al.  Contributions of striatal subregions to place and response learning. , 2004, Learning & memory.

[17]  Michael J. Frank,et al.  Hippocampus, cortex, and basal ganglia: Insights from computational models of complementary learning systems , 2004, Neurobiology of Learning and Memory.

[18]  B. Balleine,et al.  Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning , 2004, The European journal of neuroscience.

[19]  T. Robbins,et al.  Putting a spin on the dorsal–ventral divide of the striatum , 2004, Trends in Neurosciences.

[20]  L. Squire Memory systems of the brain: A brief history and current perspective , 2004, Neurobiology of Learning and Memory.

[21]  Carol A. Seger,et al.  The Roles of the Caudate Nucleus in Human Classification Learning , 2005, The Journal of Neuroscience.

[22]  B. Balleine,et al.  The role of the dorsomedial striatum in instrumental conditioning , 2005, The European journal of neuroscience.

[23]  B. Balleine,et al.  Blockade of NMDA receptors in the dorsomedial striatum prevents action–outcome learning in instrumental conditioning , 2005, The European journal of neuroscience.

[24]  P. Dayan,et al.  Cortical substrates for exploratory decisions in humans , 2006, Nature.

[25]  B. Balleine,et al.  Inactivation of dorsolateral striatum enhances sensitivity to changes in the action–outcome contingency in instrumental conditioning , 2006, Behavioural Brain Research.

[26]  Carl Petersen,et al.  Layer- and Column-Specific Knockout of NMDA Receptors in Pyramidal Neurons of the Mouse Barrel Cortex , 2007, Frontiers in integrative neuroscience.

[27]  R. Costa,et al.  Endocannabinoid Signaling is Critical for Habit Formation , 2007, Frontiers in integrative neuroscience.

[28]  Alcino J. Silva,et al.  Memory for context becomes less specific with time. , 2007, Learning & memory.

[29]  High on Habits , 2008, Front. Neurosci..

[30]  Yael Niv,et al.  Operant Conditioning , 1971 .

[31]  Carol A. Seger,et al.  How do the basal ganglia contribute to categorization? Their roles in generalization, response selection, and learning via feedback , 2008, Neuroscience & Biobehavioral Reviews.

[32]  R. de Diego-Balaguer,et al.  Striatal degeneration impairs language learning: evidence from Huntington's disease. , 2008, Brain : a journal of neurology.

[33]  D. Lovinger,et al.  Dynamic reorganization of striatal circuits during the acquisition and consolidation of a skill , 2009, Nature Neuroscience.

[34]  F. Fabbro,et al.  Spontaneous language production in bilingual Parkinson’s disease patients: Evidence of greater phonological, morphological and syntactic impairments in native language , 2010, Brain and Language.

[35]  H. Yin The Sensorimotor Striatum Is Necessary for Serial Order Learning , 2010, The Journal of Neuroscience.

[36]  Xin Jin,et al.  Start/stop signals emerge in nigrostriatal circuits during sequence learning , 2010, Nature.

[37]  B. Balleine,et al.  Human and Rodent Homologies in Action Control: Corticostriatal Determinants of Goal-Directed and Habitual Action , 2010, Neuropsychopharmacology.

[38]  Alcino J. Silva,et al.  The Hippocampus Plays a Selective Role in the Retrieval of Detailed Contextual Memories , 2010, Current Biology.

[39]  M. Frank,et al.  Transitive inference in adults with autism spectrum disorders , 2011, Cognitive, affective & behavioral neuroscience.