Stable encoding of task structure coexists with flexible coding of task events in sensorimotor striatum.

The sensorimotor striatum, as part of the brain’s habit circuitry, has been suggested to store fixed action values as a result of stimulus-response learning, and has been contrasted with a more flexible system that conditionally assigns values to behaviors. The stability of neural activity in the sensorimotor striatum is thought to underlie not only normal habits, but also addiction and clinical syndromes characterized by behavioral fixity. By recording in the sensorimotor striatum of mice, we asked whether neuronal activity acquired during procedural learning would be stable even if the sensory stimuli triggering the habitual behavior were altered. Contrary to expectation, both fixed and flexible activity patterns appeared. One, representing the global structure of the acquired behavior, was stable across changes in task cuing. The second, a fine-grain representation of task events, adjusted rapidly. Such dual forms of representation may be critical to allow motor and cognitive flexibility despite habitual performance.

[1]  Charles J. Wilson,et al.  Striatal interneurones: chemical, physiological and morphological characterization , 1995, Trends in Neurosciences.

[2]  M. Petrides,et al.  Functional role of the basal ganglia in the planning and execution of actions , 2006, Annals of neurology.

[3]  Sabrina Ravel,et al.  Responses of Tonically Active Neurons in the Monkey Striatum Discriminate between Motivationally Opposing Stimuli , 2003, The Journal of Neuroscience.

[4]  M. Kawato,et al.  Different neural correlates of reward expectation and reward expectation error in the putamen and caudate nucleus during stimulus-action-reward association learning. , 2006, Journal of neurophysiology.

[5]  B. Balleine,et al.  The Role of the Dorsal Striatum in Reward and Decision-Making , 2007, The Journal of Neuroscience.

[6]  N. E. Massioui,et al.  Alleviation of overtraining reversal effect by transient inactivation of the dorsal striatum , 2000, The European journal of neuroscience.

[7]  H. Parthasarathy,et al.  Local Release of GABAergic Inhibition in the Motor Cortex Induces Immediate-Early Gene Expression in Indirect Pathway Neurons of the Striatum , 1997, The Journal of Neuroscience.

[8]  M. S Jog,et al.  Tetrode technology: advances in implantable hardware, neuroimaging, and data analysis techniques , 2002, Journal of Neuroscience Methods.

[9]  Sabrina M. Tom,et al.  The Neural Correlates of Motor Skill Automaticity , 2005, The Journal of Neuroscience.

[10]  H. Eichenbaum,et al.  Striatal versus hippocampal representations during win-stay maze performance. , 2009, Journal of neurophysiology.

[11]  Leslie G. Ungerleider,et al.  Distinct contribution of the cortico-striatal and cortico-cerebellar systems to motor skill learning , 2003, Neuropsychologia.

[12]  A M Graybiel,et al.  Cortically Driven Immediate-Early Gene Expression Reflects Modular Influence of Sensorimotor Cortex on Identified Striatal Neurons in the Squirrel Monkey , 1997, The Journal of Neuroscience.

[13]  K. Doya,et al.  Representation of Action-Specific Reward Values in the Striatum , 2005, Science.

[14]  A. Graybiel Habits, rituals, and the evaluative brain. , 2008, Annual review of neuroscience.

[15]  E. Miller,et al.  Different time courses of learning-related activity in the prefrontal cortex and striatum , 2005, Nature.

[16]  Ziv M. Williams,et al.  Selective enhancement of associative learning by microstimulation of the anterior caudate , 2006, Nature Neuroscience.

[17]  P. Janak,et al.  Inactivation of the Lateral But Not Medial Dorsal Striatum Eliminates the Excitatory Impact of Pavlovian Stimuli on Instrumental Responding , 2007, The Journal of Neuroscience.

[18]  J. Doyon,et al.  Reorganization and plasticity in the adult brain during learning of motor skills , 2005, Current Opinion in Neurobiology.

[19]  P. McCullagh,et al.  Generalized Linear Models , 1972, Predictive Analytics.

[20]  Karl J. Friston,et al.  Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning , 2004, Science.

[21]  Oxana Eschenko,et al.  Non-commercial Research and Educational Use including without Limitation Use in Instruction at Your Institution, Sending It to Specific Colleagues That You Know, and Providing a Copy to Your Institution's Administrator. All Other Uses, Reproduction and Distribution, including without Limitation Comm , 2022 .

[22]  R. O’Reilly,et al.  Separate neural substrates for skill learning and performance in the ventral and dorsal striatum , 2007, Nature Neuroscience.

[23]  T. Klingberg,et al.  Prefrontal cortex and basal ganglia control access to working memory , 2008, Nature Neuroscience.

[24]  Shubhodeep Chakrabarti,et al.  Topography of cortical projections to the dorsolateral neostriatum in rats: Multiple overlapping sensorimotor pathways , 2006, The Journal of comparative neurology.

[25]  Charles J. Wilson,et al.  Spontaneous firing patterns of identified spiny neurons in the rat neostriatum , 1981, Brain Research.

[26]  H. Yin,et al.  The role of the basal ganglia in habit formation , 2006, Nature Reviews Neuroscience.

[27]  P. Dayan,et al.  Reward, Motivation, and Reinforcement Learning , 2002, Neuron.

[28]  M. Laubach,et al.  Dynamic Encoding of Action Selection by the Medial Striatum , 2009, The Journal of Neuroscience.

[29]  J. Gabrieli,et al.  Direct comparison of neural systems mediating conscious and unconscious skill learning. , 2002, Journal of neurophysiology.

[30]  T. Robbins,et al.  Neural systems of reinforcement for drug addiction: from actions to habits to compulsion , 2005, Nature Neuroscience.

[31]  N. White Some highlights of research on the effects of caudate nucleus lesions over the past 200 years , 2009, Behavioural Brain Research.

[32]  P. Dayan,et al.  Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control , 2005, Nature Neuroscience.

[33]  D. Lovinger,et al.  Dynamic reorganization of striatal circuits during the acquisition and consolidation of a skill , 2009, Nature Neuroscience.

[34]  M. Nicolelis,et al.  Differential Corticostriatal Plasticity during Fast and Slow Motor Skill Learning in Mice , 2004, Current Biology.

[35]  M. Jüptner,et al.  A review of differences between basal ganglia and cerebellar control of movements as revealed by functional imaging studies. , 1998, Brain : a journal of neurology.

[36]  L. Brown Somatotopic organization in rat striatum: evidence for a combinational map. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[37]  B. Balleine,et al.  Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning , 2004, The European journal of neuroscience.

[38]  M. Nicolelis,et al.  Interval timing and the encoding of signal duration by ensembles of cortical and striatal neurons. , 2003, Behavioral neuroscience.

[39]  A. D. Redish,et al.  Task-dependent encoding of space and events by striatal neurons is dependent on neural subtype , 2008, Neuroscience.

[40]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[41]  A. A Emondi,et al.  Tracking neurons recorded from tetrodes across time , 2004, Journal of Neuroscience Methods.

[42]  C. I. Connolly,et al.  Building neural representations of habits. , 1999, Science.

[43]  P. Glimcher,et al.  Action and Outcome Encoding in the Primate Caudate Nucleus , 2007, The Journal of Neuroscience.

[44]  S. Mizumori,et al.  Role of the dorsomedial striatum in behavioral flexibility for response and visual cue discrimination learning. , 2002, Behavioral neuroscience.

[45]  P. Dayan,et al.  Opinion TRENDS in Cognitive Sciences Vol.10 No.8 Full text provided by www.sciencedirect.com A normative perspective on motivation , 2022 .

[46]  Lars Bäckman,et al.  Transfer of Learning After Updating Training Mediated by the Striatum , 2008, Science.

[47]  M. West,et al.  Changes in activity of the striatum during formation of a motor habit , 2007, The European journal of neuroscience.

[48]  T. Robbins,et al.  Putting a spin on the dorsal–ventral divide of the striatum , 2004, Trends in Neurosciences.

[49]  J. Hollerman,et al.  Changes in behavior-related neuronal activity in the striatum during learning , 2003, Trends in Neurosciences.

[50]  M. Laubach,et al.  Neuronal correlates of instrumental learning in the dorsal striatum. , 2009, Journal of neurophysiology.

[51]  Adam Johnson,et al.  Computing motivation: Incentive salience boosts of drug or appetite states , 2008, Behavioral and Brain Sciences.

[52]  J. W. Aldridge,et al.  Basal ganglia neural mechanisms of natural movement sequences. , 2004, Canadian journal of physiology and pharmacology.

[53]  Bradley P. Carlin,et al.  Bayesian measures of model complexity and fit , 2002 .

[54]  O. Hikosaka,et al.  Immediate changes in anticipatory activity of caudate neurons associated with reversal of position-reward contingency. , 2005, Journal of neurophysiology.

[55]  Scott T. Grafton,et al.  Attention and stimulus characteristics determine the locus of motor-sequence encoding. A PET study. , 1997, Brain : a journal of neurology.

[56]  A. Graybiel,et al.  Responses of tonically active neurons in the primate's striatum undergo systematic changes during behavioral sensorimotor conditioning , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[57]  Richard B. Ivry,et al.  The Human Striatum is Necessary for Responding to Changes in Stimulus Relevance , 2006, Journal of Cognitive Neuroscience.

[58]  C. Halldin,et al.  A PET study of , 2000, The international journal of neuropsychopharmacology.

[59]  M. Ragozzino The Contribution of the Medial Prefrontal Cortex, Orbitofrontal Cortex, and Dorsomedial Striatum to Behavioral Flexibility , 2007, Annals of the New York Academy of Sciences.

[60]  A. Mcgeorge,et al.  The organization of the projection from the cerebral cortex to the striatum in the rat , 1989, Neuroscience.

[61]  P. Matthews,et al.  Changing brain networks for visuomotor control with increased movement automaticity. , 2004, Journal of neurophysiology.

[62]  A. Graybiel The basal ganglia: learning new tricks and loving it , 2005, Current Opinion in Neurobiology.

[63]  K. Doya,et al.  The computational neurobiology of learning and reward , 2006, Current Opinion in Neurobiology.

[64]  A. Dickinson,et al.  Parallel and interactive learning processes within the basal ganglia: Relevance for the understanding of addiction , 2009, Behavioural Brain Research.

[65]  E. Vaadia,et al.  Coincident but Distinct Messages of Midbrain Dopamine and Striatal Tonically Active Neurons , 2004, Neuron.

[66]  J. Tepper,et al.  Dual Cholinergic Control of Fast-Spiking Interneurons in the Neostriatum , 2002, The Journal of Neuroscience.