Tracking Progress toward a Goal in Corticostriatal Ensembles

When performing sequences of actions, we constantly keep track of our current position in the sequence relative to the overall goal. The present study searched for neural representations of sequence progression in corticostriatal circuits. Neurons within the anterior cingulate cortex (ACC) and its target region in the dorsal striatum (DS) were recorded from simultaneously as rats performed different sequences of lever presses. We analyzed the responses of the neurons to presses occurring in the “first,” “second,” or “third” serial position regardless of the particular sequence or physical levers. Principal component analysis revealed that the main source of firing rate variance in the ACC was a smooth ramp-like change as the animal progressed through the sequence toward the reward. No such smooth-ramping activity was observed in DS ensembles as firing tended to be tightly linked to each action. In the ACC, the progression in firing was observed only for correct choices and not errors, whereas in the DS, firing associated with each action in a sequence was similar regardless of whether the action was correct or not. Therefore, different forms of a signal exist within corticostriatal circuits that evolve across a sequence of actions, with DS ensembles tracking every action and ACC ensembles tracking actual progress toward the goal.

[1]  Michael E. Hasselmo,et al.  Working Memory Performance Correlates with Prefrontal-Hippocampal Theta Interactions but not with Prefrontal Neuron Firing Rates , 2009, Front. Integr. Neurosci..

[2]  B. McNaughton,et al.  Firing characteristics of deep layer neurons in prefrontal cortex in rats performing spatial working memory tasks. , 1998, Cerebral cortex.

[3]  A. Redish,et al.  Neuronal activity in the rodent dorsal striatum in sequential navigation: separation of spatial and reward responses on the multiple T task. , 2004, Journal of neurophysiology.

[4]  Joshua W. Brown,et al.  Medial prefrontal cortex as an action-outcome predictor , 2011, Nature Neuroscience.

[5]  J. W. Aldridge,et al.  Coding of Serial Order by Neostriatal Neurons: A “Natural Action” Approach to Movement Sequence , 1998, The Journal of Neuroscience.

[6]  Z. Rossetti,et al.  Noradrenaline and Dopamine Elevations in the Rat Prefrontal Cortex in Spatial Working Memory , 2005, The Journal of Neuroscience.

[7]  Keiji Tanaka,et al.  Neuronal Correlates of Goal-Based Motor Selection in the Prefrontal Cortex , 2003, Science.

[8]  S. Mizumori,et al.  Neurons in rat medial prefrontal cortex show anticipatory rate changes to predictable differential rewards in a spatial memory task , 2001, Behavioural Brain Research.

[9]  Daniel Durstewitz,et al.  Successful choice behavior is associated with distinct and coherent network states in anterior cingulate cortex , 2008, Proceedings of the National Academy of Sciences.

[10]  Timothy E. J. Behrens,et al.  Review Frontal Cortex and Reward-guided Learning and Decision-making Figure 1. Frontal Brain Regions in the Macaque Involved in Reward-guided Learning and Decision-making Finer Grained Anatomical Divisions with Frontal Cortical Systems for Reward-guided Behavior , 2022 .

[11]  J. Seamans,et al.  Dopamine and Serotonin Interactively Modulate Prefrontal Cortex Neurons In Vitro , 2011, Biological Psychiatry.

[12]  B. Richmond,et al.  Anterior Cingulate: Single Neuronal Signals Related to Degree of Reward Expectancy , 2002, Science.

[13]  Masataka Watanabe,et al.  Prefrontal and cingulate unit activity during timing behavior in the monkey , 1979, Brain Research.

[14]  M. Jung,et al.  Dynamics of Population Code for Working Memory in the Prefrontal Cortex , 2003, Neuron.

[15]  Barry J. Richmond,et al.  Differential Encoding of Factors Influencing Predicted Reward Value in Monkey Rostral Anterior Cingulate Cortex , 2012, PloS one.

[16]  S. Floresco,et al.  Magnitude of Dopamine Release in Medial Prefrontal Cortex Predicts Accuracy of Memory on a Delayed Response Task , 2004, The Journal of Neuroscience.

[17]  Daeyeol Lee,et al.  Prefrontal Neural Correlates of Memory for Sequences , 2007, The Journal of Neuroscience.

[18]  J. Tanji,et al.  Integration of temporal order and object information in the monkey lateral prefrontal cortex. , 2004, Journal of neurophysiology.

[19]  G. Paxinos,et al.  The Rat Brain in Stereotaxic Coordinates , 1983 .

[20]  J. Tanji,et al.  Categorization of behavioural sequences in the prefrontal cortex , 2007, Nature.

[21]  R. Roth,et al.  Topographical organization of the efferent projections of the medial prefrontal cortex in the rat: An anterograde tract‐tracing study with Phaseolus vulgaris leucoagglutinin , 1989, The Journal of comparative neurology.

[22]  W. Kargo,et al.  Adaptation of Prefrontal Cortical Firing Patterns and Their Fidelity to Changes in Action–Reward Contingencies , 2007, The Journal of Neuroscience.

[23]  A. Phillips,et al.  Modulation by Central and Basolateral Amygdalar Nuclei of Dopaminergic Correlates of Feeding to Satiety in the Rat Nucleus Accumbens and Medial Prefrontal Cortex , 2002, The Journal of Neuroscience.

[24]  Mark Laubach,et al.  Reversible inactivations of rat medial prefrontal cortex impair the ability to wait for a stimulus , 2006, Neuroscience.

[25]  M. Manfredi,et al.  The masseter inhibitory reflex is evoked by innocuous stimuli and mediated by A beta afferent fibres , 2004, Experimental Brain Research.

[26]  J. Joseph,et al.  Prefrontal cortex and spatial sequencing in macaque monkey , 2004, Experimental Brain Research.

[27]  A M Graybiel,et al.  Time-varying covariance of neural activities recorded in striatum and frontal cortex as monkeys perform sequential-saccade tasks. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[28]  G. E. Alexander,et al.  Movement sequence-related activity reflecting numerical order of components in supplementary and presupplementary motor areas. , 1998, Journal of neurophysiology.

[29]  E. Procyk,et al.  Anterior cingulate activity during routine and non-routine sequential behaviors in macaques , 2000, Nature Neuroscience.

[30]  J. Tanji,et al.  Activity in the Lateral Prefrontal Cortex Reflects Multiple Steps of Future Events in Action Plans , 2006, Neuron.

[31]  Daniel Durstewitz,et al.  Self-Organizing Neural Integrator Predicts Interval Times through Climbing Activity , 2003, The Journal of Neuroscience.

[32]  M. Hasselmo,et al.  What is the Functional Relevance of Prefrontal Cortex Entrainment to Hippocampal Theta Rhythms? , 2011, Front. Neurosci..

[33]  Kae Nakamura,et al.  Neuronal activity in medial frontal cortex during learning of sequential procedures. , 1998, Journal of neurophysiology.

[34]  Eric A. Zilli,et al.  Medial prefrontal cortex cells show dynamic modulation with the hippocampal theta rhythm dependent on behavior , 2005, Hippocampus.

[35]  Jae-Wook Ryou,et al.  Making your next move: Dorsolateral prefrontal cortex and planning a sequence of actions in freely moving monkeys , 2004, Cognitive, affective & behavioral neuroscience.

[36]  D. Durstewitz,et al.  Abrupt Transitions between Prefrontal Neural Ensemble States Accompany Behavioral Transitions during Rule Learning , 2010, Neuron.

[37]  Jonathan D. Wallis,et al.  Neurons in the Frontal Lobe Encode the Value of Multiple Decision Variables , 2009, Journal of Cognitive Neuroscience.

[38]  Carl R Olson,et al.  Rank signals in four areas of macaque frontal cortex during selection of actions and objects in serial order. , 2010, Journal of neurophysiology.

[39]  Barak F. Caracheo,et al.  Abrupt changes in the patterns and complexity of anterior cingulate cortex activity when food is introduced into an environment , 2013, Front. Neurosci..

[40]  Xiao-Jing Wang,et al.  The importance of mixed selectivity in complex cognitive tasks , 2013, Nature.

[41]  Eldon Emberly,et al.  Action and outcome activity state patterns in the anterior cingulate cortex. , 2013, Cerebral cortex.

[42]  D. Durstewitz,et al.  Contextual encoding by ensembles of medial prefrontal cortex neurons , 2012, Proceedings of the National Academy of Sciences.

[43]  A. Graybiel,et al.  Prolonged Dopamine Signalling in Striatum Signals Proximity and Value of Distant Rewards , 2013, Nature.

[44]  M. Laubach,et al.  Delay activity in rodent frontal cortex during a simple reaction time task. , 2009, Journal of neurophysiology.

[45]  M. Laubach,et al.  Reward-related activity in the medial prefrontal cortex is driven by consumption , 2013, Front. Neurosci..

[46]  Douglas A Nitz,et al.  Anterior cingulate neurons in the rat map anticipated effort and reward to their associated action sequences. , 2012, Journal of neurophysiology.