Corticostriatal Interactions during Learning, Memory Processing, and Decision Making

This mini-symposium aims to integrate recent insights from anatomy, behavior, and neurophysiology, highlighting the anatomical organization, behavioral significance, and information-processing mechanisms of corticostriatal interactions. In this summary of topics, which is not meant to provide a comprehensive survey, we will first review the anatomy of corticostriatal circuits, comparing different ways by which “loops” of cortical–basal ganglia circuits communicate. Next, we will address the causal importance and systems-neurophysiological mechanisms of corticostriatal interactions for memory, emphasizing the communication between hippocampus and ventral striatum during contextual conditioning. Furthermore, ensemble recording techniques have been applied to compare information processing in the dorsal and ventral striatum to predictions from reinforcement learning theory. We will next discuss how neural activity develops in corticostriatal areas when habits are learned. Finally, we will evaluate the role of GABAergic interneurons in dynamically transforming cortical inputs into striatal output during learning and decision making.

[1]  J. Berke,et al.  Fast oscillations in cortical‐striatal networks switch frequency following rewarding events and stimulant drugs , 2009, The European journal of neuroscience.

[2]  K. Doya,et al.  Validation of Decision-Making Models and Analysis of Decision Variables in the Rat Basal Ganglia , 2009, The Journal of Neuroscience.

[3]  B. McNaughton,et al.  Hippocampus Leads Ventral Striatum in Replay of Place-Reward Information , 2009, PLoS biology.

[4]  Kathryn E. Merrick,et al.  Motivated Reinforcement Learning - Curious Characters for Multiuser Games , 2009 .

[5]  K. Blackwell,et al.  Gap Junctions between Striatal Fast-Spiking Interneurons Regulate Spiking Activity and Synchronization as a Function of Cortical Activity , 2009, The Journal of Neuroscience.

[6]  A. Dickinson,et al.  Parallel and interactive learning processes within the basal ganglia: Relevance for the understanding of addiction , 2009, Behavioural Brain Research.

[7]  B. Balleine,et al.  The integrative function of the basal ganglia in instrumental conditioning , 2009, Behavioural Brain Research.

[8]  J. Doyon,et al.  Contributions of the basal ganglia and functionally related brain structures to motor learning , 2009, Behavioural Brain Research.

[9]  Matthijs A. A. van der Meer,et al.  Frontiers in Integrative Neuroscience Integrative Neuroscience Low and High Gamma Oscillations in Rat Ventral Striatum Have Distinct Relationships to Behavior, Reward, and Spiking Activity on a Learned Spatial Decision Task , 2022 .

[10]  W. Singer,et al.  Frontiers in Integrative Neuroscience Integrative Neuroscience Neural Synchrony in Cortical Networks: History, Concept and Current Status , 2022 .

[11]  T. Fukuda Network Architecture of Gap Junction-Coupled Neuronal Linkage in the Striatum , 2009, The Journal of Neuroscience.

[12]  Matthijs A. A. van der Meer,et al.  Frontiers in Integrative Neuroscience Integrative Neuroscience Covert Expectation-of-reward in Rat Ventral Striatum at Decision Points , 2022 .

[13]  H. Eichenbaum,et al.  Striatal versus hippocampal representations during win-stay maze performance. , 2009, Journal of neurophysiology.

[14]  J. Berke Uncoordinated Firing Rate Changes of Striatal Fast-Spiking Interneurons during Behavioral Task Performance , 2008, The Journal of Neuroscience.

[15]  T. Robbins,et al.  Functional Interaction between the Hippocampus and Nucleus Accumbens Shell Is Necessary for the Acquisition of Appetitive Spatial Context Conditioning , 2008, The Journal of Neuroscience.

[16]  B. McNaughton,et al.  Preferential Reactivation of Motivationally Relevant Information in the Ventral Striatum , 2008, The Journal of Neuroscience.

[17]  A. Graybiel Habits, rituals, and the evaluative brain. , 2008, Annual review of neuroscience.

[18]  Colin Camerer,et al.  Dissociating the Role of the Orbitofrontal Cortex and the Striatum in the Computation of Goal Values and Prediction Errors , 2008, The Journal of Neuroscience.

[19]  A. D. Redish,et al.  Task-dependent encoding of space and events by striatal neurons is dependent on neural subtype , 2008, Neuroscience.

[20]  Seth J. Ramus,et al.  Interactions between the Orbitofrontal Cortex and the Hippocampal Memory System during the Storage of Long‐Term Memory , 2007, Annals of the New York Academy of Sciences.

[21]  Matthijs A. A. van der Meer,et al.  Integrating hippocampus and striatum in decision-making , 2007, Current Opinion in Neurobiology.

[22]  JaneR . Taylor,et al.  Bidirectional modulation of goal-directed actions by prefrontal cortical dopamine. , 2007, Cerebral cortex.

[23]  D. R. Euston,et al.  Fast-Forward Playback of Recent Memory Sequences in Prefrontal Cortex During Sleep , 2007, Science.

[24]  Adam Johnson,et al.  Neural Ensembles in CA3 Transiently Encode Paths Forward of the Animal at a Decision Point , 2007, The Journal of Neuroscience.

[25]  G. Buzsáki,et al.  Forward and reverse hippocampal place-cell sequences during ripples , 2007, Nature Neuroscience.

[26]  J. O'Doherty,et al.  What We Know and Do Not Know about the Functions of the Orbitofrontal Cortex after 20 Years of Cross-Species Studies , 2007, The Journal of Neuroscience.

[27]  P. W. German,et al.  Rat nucleus accumbens neurons persistently encode locations associated with morphine reward. , 2007, Journal of neurophysiology.

[28]  M. West,et al.  Changes in activity of the striatum during formation of a motor habit , 2007, The European journal of neuroscience.

[29]  M. Wilson,et al.  Coordinated memory replay in the visual cortex and hippocampus during sleep , 2007, Nature Neuroscience.

[30]  R. O’Reilly,et al.  Separate neural substrates for skill learning and performance in the ventral and dorsal striatum , 2007, Nature Neuroscience.

[31]  S. Nicola The nucleus accumbens as part of a basal ganglia action selection circuit , 2007, Psychopharmacology.

[32]  Gong-Wu Wang,et al.  Disconnection of the hippocampal–prefrontal cortical circuits impairs spatial working memory performance in rats , 2006, Behavioural Brain Research.

[33]  M. Richard Theories of Hippocampal Function , 2006 .

[34]  S. Quartz,et al.  Neural Differentiation of Expected Reward and Risk in Human Subcortical Structures , 2006, Neuron.

[35]  P. Dayan,et al.  Opinion TRENDS in Cognitive Sciences Vol.10 No.8 Full text provided by www.sciencedirect.com A normative perspective on motivation , 2022 .

[36]  T. Robbins,et al.  Functions of frontostriatal systems in cognition: Comparative neuropsychopharmacological studies in rats, monkeys and humans , 2006, Biological Psychology.

[37]  Bruce L McNaughton,et al.  Selective excitotoxic lesions of the hippocampus and basolateral amygdala have dissociable effects on appetitive cue and place conditioning based on path integration in a novel Y‐maze procedure , 2006, The European journal of neuroscience.

[38]  H. Yin,et al.  The role of the basal ganglia in habit formation , 2006, Nature Reviews Neuroscience.

[39]  K. Doya,et al.  The computational neurobiology of learning and reward , 2006, Current Opinion in Neurobiology.

[40]  C. Pennartz,et al.  Anatomical evidence for direct connections between the shell and core subregions of the rat nucleus accumbens , 2005, Neuroscience.

[41]  P. Dayan,et al.  Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control , 2005, Nature Neuroscience.

[42]  A. Graybiel,et al.  Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories , 2005, Nature.

[43]  M. DiFiglia,et al.  Altered parvalbumin-positive neuron distribution in basal ganglia of individuals with Tourette syndrome. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[44]  Jeffrey C. Cooper,et al.  Functional magnetic resonance imaging of reward prediction , 2005, Current opinion in neurology.

[45]  Sabrina M. Tom,et al.  The Neural Correlates of Motor Skill Automaticity , 2005, The Journal of Neuroscience.

[46]  P. O’Donnell,et al.  Prefrontal cortical cell firing during maintenance, extinction, and reinstatement of goal‐directed behavior for natural reward , 2005, Synapse.

[47]  A. Faure,et al.  Lesion to the Nigrostriatal Dopamine System Disrupts Stimulus-Response Habit Formation , 2005, The Journal of Neuroscience.

[48]  Howard L Fields,et al.  Encoding of Palatability and Appetitive Behaviors by Distinct Neuronal Populations in the Nucleus Accumbens , 2005, The Journal of Neuroscience.

[49]  Joshua D. Berke,et al.  Participation of Striatal Neurons in Large-Scale Oscillatory Networks , 2005 .

[50]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[51]  H. Eichenbaum,et al.  Oscillatory Entrainment of Striatal Neurons in Freely Moving Rats , 2004, Neuron.

[52]  T. Robbins,et al.  Putting a spin on the dorsal–ventral divide of the striatum , 2004, Trends in Neurosciences.

[53]  B. McNaughton,et al.  The Ventral Striatum in Off-Line Processing: Ensemble Reactivation during Sleep and Modulation by Hippocampal Ripples , 2004, The Journal of Neuroscience.

[54]  J. W. Aldridge,et al.  Basal ganglia neural mechanisms of natural movement sequences. , 2004, Canadian journal of physiology and pharmacology.

[55]  Karl J. Friston,et al.  Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning , 2004, Science.

[56]  R. Wightman,et al.  Dopamine Operates as a Subsecond Modulator of Food Seeking , 2004, The Journal of Neuroscience.

[57]  K. Lynch,et al.  Accumbal neural responses during the initiation and maintenance of intravenous cocaine self-administration. , 2004, Journal of neurophysiology.

[58]  R. Kesner,et al.  The role of the prefrontal cortex in object–place learning: a test of the attribute specificity model , 2003, Behavioural Brain Research.

[59]  Cyriel M. A. Pennartz,et al.  Learning-related changes in response patterns of prefrontal neurons during instrumental conditioning , 2003, Behavioural Brain Research.

[60]  S. Killcross,et al.  Inactivation of the infralimbic prefrontal cortex reinstates goal-directed responding in overtrained rats , 2003, Behavioural Brain Research.

[61]  Wolfram Schultz,et al.  Effects of expectations for different reward magnitudes on neuronal activity in primate striatum. , 2003, Journal of neurophysiology.

[62]  S. Killcross,et al.  Coordination of actions and habits in the medial prefrontal cortex of rats. , 2003, Cerebral cortex.

[63]  J. Rawlins,et al.  Effects of medial prefrontal cortex cytotoxic lesions in mice , 2003, Behavioural Brain Research.

[64]  Mark R. Bower,et al.  Off-line reprocessing of recent memory and its role in memory consolidation: a progress report , 2003 .

[65]  Albert K. Lee,et al.  Memory of Sequential Experience in the Hippocampus during Slow Wave Sleep , 2002, Neuron.

[66]  B L McNaughton,et al.  Coordinated Reactivation of Distributed Memory Traces in Primate Neocortex , 2002, Science.

[67]  J. Feldon,et al.  Effect of excitotoxic lesions of rat medial prefrontal cortex on spatial memory , 2002, Behavioural Brain Research.

[68]  B. Everitt,et al.  Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex , 2002, Neuroscience & Biobehavioral Reviews.

[69]  Kae Nakamura,et al.  Central mechanisms of motor skill learning , 2002, Current Opinion in Neurobiology.

[70]  B L McNaughton,et al.  Memory reactivation and consolidation during sleep: from cellular mechanisms to human performance. , 2002, Progress in brain research.

[71]  A. Sadikot,et al.  GABA promotes survival but not proliferation of parvalbumin-immunoreactive interneurons in rodent neostriatum: an in vivo study with stereology , 2001, Neuroscience.

[72]  R. Joosten,et al.  Place and Response Learning of Rats in a Morris Water Maze: Differential Effects of Fimbria Fornix and Medial Prefrontal Cortex Lesions , 2001, Neurobiology of Learning and Memory.

[73]  Peter Dayan,et al.  Motivated Reinforcement Learning , 2001, NIPS.

[74]  W. Schultz Multiple reward signals in the brain , 2000, Nature Reviews Neuroscience.

[75]  L. Abbott,et al.  Synaptic plasticity: taming the beast , 2000, Nature Neuroscience.

[76]  Nikolaus R. McFarland,et al.  Striatonigrostriatal Pathways in Primates Form an Ascending Spiral from the Shell to the Dorsolateral Striatum , 2000, The Journal of Neuroscience.

[77]  T. Robbins,et al.  Disconnection of the anterior cingulate cortex and nucleus accumbens core impairs Pavlovian approach behavior: further evidence for limbic cortical-ventral striatopallidal systems. , 2000, Behavioral neuroscience.

[78]  J. Changeux,et al.  Reward-dependent learning in neuronal networks for planning and decision making. , 2000, Progress in brain research.

[79]  S. Ikemoto,et al.  The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking , 1999, Brain Research Reviews.

[80]  C. I. Connolly,et al.  Building neural representations of habits. , 1999, Science.

[81]  J. Deniau,et al.  Three-dimensional distribution of nigrostriatal neurons in the rat: relation to the topography of striatonigral projections , 1999, Neuroscience.

[82]  B. Setlow,et al.  Differential effects of immediate posttraining sulphide microinfusions into the nucleus accumbens shell and core on Morris water maze retention , 1999, Psychobiology.

[83]  B. McNaughton,et al.  Reactivation of Hippocampal Cell Assemblies: Effects of Behavioral State, Experience, and EEG Dynamics , 1999, The Journal of Neuroscience.

[84]  J. Tepper,et al.  Inhibitory control of neostriatal projection neurons by GABAergic interneurons , 1999, Nature Neuroscience.

[85]  J. Bolam,et al.  Selective Innervation of Neostriatal Interneurons by a Subclass of Neuron in the Globus Pallidus of the Rat , 1998, The Journal of Neuroscience.

[86]  B. Balleine,et al.  Goal-directed instrumental action: contingency and incentive learning and their cortical substrates , 1998, Neuropharmacology.

[87]  R P Kesner,et al.  Differential involvement of the dorsal anterior cingulate and prelimbic-infralimbic areas of the rodent prefrontal cortex in spatial working memory. , 1998, Behavioral neuroscience.

[88]  G. Schoenbaum,et al.  Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning , 1998, Nature Neuroscience.

[89]  B. McNaughton,et al.  Memory reprocessing in corticocortical and hippocampocortical neuronal ensembles. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[90]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[91]  J. Seamans,et al.  Selective Roles for Hippocampal, Prefrontal Cortical, and Ventral Striatal Circuits in Radial-Arm Maze Tasks With or Without a Delay , 1997, The Journal of Neuroscience.

[92]  H. Markram,et al.  Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs , 1997, Science.

[93]  James L. McClelland,et al.  Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. , 1995, Psychological review.

[94]  M. Kimura Role of basal ganglia in behavioral learning , 1995, Neuroscience Research.

[95]  A. Grace,et al.  Synaptic interactions among excitatory afferents to nucleus accumbens neurons: hippocampal gating of prefrontal cortical input , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[96]  A M Graybiel,et al.  The basal ganglia and adaptive motor control. , 1994, Science.

[97]  B. McNaughton,et al.  Reactivation of hippocampal ensemble memories during sleep. , 1994, Science.

[98]  Joel L. Davis,et al.  A Model of How the Basal Ganglia Generate and Use Neural Signals That Predict Reinforcement , 1994 .

[99]  W. Schultz,et al.  Neuronal activity in monkey ventral striatum related to the expectation of reward , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[100]  T. Robbins,et al.  The basolateral amygdala-ventral striatal system and conditioned place preference: Further evidence of limbic-striatal interactions underlying reward-related processes , 1991, Neuroscience.

[101]  G. E. Alexander,et al.  Functional architecture of basal ganglia circuits: neural substrates of parallel processing , 1990, Trends in Neurosciences.

[102]  G. E. Alexander,et al.  Basal ganglia-thalamocortical circuits: parallel substrates for motor, oculomotor, "prefrontal" and "limbic" functions. , 1990, Progress in brain research.

[103]  G. Buzsáki Two-stage model of memory trace formation: A role for “noisy” brain states , 1989, Neuroscience.

[104]  T. Robbins,et al.  Involvement of the amygdala in stimulus-reward associations: Interaction with the ventral striatum , 1989, Neuroscience.

[105]  C. Pavlides,et al.  Influences of hippocampal place cell firing in the awake state on the activity of these cells during subsequent sleep episodes , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[106]  O. Hikosaka,et al.  Functional properties of monkey caudate neurons. III. Activities related to expectation of target and reward. , 1989, Journal of neurophysiology.

[107]  A. Dickinson Actions and habits: the development of behavioural autonomy , 1985 .

[108]  Douglas L. Jones,et al.  From motivation to action: Functional interface between the limbic system and the motor system , 1980, Progress in Neurobiology.

[109]  G. P. Smith,et al.  Efferent connections and nigral afferents of the nucleus accumbens septi in the rat , 1978, Neuroscience.

[110]  D Marr,et al.  Simple memory: a theory for archicortex. , 1971, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.