Parallel contributions of distinct human memory systems during probabilistic learning

Regions within the medial temporal lobe and basal ganglia are thought to subserve distinct memory systems underlying declarative and nondeclarative processes, respectively. One question of interest is how these multiple memory systems interact during learning to contribute to goal directed behavior. While some hypotheses suggest that regions such as the striatum and the hippocampus interact in a competitive manner, alternative views posit that these structures may operate in a parallel manner to facilitate learning. In the current experiment, we probed the functional connectivity between regions in the striatum and hippocampus in the human brain during an event related probabilistic learning task that varied with respect to type of difficulty (easy or hard cues) and type of learning (via feedback or observation). We hypothesized that the hippocampus and striatum would interact in a parallel manner during learning. We identified regions of interest (ROI) in the striatum and hippocampus that showed an effect of cue difficulty during learning and found that such ROIs displayed a similar pattern of blood oxygen level dependent (BOLD) responses, irrespective of learning type, and were functionally correlated as assessed by a Granger causality analysis. Given the connectivity of both structures with dopaminergic midbrain centers, we further applied a reinforcement learning algorithm often used to highlight the role of dopamine in human reward related learning paradigms. Activity in both the striatum and hippocampus positively correlated with a prediction error signal during feedback learning. These results suggest that distinct human memory systems operate in parallel during probabilistic learning, and may act synergistically particularly when a violation of expectation occurs, to jointly contribute to learning and decision making.

[1]  Elizabeth Tricomi,et al.  Feedback signals in the caudate reflect goal achievement on a declarative memory task , 2008, NeuroImage.

[2]  B. Knowlton,et al.  Learning and memory functions of the Basal Ganglia. , 2002, Annual review of neuroscience.

[3]  M. Gluck,et al.  Basal ganglia and dopamine contributions to probabilistic category learning , 2008, Neuroscience & Biobehavioral Reviews.

[4]  Gary H. Glover,et al.  Contributions of the hippocampus and the striatum to simple association and frequency-based learning , 2005, NeuroImage.

[5]  Carol A. Seger,et al.  How do the basal ganglia contribute to categorization? Their roles in generalization, response selection, and learning via feedback , 2008, Neuroscience & Biobehavioral Reviews.

[6]  L. Squire Declarative and Nondeclarative Memory: Multiple Brain Systems Supporting Learning and Memory , 1992, Journal of Cognitive Neuroscience.

[7]  D. Schacter,et al.  The Evolution of Multiple Memory Systems , 1987 .

[8]  P. Matthews,et al.  Learning about pain: the neural substrate of the prediction error for aversive events. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[9]  W. F. Prokasy,et al.  Classical conditioning II: Current research and theory. , 1972 .

[10]  M. Gluck,et al.  Interactive memory systems in the human brain , 2001, Nature.

[11]  M. Gluck,et al.  Probabilistic classification learning in amnesia. , 1994, Learning & memory.

[12]  S. Inati,et al.  An fMRI study of reward-related probability learning , 2005, NeuroImage.

[13]  Herve Simon,et al.  Origin of dopaminergic innervation of the rat hippocampal formation , 1980, Neuroscience Letters.

[14]  M. Greicius,et al.  Regional analysis of hippocampal activation during memory encoding and retrieval: fMRI study , 2003, Hippocampus.

[15]  P. Strick,et al.  Basal Ganglia Output and Cognition: Evidence from Anatomical, Behavioral, and Clinical Studies , 2000, Brain and Cognition.

[16]  Rainer Goebel,et al.  Analysis of functional image analysis contest (FIAC) data with brainvoyager QX: From single‐subject to cortically aligned group general linear model analysis and self‐organizing group independent component analysis , 2006, Human brain mapping.

[17]  R. J. McDonald,et al.  Multiple Parallel Memory Systems in the Brain of the Rat , 2002, Neurobiology of Learning and Memory.

[18]  Carol A. Seger,et al.  Dynamics of frontal, striatal, and hippocampal systems during rule learning. , 2005, Cerebral cortex.

[19]  Carol A. Seger,et al.  Dissociation between Striatal Regions while Learning to Categorize via Feedback and via Observation , 2007, Journal of Cognitive Neuroscience.

[20]  M. Gluck,et al.  Probabilistic categorization: How do normal participants and amnesic patients do it? , 2008, Neuroscience & Biobehavioral Reviews.

[21]  J. Lisman,et al.  The Hippocampal-VTA Loop: Controlling the Entry of Information into Long-Term Memory , 2005, Neuron.

[22]  Henrik Walter,et al.  Prediction error as a linear function of reward probability is coded in human nucleus accumbens , 2006, NeuroImage.

[23]  S. N. Haber,et al.  The organization of midbrain projections to the ventral striatum in the primate , 1994, Neuroscience.

[24]  G. Vanni-Mercier,et al.  The Hippocampus Codes the Uncertainty of Cue–Outcome Associations: An Intracranial Electrophysiological Study in Humans , 2009, The Journal of Neuroscience.

[25]  M. Delgado,et al.  Reward‐Related Responses in the Human Striatum , 2007, Annals of the New York Academy of Sciences.

[26]  M. Packard,et al.  Dissociation of hippocampus and caudate nucleus memory systems by posttraining intracerebral injection of dopamine agonists. , 1991, Behavioral neuroscience.

[27]  Rainer Goebel,et al.  Investigating directed cortical interactions in time-resolved fMRI data using vector autoregressive modeling and Granger causality mapping. , 2003, Magnetic resonance imaging.

[28]  C. Stark,et al.  Striatal and medial temporal lobe functional interactions during visuomotor associative learning. , 2011, Cerebral cortex.

[29]  Jonathan D. Cohen,et al.  Improved Assessment of Significant Activation in Functional Magnetic Resonance Imaging (fMRI): Use of a Cluster‐Size Threshold , 1995, Magnetic resonance in medicine.

[30]  H. Heinze,et al.  Reward-related fMRI activation of dopaminergic midbrain is associated with enhanced hippocampus-dependent long-term memory formation , 2005 .

[31]  W. Schultz Getting Formal with Dopamine and Reward , 2002, Neuron.

[32]  Daphna Shohamy,et al.  Strategies in probabilistic categorization: results from a new way of analyzing performance. , 2006, Learning & memory.

[33]  S. Haber The primate basal ganglia: parallel and integrative networks , 2003, Journal of Chemical Neuroanatomy.

[34]  S. Holm A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[35]  Karl J. Friston,et al.  Temporal Difference Models and Reward-Related Learning in the Human Brain , 2003, Neuron.

[36]  P. Montague,et al.  Activity in human ventral striatum locked to errors of reward prediction , 2002, Nature Neuroscience.

[37]  D. Shohamy,et al.  Integrating Memories in the Human Brain: Hippocampal-Midbrain Encoding of Overlapping Events , 2008, Neuron.

[38]  W. Rice ANALYZING TABLES OF STATISTICAL TESTS , 1989, Evolution; international journal of organic evolution.

[39]  M. Delgado,et al.  Modulation of Caudate Activity by Action Contingency , 2004, Neuron.

[40]  P. Strick,et al.  Basal ganglia and cerebellar loops: motor and cognitive circuits , 2000, Brain Research Reviews.

[41]  Joel L. Davis,et al.  Adaptive Critics and the Basal Ganglia , 1995 .

[42]  M. Gluck,et al.  How do people solve the "weather prediction" task?: individual variability in strategies for probabilistic category learning. , 2002, Learning & memory.

[43]  Moser Edvard,et al.  Pattern Separation in the Dentate Gyrus , 2009 .

[44]  R. Passingham,et al.  Learning Arbitrary Visuomotor Associations: Temporal Dynamic of Brain Activity , 2001, NeuroImage.

[45]  M. Gluck,et al.  Cortico-striatal contributions to feedback-based learning: converging data from neuroimaging and neuropsychology. , 2004, Brain : a journal of neurology.

[46]  A. Barto Adaptive Critics and the Basal Ganglia , 1995 .

[47]  H. Heinze,et al.  Reward-Related fMRI Activation of Dopaminergic Midbrain Is Associated with Enhanced Hippocampus- Dependent Long-Term Memory Formation , 2005, Neuron.

[48]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[49]  Samuel M. McClure,et al.  Temporal Prediction Errors in a Passive Learning Task Activate Human Striatum , 2003, Neuron.

[50]  Rainer Goebel,et al.  Mapping directed influence over the brain using Granger causality and fMRI , 2005, NeuroImage.

[51]  Brian Knutson,et al.  Reward-Motivated Learning: Mesolimbic Activation Precedes Memory Formation , 2006, Neuron.

[53]  D. Shohamy,et al.  Dopamine and adaptive memory , 2010, Trends in Cognitive Sciences.

[54]  Russell A. Poldrack,et al.  Guidelines for reporting an fMRI study , 2008, NeuroImage.

[55]  Kyle S. Smith,et al.  Corticostriatal Interactions during Learning, Memory Processing, and Decision Making , 2009, The Journal of Neuroscience.

[56]  Carol A. Seger,et al.  The Roles of the Caudate Nucleus in Human Classification Learning , 2005, The Journal of Neuroscience.

[57]  A. Kelley,et al.  The distribution of the projection from the hippocampal formation to the nucleus accumbens in the rat: An anterograde and retrograde-horseradish peroxidase study , 1982, Neuroscience.

[58]  N. Bunzeck,et al.  Absolute Coding of Stimulus Novelty in the Human Substantia Nigra/VTA , 2006, Neuron.

[59]  D. Lagnado,et al.  Challenging the role of implicit processes in probabilistic category learning , 2007, Psychonomic bulletin & review.

[60]  L. Swanson,et al.  The projections of the ventral tegmental area and adjacent regions: A combined fluorescent retrograde tracer and immunofluorescence study in the rat , 1982, Brain Research Bulletin.

[61]  Guillén Fernández,et al.  Interaction between the Human Hippocampus and the Caudate Nucleus during Route Recognition , 2004, Neuron.

[62]  M. Kawato,et al.  Association Learning Caudate Nucleus During Stimulus-Action-Reward and Reward Expectation Error in the Putamen and Different Neural Correlates of Reward Expectation , 2006 .

[63]  E. Kandel,et al.  D1/D5 receptor agonists induce a protein synthesis-dependent late potentiation in the CA1 region of the hippocampus. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[64]  Karl J. Friston,et al.  Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning , 2004, Science.

[65]  L. Squire,et al.  Structure and function of declarative and nondeclarative memory systems. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[66]  Raymond J. Dolan,et al.  Anticipation of novelty recruits reward system and hippocampus while promoting recollection , 2007, NeuroImage.

[67]  J. D. McGaugh,et al.  Inactivation of Hippocampus or Caudate Nucleus with Lidocaine Differentially Affects Expression of Place and Response Learning , 1996, Neurobiology of Learning and Memory.

[68]  R. Rescorla A theory of pavlovian conditioning: The effectiveness of reinforcement and non-reinforcement , 1972 .

[69]  B. Knowlton,et al.  A Dissociation of Encoding and Retrieval Processes in the Human Hippocampus , 2005, The Journal of Neuroscience.

[70]  Chris Watkins,et al.  Learning from delayed rewards , 1989 .

[71]  J. Geweke,et al.  Measurement of Linear Dependence and Feedback between Multiple Time Series , 1982 .

[72]  R. O’Reilly,et al.  The role of the dorsal striatum and dorsal hippocampus in probabilistic and deterministic odor discrimination tasks. , 2008, Learning & memory.

[73]  Russell A Poldrack,et al.  Modulation of competing memory systems by distraction. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[74]  R. Poldrack,et al.  Competition among multiple memory systems: converging evidence from animal and human brain studies , 2003, Neuropsychologia.

[75]  R E Harlan,et al.  The accumbens: beyond the core-shell dichotomy. , 1997, The Journal of neuropsychiatry and clinical neurosciences.

[76]  C. Pittenger,et al.  A double dissociation revealing bidirectional competition between striatum and hippocampus during learning , 2008, Proceedings of the National Academy of Sciences.

[77]  Emery N Brown,et al.  Behavioral / Systems / Cognitive Functional Magnetic Resonance Imaging Activity during the Gradual Acquisition and Expression of Paired-Associate Memory , 2005 .