Striatal and hippocampal entropy and recognition signals in category learning: simultaneous processes revealed by model-based fMRI.

Category learning is a complex phenomenon that engages multiple cognitive processes, many of which occur simultaneously and unfold dynamically over time. For example, as people encounter objects in the world, they simultaneously engage processes to determine their fit with current knowledge structures, gather new information about the objects, and adjust their representations to support behavior in future encounters. Many techniques that are available to understand the neural basis of category learning assume that the multiple processes that subserve it can be neatly separated between different trials of an experiment. Model-based functional magnetic resonance imaging offers a promising tool to separate multiple, simultaneously occurring processes and bring the analysis of neuroimaging data more in line with category learning's dynamic and multifaceted nature. We use model-based imaging to explore the neural basis of recognition and entropy signals in the medial temporal lobe and striatum that are engaged while participants learn to categorize novel stimuli. Consistent with theories suggesting a role for the anterior hippocampus and ventral striatum in motivated learning in response to uncertainty, we find that activation in both regions correlates with a model-based measure of entropy. Simultaneously, separate subregions of the hippocampus and striatum exhibit activation correlated with a model-based recognition strength measure. Our results suggest that model-based analyses are exceptionally useful for extracting information about cognitive processes from neuroimaging data. Models provide a basis for identifying the multiple neural processes that contribute to behavior, and neuroimaging data can provide a powerful test bed for constraining and testing model predictions.

[1]  R. Morris,et al.  Place navigation impaired in rats with hippocampal lesions , 1982, Nature.

[2]  G. E. Alexander,et al.  Parallel organization of functionally segregated circuits linking basal ganglia and cortex. , 1986, Annual review of neuroscience.

[3]  John R. Anderson,et al.  The Adaptive Nature of Human Categorization , 1991 .

[4]  L. Squire Memory and the hippocampus: a synthesis from findings with rats, monkeys, and humans. , 1992, Psychological review.

[5]  L. Swanson,et al.  Projections of the ventral subiculum to the amygdala, septum, and hypothalamus: A PHAL anterograde tract‐tracing study in the rat , 1992, The Journal of comparative neurology.

[6]  W. T. Maddox,et al.  Relations between prototype, exemplar, and decision bound models of categorization , 1993 .

[7]  R. Nosofsky,et al.  Comparing modes of rule-based classification learning: A replication and extension of Shepard, Hovland, and Jenkins (1961) , 1994, Memory & cognition.

[8]  R M Nosofsky,et al.  Recognition memory for exceptions to the category rule. , 1995, Journal of experimental psychology. Learning, memory, and cognition.

[9]  A. Pickering,et al.  New approaches to the study of amnesic patients: what can a neurofunctional philosophy and neural network methods offer? , 1997, Memory.

[10]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[11]  Gregory Ashby,et al.  A neuropsychological theory of multiple systems in category learning. , 1998, Psychological review.

[12]  M. Moser,et al.  Functional differentiation in the hippocampus , 1998, Hippocampus.

[13]  Garrett E. Alexander Basal ganglia , 1998 .

[14]  Karl J. Friston,et al.  Segregating the functions of human hippocampus. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[15]  C. Carter,et al.  Complementary Category Learning Systems Identified Using Event-Related Functional MRI , 2000, Journal of Cognitive Neuroscience.

[16]  M. Witter,et al.  Anatomical Organization of the Parahippocampal‐Hippocampal Network , 2000, Annals of the New York Academy of Sciences.

[17]  C. Cavada,et al.  The anatomical connections of the macaque monkey orbitofrontal cortex. A review. , 2000, Cerebral cortex.

[18]  Samuel M. McClure,et al.  Predictability Modulates Human Brain Response to Reward , 2001, The Journal of Neuroscience.

[19]  Craig E. L. Stark,et al.  When zero is not zero: The problem of ambiguous baseline conditions in fMRI , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[20]  Heikki Lyytinen,et al.  The Orienting Response in Information Processing , 2002 .

[21]  S. Engel,et al.  Dynamics of the Hippocampus During Encoding and Retrieval of Face-Name Pairs , 2003, Science.

[22]  Paul J. Reber,et al.  Dissociating Explicit and Implicit Category Knowledge with fMRI , 2003, Journal of Cognitive Neuroscience.

[23]  R. Poldrack,et al.  Competition among multiple memory systems: converging evidence from animal and human brain studies , 2003, Neuropsychologia.

[24]  Karl J. Friston,et al.  Temporal Difference Models and Reward-Related Learning in the Human Brain , 2003, Neuron.

[25]  R. Henson,et al.  A familiarity signal in human anterior medial temporal cortex? , 2003, Hippocampus.

[26]  Adam Gazzaley,et al.  Measuring functional connectivity during distinct stages of a cognitive task , 2004, NeuroImage.

[27]  M. Gluck,et al.  Human midbrain sensitivity to cognitive feedback and uncertainty during classification learning. , 2004, Journal of neurophysiology.

[28]  R. Clark,et al.  The medial temporal lobe. , 2004, Annual review of neuroscience.

[29]  R. Habib,et al.  Activation of midbrain structures by associative novelty and the formation of explicit memory in humans. , 2004, Learning & memory.

[30]  Yasuaki Sakamoto,et al.  Schematic influences on category learning and recognition memory. , 2004, Journal of experimental psychology. General.

[31]  W. T. Maddox,et al.  Dissociating explicit and procedural-learning based systems of perceptual category learning , 2004, Behavioural Processes.

[32]  D. Medin,et al.  SUSTAIN: a network model of category learning. , 2004, Psychological review.

[33]  Hans-Jochen Heinze,et al.  Dissociating intentional learning from relative novelty responses in the medial temporal lobe , 2005, NeuroImage.

[34]  Carol A. Seger,et al.  The Roles of the Caudate Nucleus in Human Classification Learning , 2005, The Journal of Neuroscience.

[35]  David L. Faigman,et al.  Human category learning. , 2005, Annual review of psychology.

[36]  F. Ashby,et al.  Category learning and multiple memory systems , 2005, Trends in Cognitive Sciences.

[37]  Raymond J. Dolan,et al.  Information theory, novelty and hippocampal responses: unpredicted or unpredictable? , 2005, Neural Networks.

[38]  Roberto Cabeza,et al.  Neural Correlates of Relational Memory: Successful Encoding and Retrieval of Semantic and Perceptual Associations , 2005, The Journal of Neuroscience.

[39]  J. Lisman,et al.  The Hippocampal-VTA Loop: Controlling the Entry of Information into Long-Term Memory , 2005, Neuron.

[40]  Ueli Rutishauser,et al.  Single-Trial Learning of Novel Stimuli by Individual Neurons of the Human Hippocampus-Amygdala Complex , 2006, Neuron.

[41]  L. Davachi Item, context and relational episodic encoding in humans , 2006, Current Opinion in Neurobiology.

[42]  R. Dolan,et al.  Anterior medial temporal lobe in human cognition: Memory for fear and the unexpected , 2006, Cognitive neuropsychiatry.

[43]  R. Cabeza,et al.  Triple dissociation in the medial temporal lobes: recollection, familiarity, and novelty. , 2006, Journal of neurophysiology.

[44]  J. Hirsch,et al.  A Neural Representation of Categorization Uncertainty in the Human Brain , 2006, Neuron.

[45]  P. Dayan,et al.  Cortical substrates for exploratory decisions in humans , 2006, Nature.

[46]  Yasuaki Sakamoto,et al.  Vancouver, Toronto, Montreal, Austin: Enhanced oddball memory through differentiation, not isolation , 2006, Psychonomic bulletin & review.

[47]  R. Poldrack Can cognitive processes be inferred from neuroimaging data? , 2006, Trends in Cognitive Sciences.

[48]  Carol A. Seger,et al.  Dynamics of frontal, striatal, and hippocampal systems during rule learning. , 2005, Cerebral cortex.

[49]  J. O'Doherty,et al.  Model‐Based fMRI and Its Application to Reward Learning and Decision Making , 2007, Annals of the New York Academy of Sciences.

[50]  Peter Redgrave,et al.  Basal Ganglia , 2020, Encyclopedia of Autism Spectrum Disorders.

[51]  Carol A. Seger,et al.  Dissociation between Striatal Regions while Learning to Categorize via Feedback and via Observation , 2007, Journal of Cognitive Neuroscience.

[52]  Daniel L Schacter,et al.  Evidence for a specific role of the anterior hippocampal region in successful associative encoding , 2007, Hippocampus.

[53]  Raymond J. Dolan,et al.  Anticipation of novelty recruits reward system and hippocampus while promoting recollection , 2007, NeuroImage.

[54]  W. T. Maddox,et al.  Neural correlates of rule-based and information-integration visual category learning. , 2006, Cerebral cortex.

[55]  H. Eichenbaum,et al.  The medial temporal lobe and recognition memory. , 2007, Annual review of neuroscience.

[56]  Craig K. Jones,et al.  High‐resolution fMRI investigation of the medial temporal lobe , 2007, Human brain mapping.

[57]  Bradley C Love,et al.  Models in search of a brain , 2007, Cognitive, affective & behavioral neuroscience.

[58]  Alison R. Preston,et al.  The medial temporal lobe and memory , 2007 .

[59]  M. Gluck,et al.  Basal ganglia and dopamine contributions to probabilistic category learning , 2008, Neuroscience & Biobehavioral Reviews.

[60]  N. Daw,et al.  Striatal Activity Underlies Novelty-Based Choice in Humans , 2008, Neuron.

[61]  M. Gluck,et al.  Probabilistic categorization: How do normal participants and amnesic patients do it? , 2008, Neuroscience & Biobehavioral Reviews.

[62]  Carol A. Seger,et al.  How do the basal ganglia contribute to categorization? Their roles in generalization, response selection, and learning via feedback , 2008, Neuroscience & Biobehavioral Reviews.

[63]  W. T. Maddox,et al.  Dissociable Prototype Learning Systems: Evidence from Brain Imaging and Behavior , 2008, The Journal of Neuroscience.

[64]  Adam N. Sanborn,et al.  Model evaluation using grouped or individual data , 2008, Psychonomic bulletin & review.

[65]  Michael Erb,et al.  Anterior hippocampus orchestrates successful encoding and retrieval of non-relational memory: an event-related fMRI study , 2008, European Archives of Psychiatry and Clinical Neuroscience.

[66]  Murray Grossman,et al.  Multiple systems of category learning , 2008, Neuroscience & Biobehavioral Reviews.

[67]  M. Bradley Natural selective attention: orienting and emotion. , 2009, Psychophysiology.

[68]  E. Düzel,et al.  The novelty exploration bonus and its attentional modulation , 2009, Neuropsychologia.

[69]  Tom Vercauteren,et al.  Diffeomorphic demons: Efficient non-parametric image registration , 2009, NeuroImage.

[70]  W. T. Maddox,et al.  Anticipatory emotions in decision tasks: Covert markers of value or attentional processes? , 2009, Cognition.

[71]  Michael A Yassa,et al.  A quantitative evaluation of cross-participant registration techniques for MRI studies of the medial temporal lobe , 2009, NeuroImage.

[72]  Hong-wei Dong,et al.  Are the Dorsal and Ventral Hippocampus Functionally Distinct Structures? , 2010, Neuron.

[73]  Valerie A. Carr,et al.  Imaging the Human Medial Temporal Lobe with High-Resolution fMRI , 2010, Neuron.

[74]  Erik J. Peterson,et al.  Dissociating the contributions of independent corticostriatal systems to visual categorization learning through the use of reinforcement learning modeling and Granger causality modeling , 2010, NeuroImage.

[75]  Carol A. Seger,et al.  Category learning in the brain. , 2010, Annual review of neuroscience.

[76]  Adam N Sanborn,et al.  Rational approximations to rational models: alternative algorithms for category learning. , 2010, Psychological review.

[77]  B. Love,et al.  The myth of computational level theory and the vacuity of rational analysis , 2011, Behavioral and Brain Sciences.

[78]  Daphna Shohamy,et al.  Cooperation between the Hippocampus and the Striatum during Episodic Encoding , 2011, Journal of Cognitive Neuroscience.

[79]  Erik J. Peterson,et al.  Dissociating hippocampal and basal ganglia contributions to category learning using stimulus novelty and subjective judgments , 2011, NeuroImage.

[80]  Nathaniel D. Daw,et al.  Trial-by-trial data analysis using computational models , 2011 .

[81]  T. Robbins,et al.  Decision Making, Affect, and Learning: Attention and Performance XXIII , 2011 .

[82]  Jian Li,et al.  Parallel contributions of distinct human memory systems during probabilistic learning , 2011, NeuroImage.

[83]  P. Dayan,et al.  Model-based influences on humans’ choices and striatal prediction errors , 2011, Neuron.

[84]  Gerd Wagner,et al.  Assessing the Neural Basis of Uncertainty in Perceptual Category Learning through Varying Levels of Distortion , 2011, Journal of Cognitive Neuroscience.

[85]  Emmanuel M. Pothos,et al.  Formal Approaches in Categorization: Contents , 2011 .

[86]  C. Stark,et al.  Striatal and medial temporal lobe functional interactions during visuomotor associative learning. , 2011, Cerebral cortex.

[87]  Russell A. Poldrack,et al.  Deconvolving BOLD activation in event-related designs for multivoxel pattern classification analyses , 2012, NeuroImage.

[88]  Brian D. Glass,et al.  Normal aging and the dissociable prototype learning systems. , 2012, Psychology and aging.

[89]  B. Love,et al.  Learning the exception to the rule: model-based FMRI reveals specialized representations for surprising category members. , 2012, Cerebral cortex.

[90]  Susanna Sallstroem,et al.  Functional Differentiation , 2009, Modern Condensed Matter Physics.