Cortical and subcortical substrates of minutes and days-long object value memory in humans

Obtaining valuable objects motivates many of our daily decisions. However, the neural underpinnings of object processing based on the value memory in humans are not yet fully understood. Here, we used whole-brain fMRI while participants passively viewed objects before, minutes after, and 1-70 days after value training to examine activations due to value memory. The behavioral performance showed significant value memory for objects, which nevertheless faded over days after training. Strong value discrimination was observed shortly after training in the occipital, ventral temporal, interparietal, and prefrontal areas. Days after training, activation in the prefrontal and parietal regions disappeared, whereas the ventral temporal areas showed sustained activation. In addition, days-long value responses emerged in certain subcortical regions, including the caudate, ventral striatum, and thalamus, with the former two showing a significant correlation with participants’ performance in days-long memory. Resting-state analysis revealed that the functional distance of value-coding brain regions from clusters, which included the intraparietal and striatal areas, determined the strength of their minutes- and days-long value memory, respectively. These findings shed light on the neural basis of value memory in humans with implications for object habit formation and cross-species comparisons.

[1]  O. Hikosaka,et al.  Salience memories formed by value, novelty and aversiveness jointly shape object responses in the prefrontal cortex and basal ganglia , 2022, Nature Communications.

[2]  M. L. Le Pelley,et al.  Attentional capture by signals of reward persists following outcome devaluation , 2022, Learning & memory.

[3]  A. Ghazizadeh,et al.  Gustatory Cortex Is Involved in Evidence Accumulation during Food Choice , 2021, eNeuro.

[4]  O. Hikosaka,et al.  Common coding of expected value and value uncertainty memories in the prefrontal cortex and basal ganglia output , 2021, Science Advances.

[5]  Sue-Hyun Lee,et al.  Primate ventral striatum maintains neural representations of the value of previously rewarded objects for habitual seeking , 2021, Nature Communications.

[6]  M. Antonelli,et al.  Transcranial Magnetic Stimulation: A review about its efficacy in the treatment of alcohol, tobacco and cocaine addiction. , 2020, Addictive behaviors.

[7]  William W. Seeley,et al.  The Salience Network: A Neural System for Perceiving and Responding to Homeostatic Demands , 2019, The Journal of Neuroscience.

[8]  A. Zilverstand,et al.  Effects of single-session versus multi-session non-invasive brain stimulation on craving and consumption in individuals with drug addiction, eating disorders or obesity: A meta-analysis , 2019, Brain Stimulation.

[9]  J. Luigjes,et al.  Efficacy of Invasive and Non-Invasive Brain Modulation Interventions for Addiction , 2018, Neuropsychology Review.

[10]  Ali Ghazizadeh,et al.  Prefrontal Cortex Represents Long-Term Memory of Object Values for Months , 2018, Current Biology.

[11]  Krzysztof J. Gorgolewski,et al.  Reward Learning over Weeks Versus Minutes Increases the Neural Representation of Value in the Human Brain , 2018, The Journal of Neuroscience.

[12]  David A. Leopold,et al.  Temporal–prefrontal cortical network for discrimination of valuable objects in long-term memory , 2018, Proceedings of the National Academy of Sciences.

[13]  M. Peelen,et al.  Valence, Not Utility, Underlies Reward-Driven Prioritization in Human Vision , 2017, The Journal of Neuroscience.

[14]  Michel F. Failing,et al.  Selection history: How reward modulates selectivity of visual attention , 2017, Psychonomic bulletin & review.

[15]  Brian A. Anderson,et al.  Reward processing in the value-driven attention network: reward signals tracking cue identity and location , 2016, Social cognitive and affective neuroscience.

[16]  Ali Ghazizadeh,et al.  Ecological Origins of Object Salience: Reward, Uncertainty, Aversiveness, and Novelty , 2016, Front. Neurosci..

[17]  B. Anderson.  The attention habit: how reward learning shapes attentional selection , 2016, Annals of the New York Academy of Sciences.

[18]  Ali Ghazizadeh,et al.  Object-finding skill created by repeated reward experience , 2016, bioRxiv.

[19]  T. Robbins,et al.  Enhanced habit formation in Gilles de la Tourette syndrome. , 2016, Brain : a journal of neurology.

[20]  Ali Ghazizadeh,et al.  Dopamine Neurons Encoding Long-Term Memory of Object Value for Habitual Behavior , 2015, Cell.

[21]  Scott T. Grafton,et al.  The striatum: where skills and habits meet. , 2015, Cold Spring Harbor perspectives in biology.

[22]  Hyoung F. Kim,et al.  Parallel basal ganglia circuits for voluntary and automatic behaviour to reach rewards. , 2015, Brain : a journal of neurology.

[23]  Barry Giesbrecht,et al.  Neural evidence reveals the rapid effects of reward history on selective attention , 2015, Brain Research.

[24]  Tristan A. Chaplin,et al.  Representation of central and peripheral vision in the primate cerebral cortex: Insights from studies of the marmoset brain , 2015, Neuroscience Research.

[25]  Daniel C. McNamee,et al.  Characterizing the Associative Content of Brain Structures Involved in Habitual and Goal-Directed Actions in Humans: A Multivariate fMRI Study , 2015, The Journal of Neuroscience.

[26]  Mircea Ariel Schoenfeld,et al.  The modulatory impact of reward and attention on global feature selection in human visual cortex , 2015 .

[27]  M. Peelen,et al.  Neural Mechanisms of Incentive Salience in Naturalistic Human Vision , 2015, Neuron.

[28]  Steven Yantis,et al.  Value-driven attentional priority signals in human basal ganglia and visual cortex , 2014, Brain Research.

[29]  T. Robbins,et al.  Behavioral and neuroimaging evidence for overreliance on habit learning in alcohol-dependent patients , 2013, Translational Psychiatry.

[30]  Senqing Qi,et al.  Neural correlates of reward-driven attentional capture in visual search , 2013, Brain Research.

[31]  Hyoung F. Kim,et al.  Distinct Basal Ganglia Circuits Controlling Behaviors Guided by Flexible and Stable Values , 2013, Neuron.

[32]  S. Shomstein,et al.  The Differential Effects of Reward on Space- and Object-Based Attentional Allocation , 2013, The Journal of Neuroscience.

[33]  S. Yantis,et al.  Persistence of value-driven attentional capture. , 2013, Journal of experimental psychology. Human perception and performance.

[34]  O. Hikosaka,et al.  Robust Representation of Stable Object Values in the Oculomotor Basal Ganglia , 2012, The Journal of Neuroscience.

[35]  Morris Moscovitch,et al.  Cognitive contributions of the ventral parietal cortex: an integrative theoretical account , 2012, Trends in Cognitive Sciences.

[36]  P. Dayan,et al.  Mapping value based planning and extensively trained choice in the human brain , 2012, Nature Neuroscience.

[37]  Patryk A. Laurent,et al.  Value-driven attentional capture , 2011, Proceedings of the National Academy of Sciences.

[38]  L. Chelazzi,et al.  Behavioral/systems/cognitive Reward Changes Salience in Human Vision via the Anterior Cingulate , 2022 .

[39]  P. Dayan,et al.  States versus Rewards: Dissociable Neural Prediction Error Signals Underlying Model-Based and Model-Free Reinforcement Learning , 2010, Neuron.

[40]  J. Serences,et al.  Spatial attention improves the quality of population codes in human visual cortex. , 2010, Journal of neurophysiology.

[41]  Benjamin O. Turner,et al.  Cortical and basal ganglia contributions to habit learning and automaticity , 2010, Trends in Cognitive Sciences.

[42]  B. Balleine,et al.  A specific role for posterior dorsolateral striatum in human habit learning , 2009, The European journal of neuroscience.

[43]  A. Graybiel.  Habits, rituals, and the evaluative brain. , 2008, Annual review of neuroscience.

[44]  B. Everitt,et al.  Cocaine Seeking Habits Depend upon Dopamine-Dependent Serial Connectivity Linking the Ventral with the Dorsal Striatum , 2008, Neuron.

[45]  Denis G. Pelli,et al.  ECVP '07 Abstracts , 2007, Perception.

[46]  H. Yin,et al.  The role of the basal ganglia in habit formation , 2006, Nature Reviews Neuroscience.

[47]  L. Chelazzi,et al.  Visual Selective Attention and the Effects of Monetary Rewards , 2006, Psychological science.

[48]  T. Robbins,et al.  Neural systems of reinforcement for drug addiction: from actions to habits to compulsion , 2005, Nature Neuroscience.

[49]  Brenna Argall,et al.  SUMA: an interface for surface-based intra- and inter-subject analysis with AFNI , 2004, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[50]  Talma Hendler,et al.  Eccentricity Bias as an Organizing Principle for Human High-Order Object Areas , 2002, Neuron.

[51]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[52]  N. Daw,et al.  Multiple Systems for Value Learning , 2014 .

[53]  Michael T. Tolston,et al.  Journal of Experimental Psychology : Human Perception and Performance Movement Constraints on Interpersonal Coordination and Communication , 2014 .

[54]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[55]  HighWire Press.  The journal of neuroscience : the official journal of the Society for Neuroscience. , 1981 .