Temporal–prefrontal cortical network for discrimination of valuable objects in long-term memory

Significance Animals, including humans, are surrounded by many objects, only some of which are valuable. To survive, it is critical to efficiently discriminate valuable objects, particularly those that are only occasionally or seasonally available. Here, we use fMRI to show that, in macaques, a network consisting of areas in the temporal and prefrontal cortex and their associated subcortical structures maintained value memories for a large number of objects. This memory representation lasted for many months after the objects were last seen and accordingly the monkeys were able to find valuable objects efficiently. We postulate that this temporal–prefrontal circuit is critical for drawing on learned value memory to guide goal-oriented behavior toward certain objects. Remembering and discriminating objects based on their previously learned values are essential for goal-directed behaviors. While the cerebral cortex is known to contribute to object recognition, surprisingly little is known about its role in retaining long-term object–value associations. To address this question, we trained macaques to arbitrarily associate small or large rewards with many random fractal objects (>100) and then used fMRI to study the long-term retention of value-based response selectivity across the brain. We found a pronounced long-term value memory in core subregions of temporal and prefrontal cortex where, several months after training, fractals previously associated with high reward (“good” stimuli) elicited elevated fMRI responses compared with those associated with low reward (“bad” stimuli). Similar long-term value-based modulation was also observed in subregions of the striatum, amygdala, and claustrum, but not in the hippocampus. The value-modulated temporal–prefrontal subregions showed strong resting-state functional connectivity to each other. Moreover, for areas outside this core, the magnitude of long-term value responses was predicted by the strength of resting-state functional connectivity to the core subregions. In separate testing, free-viewing gaze behavior indicated that the monkeys retained stable long-term memory of object value. These results suggest an implicit and high-capacity memory mechanism in the temporal–prefrontal circuitry and its associated subcortical regions for long-term retention of object-value memories that can guide value-oriented behavior.

[1]  Hyoung F. Kim,et al.  Distinct Basal Ganglia Circuits Controlling Behaviors Guided by Flexible and Stable Values , 2013, Neuron.

[2]  Greg D. Gale,et al.  The Amygdala, Fear, and Memory , 2003, Annals of the New York Academy of Sciences.

[3]  L. Chelazzi,et al.  Rewards teach visual selective attention , 2013, Vision Research.

[4]  H. Heinze,et al.  Reward-Related fMRI Activation of Dopaminergic Midbrain Is Associated with Enhanced Hippocampus- Dependent Long-Term Memory Formation , 2005, Neuron.

[5]  Ali Ghazizadeh,et al.  Isolating event-related neuronal responses by deconvolution. , 2010, Journal of neurophysiology.

[6]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[7]  M MISHKIN,et al.  Simultaneous and successive visual discrimination by monkeys with inferotemporal lesions. , 1955, Journal of comparative and physiological psychology.

[8]  N. Cohen From Conditioning to Conscious Recollection Memory Systems of the Brain. Oxford Psychology Series, Volume 35. , 2001 .

[9]  T. Carew,et al.  Invertebrate learning and memory: from behavior to molecules. , 1986, Annual review of neuroscience.

[10]  Leslie G. Ungerleider,et al.  Subcortical connections of inferior temporal areas TE and TEO in macaque monkeys , 1993, The Journal of comparative neurology.

[11]  R. Saunders,et al.  Prefrontal mechanisms of behavioral flexibility, emotion regulation and value updating , 2013, Nature Neuroscience.

[12]  O. Hikosaka,et al.  Robust Representation of Stable Object Values in the Oculomotor Basal Ganglia , 2012, The Journal of Neuroscience.

[13]  Leslie G. Ungerleider,et al.  Visual topography of area TEO in the macaque , 1991, The Journal of comparative neurology.

[14]  Ali Ghazizadeh,et al.  Parallel basal ganglia circuits for decision making , 2018, Journal of Neural Transmission.

[15]  K. Nelissen,et al.  Dopaminergic Reward Signals Selectively Decrease fMRI Activity in Primate Visual Cortex , 2013, Neuron.

[16]  Leslie G. Ungerleider,et al.  Connections of inferior temporal areas TE and TEO with medial temporal- lobe structures in infant and adult monkeys , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[17]  H. Eichenbaum,et al.  From Conditioning to Conscious Recollection , 2001 .

[18]  P. Goldman-Rakic Circuitry of Primate Prefrontal Cortex and Regulation of Behavior by Representational Memory , 2011 .

[19]  P. Strick,et al.  Basal-ganglia 'projections' to the prefrontal cortex of the primate. , 2002, Cerebral cortex.

[20]  Deborah E. Hannula,et al.  The Eyes Have It: Hippocampal Activity Predicts Expression of Memory in Eye Movements , 2009, Neuron.

[21]  Ali Ghazizadeh,et al.  Flexible and Stable Value Coding Areas in Caudate Head and Tail Receive Anatomically Distinct Cortical and Subcortical Inputs , 2017, Front. Neuroanat..

[22]  Shinya Yamamoto,et al.  Reward Value-Contingent Changes of Visual Responses in the Primate Caudate Tail Associated with a Visuomotor Skill , 2013, The Journal of Neuroscience.

[23]  E. Murray,et al.  The amygdala and reward , 2002, Nature Reviews Neuroscience.

[24]  Abraham Z. Snyder,et al.  A method for using blocked and event-related fMRI data to study “resting state” functional connectivity , 2007, NeuroImage.

[25]  N. Logothetis,et al.  A combined MRI and histology atlas of the rhesus monkey brain in stereotaxic coordinates , 2007 .

[26]  K. Henke A model for memory systems based on processing modes rather than consciousness , 2010, Nature Reviews Neuroscience.

[27]  K. Nelissen,et al.  Neural Correlates of the Formation and Retention of Cocaine-Induced Stimulus–Reward Associations , 2012, Biological Psychiatry.

[28]  Christopher J. Peck,et al.  Reward Modulates Attention Independently of Action Value in Posterior Parietal Cortex , 2009, The Journal of Neuroscience.

[29]  Brenna Argall,et al.  SUMA: an interface for surface-based intra- and inter-subject analysis with AFNI , 2004, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[30]  O. Hikosaka,et al.  Influence of reward expectation on visuospatial processing in macaque lateral prefrontal cortex. , 2002, Journal of neurophysiology.

[31]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[32]  Joseph W. Kable,et al.  The valuation system: A coordinate-based meta-analysis of BOLD fMRI experiments examining neural correlates of subjective value , 2013, NeuroImage.

[33]  B. Roche,et al.  The Behavior of Organisms? , 1997 .

[34]  P. Strick,et al.  The temporal lobe is a target of output from the basal ganglia. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[35]  B. Richmond,et al.  Response differences in monkey TE and perirhinal cortex: stimulus association related to reward schedules. , 2000, Journal of neurophysiology.

[36]  Ali Ghazizadeh,et al.  Object-finding skill created by repeated reward experience , 2016, bioRxiv.

[37]  Brian Knutson,et al.  Reward-Motivated Learning: Mesolimbic Activation Precedes Memory Formation , 2006, Neuron.

[38]  J. O'Doherty,et al.  Reward representations and reward-related learning in the human brain: insights from neuroimaging , 2004, Current Opinion in Neurobiology.

[39]  Gary H. Glover,et al.  fMRI identifies a network of structures correlated with retention of positive and negative emotional memory , 1999, Psychobiology.

[40]  O. Steinlein,et al.  Congenital Myasthenic Syndrome in Cattle due to Homozygosity for a Truncating Mutation in the Acetylcholine Receptor (AChR) Epsilon‐Subunit Gene , 2003, Annals of the New York Academy of Sciences.

[41]  Doris Y. Tsao,et al.  Comparing face patch systems in macaques and humans , 2008, Proceedings of the National Academy of Sciences.

[42]  D. Amaral,et al.  Some observations on cortical inputs to the macaque monkey amygdala: An anterograde tracing study , 2002, The Journal of comparative neurology.

[43]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[44]  Karl J. Friston,et al.  Nonlinear event‐related responses in fMRI , 1998, Magnetic resonance in medicine.

[45]  J. O'Doherty,et al.  The problem with value , 2014, Neuroscience & Biobehavioral Reviews.

[46]  John T Serences,et al.  Value-Based Modulations in Human Visual Cortex , 2008, Neuron.

[47]  Mark F Bear,et al.  Reward timing in the primary visual cortex. , 2006, Science.

[48]  G. Orban,et al.  Visual Motion Processing Investigated Using Contrast Agent-Enhanced fMRI in Awake Behaving Monkeys , 2001, Neuron.

[49]  H. Eichenbaum,et al.  The medial temporal lobe and recognition memory. , 2007, Annual review of neuroscience.

[50]  W. Schultz Multiple reward signals in the brain , 2000, Nature Reviews Neuroscience.

[51]  Shawn W. Ell,et al.  Learning robust cortico-cortical associations with the basal ganglia: An integrative review , 2015, Cortex.

[52]  Y. Miyashita,et al.  Top-down signal from prefrontal cortex in executive control of memory retrieval , 1999, Nature.

[53]  E. Rolls,et al.  Orbitofrontal cortex neurons: role in olfactory and visual association learning. , 1996, Journal of neurophysiology.

[54]  D. Gaffan,et al.  Amygdalar interaction with the mediodorsal nucleus of the thalamus and the ventromedial prefrontal cortex in stimulus-reward associative learning in the monkey , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[55]  G. Winocur,et al.  Memory formation and long-term retention in humans and animals: Convergence towards a transformation account of hippocampal–neocortical interactions , 2010, Neuropsychologia.

[56]  A. Bonci,et al.  Transcranial magnetic stimulation of dorsolateral prefrontal cortex reduces cocaine use: A pilot study , 2016, European Neuropsychopharmacology.

[57]  P. Strick,et al.  Extended Practice of a Motor Skill Is Associated with Reduced Metabolic Activity in M1 , 2013, Nature Neuroscience.

[58]  W. Schultz,et al.  Relative reward preference in primate orbitofrontal cortex , 1999, Nature.

[59]  E. Rolls The orbitofrontal cortex and reward. , 2000, Cerebral cortex.

[60]  Y. Dudai The neurobiology of consolidations, or, how stable is the engram? , 2004, Annual review of psychology.

[61]  Daniel Glen,et al.  Three-Dimensional Digital Template Atlas of the Macaque Brain , 2016, Cerebral cortex.

[62]  Kevin Murphy,et al.  How long to scan? The relationship between fMRI temporal signal to noise ratio and necessary scan duration , 2007, NeuroImage.

[63]  A. Leventhal,et al.  Signal timing across the macaque visual system. , 1998, Journal of neurophysiology.

[64]  Ilya E. Monosov,et al.  What and Where Information in the Caudate Tail Guides Saccades to Visual Objects , 2012, The Journal of Neuroscience.

[65]  Christoph Kayser,et al.  Unimodal Responses Prevail within the Multisensory Claustrum , 2010, The Journal of Neuroscience.

[66]  Keiji Tanaka,et al.  Reward Association Affects Neuronal Responses to Visual Stimuli in Macaque TE and Perirhinal Cortices , 2006, The Journal of Neuroscience.

[67]  R. Desimone,et al.  Neural Mechanisms of Visual Working Memory in Prefrontal Cortex of the Macaque , 1996, The Journal of Neuroscience.

[68]  S. Yantis,et al.  Persistence of value-driven attentional capture. , 2013, Journal of experimental psychology. Human perception and performance.

[69]  Anders M. Dale,et al.  Repeated fMRI Using Iron Oxide Contrast Agent in Awake, Behaving Macaques at 3 Tesla , 2002, NeuroImage.

[70]  Peter M. Kaskan,et al.  Learned Value Shapes Responses to Objects in Frontal and Ventral Stream Networks in Macaque Monkeys , 2016, Cerebral cortex.

[71]  Jennifer A. Mangels,et al.  A Neostriatal Habit Learning System in Humans , 1996, Science.

[72]  G. Luppino,et al.  Connectional heterogeneity of the ventral part of the macaque area 46. , 2013, Cerebral cortex.

[73]  Andrew R Delamater,et al.  The Role of the Orbitofrontal Cortex in Sensory‐Specific Encoding of Associations in Pavlovian and Instrumental Conditioning , 2007, Annals of the New York Academy of Sciences.

[74]  Steven Yantis,et al.  Value-driven attentional priority signals in human basal ganglia and visual cortex , 2014, Brain Research.

[75]  Yasushi Miyashita,et al.  Generation of fractal patterns for probing the visual memory , 1991, Neuroscience Research.

[76]  M. Mishkin,et al.  Effects of object preferences and aversions on discrimination learning in monkeys with frontal lesions. , 1961 .

[77]  David Gaffan,et al.  Frontal-temporal disconnection abolishes object discrimination learning set in macaque monkeys. , 2006, Cerebral cortex.

[78]  L. Squire Memory systems of the brain: A brief history and current perspective , 2004, Neurobiology of Learning and Memory.

[79]  Philipp Sterzer,et al.  Priming in a shape task but not in a category task under continuous flash suppression. , 2016, Journal of vision.

[80]  Ali Ghazizadeh,et al.  Dopamine Neurons Encoding Long-Term Memory of Object Value for Habitual Behavior , 2015, Cell.

[81]  Leslie G. Ungerleider,et al.  Connections of inferior temporal areas TEO and TE with parietal and frontal cortex in macaque monkeys. , 1994, Cerebral cortex.

[82]  Leslie G. Ungerleider,et al.  Organization of visual cortical inputs to the striatum and subsequent outputs to the pallido‐nigral complex in the monkey , 1990, The Journal of comparative neurology.

[83]  M. Mishkin,et al.  Perseverative interference in monkeys following selective lesions of the inferior prefrontal convexity , 1970, Experimental Brain Research.

[84]  Keiji Tanaka,et al.  Time Context of Cue-Outcome Associations Represented by Neurons in Perirhinal Cortex , 2015, The Journal of Neuroscience.

[85]  Ali Ghazizadeh,et al.  Ecological Origins of Object Salience: Reward, Uncertainty, Aversiveness, and Novelty , 2016, Front. Neurosci..

[86]  Michael L. Platt,et al.  Neural correlates of decision variables in parietal cortex , 1999, Nature.

[87]  Doris Y. Tsao,et al.  Patches of face-selective cortex in the macaque frontal lobe , 2008, Nature Neuroscience.

[88]  Hyoung F. Kim,et al.  Basal ganglia circuits for reward value-guided behavior. , 2014, Annual review of neuroscience.

[89]  Aaron R. Seitz,et al.  Rewards Evoke Learning of Unconsciously Processed Visual Stimuli in Adult Humans , 2009, Neuron.

[90]  F. Ye,et al.  Correction for geometric distortion and N/2 ghosting in EPI by phase labeling for additional coordinate encoding (PLACE) , 2007, Magnetic resonance in medicine.

[91]  J. Maunsell Neuronal representations of cognitive state: reward or attention? , 2004, Trends in Cognitive Sciences.

[92]  Aaron R. Seitz,et al.  Dissociable Neural Effects of Long-term Stimulus–Reward Pairing in Macaque Visual Cortex , 2010, Journal of Cognitive Neuroscience.