Prefrontal Cortex Represents Long-Term Memory of Object Values for Months

As a central hub for cognitive control, prefrontal cortex (PFC) is thought to utilize memories. However, unlike working or short-term memory, the neuronal representation of long-term memory in PFC has not been systematically investigated. Using single-unit recordings in macaques, we show that PFC neurons rapidly update and maintain responses to objects based on short-term reward history. Interestingly, after repeated object-reward association, PFC neurons continue to show value-biased responses to objects even in the absence of reward. This value-biased response is retained for several months after training and is resistant to extinction and to interference from new object-reward learning for many complex objects (>90). Accordingly, the monkeys remember the values of the learned objects for several months in separate testing. These findings reveal that in addition to flexible short-term and low-capacity memories, primate PFC represents stable long-term and high-capacity memories, which could prioritize valuable objects far into the future.

[1]  Masamichi Sakagami,et al.  The hierarchical organization of decision making in the primate prefrontal cortex , 1999, Neuroscience Research.

[2]  W. Schultz,et al.  Influences of Rewarding and Aversive Outcomes on Activity in Macaque Lateral Prefrontal Cortex , 2006, Neuron.

[3]  H. Seo,et al.  Dynamic signals related to choices and outcomes in the dorsolateral prefrontal cortex. , 2007, Cerebral cortex.

[4]  R. M. Elliott,et al.  Behavior of Organisms , 1991 .

[5]  M. Mishkin,et al.  Monkeys with combined amygdalo-hippocampal lesions succeed in object discrimination learning despite 24-hour intertrial intervals. , 1984, Behavioral neuroscience.

[6]  Robert Desimone,et al.  Feature-Based Attention in the Frontal Eye Field and Area V4 during Visual Search , 2011, Neuron.

[7]  E T Rolls,et al.  Sparseness of the neuronal representation of stimuli in the primate temporal visual cortex. , 1995, Journal of neurophysiology.

[8]  O. Hikosaka,et al.  Functional territories in primate substantia nigra pars reticulata separately signaling stable and flexible values. , 2015, Journal of neurophysiology.

[9]  P. Goldman-Rakic.  Circuitry of Primate Prefrontal Cortex and Regulation of Behavior by Representational Memory , 2011 .

[10]  L. Squire,et al.  The learning of categories: parallel brain systems for item memory and category knowledge. , 1993, Science.

[11]  E. Miller,et al.  Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task , 2003, The European journal of neuroscience.

[12]  Y. Miyashita,et al.  Top-down signal from prefrontal cortex in executive control of memory retrieval , 1999, Nature.

[13]  Masataka Watanabe.  Reward expectancy in primate prefrental neurons , 1996, Nature.

[14]  D. Gaffan,et al.  Crossed unilateral lesions of the medial forebrain bundle and either inferior temporal or frontal cortex impair object–reward association learning in Rhesus monkeys , 2001, Neuropsychologia.

[15]  E. Rolls,et al.  Orbitofrontal cortex neurons: role in olfactory and visual association learning. , 1996, Journal of neurophysiology.

[16]  M. Roesch,et al.  Neuronal Activity Related to Reward Value and Motivation in Primate Frontal Cortex , 2004, Science.

[17]  H. Eichenbaum,et al.  The medial temporal lobe and recognition memory. , 2007, Annual review of neuroscience.

[18]  Shinya Yamamoto,et al.  Reward Value-Contingent Changes of Visual Responses in the Primate Caudate Tail Associated with a Visuomotor Skill , 2013, The Journal of Neuroscience.

[19]  Hyoung F. Kim,et al.  Why skill matters , 2013, Trends in Cognitive Sciences.

[20]  N. Logothetis,et al.  A combined MRI and histology atlas of the rhesus monkey brain in stereotaxic coordinates , 2007 .

[21]  David L. Sheinberg,et al.  Effects of Long-Term Visual Experience on Responses of Distinct Classes of Single Units in Inferior Temporal Cortex , 2012, Neuron.

[22]  Kae Nakamura,et al.  Coding of Task Reward Value in the Dorsal Raphe Nucleus , 2010, The Journal of Neuroscience.

[23]  Ali Ghazizadeh,et al.  Ecological Origins of Object Salience: Reward, Uncertainty, Aversiveness, and Novelty , 2016, Front. Neurosci..

[24]  Ali Ghazizadeh,et al.  Dopamine Neurons Encoding Long-Term Memory of Object Value for Habitual Behavior , 2015, Cell.

[25]  David A. Leopold,et al.  Temporal–prefrontal cortical network for discrimination of valuable objects in long-term memory , 2018, Proceedings of the National Academy of Sciences.

[26]  Leslie G. Ungerleider,et al.  Connections of inferior temporal areas TEO and TE with parietal and frontal cortex in macaque monkeys. , 1994, Cerebral cortex.

[27]  Hyoung F. Kim,et al.  Distinct Basal Ganglia Circuits Controlling Behaviors Guided by Flexible and Stable Values , 2013, Neuron.

[28]  Leslie G. Ungerleider,et al.  Organization of visual cortical inputs to the striatum and subsequent outputs to the pallido‐nigral complex in the monkey , 1990, The Journal of comparative neurology.

[29]  K. Grill-Spector,et al.  Repetition and the brain: neural models of stimulus-specific effects , 2006, Trends in Cognitive Sciences.

[30]  C. Bruce,et al.  Primate frontal eye fields. I. Single neurons discharging before saccades. , 1985, Journal of neurophysiology.

[31]  Joseph J. Paton,et al.  The primate amygdala represents the positive and negative value of visual stimuli during learning , 2006, Nature.

[32]  Hyoung F. Kim,et al.  Separate groups of dopamine neurons innervate caudate head and tail encoding flexible and stable value memories , 2014, Front. Neuroanat..

[33]  Hyoung F. Kim,et al.  Basal ganglia circuits for reward value-guided behavior. , 2014, Annual review of neuroscience.

[34]  G. Luppino,et al.  Connectional heterogeneity of the ventral part of the macaque area 46. , 2013, Cerebral cortex.

[35]  M. Sakagami,et al.  Category representation and generalization in the prefrontal cortex , 2012, The European journal of neuroscience.

[36]  R. Engle,et al.  The role of prefrontal cortex in working-memory capacity, executive attention, and general fluid intelligence: An individual-differences perspective , 2002, Psychonomic bulletin & review.

[37]  M. Mishkin,et al.  Effects of object preferences and aversions on discrimination learning in monkeys with frontal lesions. , 1961 .

[38]  David J. Freedman,et al.  Categorical representation of visual stimuli in the primate prefrontal cortex. , 2001, Science.

[39]  Charan Ranganath,et al.  Prefrontal Cortex and Long-Term Memory Encoding: An Integrative Review of Findings from Neuropsychology and Neuroimaging , 2007, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[40]  Timothy E. J. Behrens,et al.  Review Frontal Cortex and Reward-guided Learning and Decision-making Figure 1. Frontal Brain Regions in the Macaque Involved in Reward-guided Learning and Decision-making Finer Grained Anatomical Divisions with Frontal Cortical Systems for Reward-guided Behavior , 2022 .

[41]  D. Barraclough,et al.  Prefrontal cortex and decision making in a mixed-strategy game , 2004, Nature Neuroscience.

[42]  Daniel Glen,et al.  Three-Dimensional Digital Template Atlas of the Macaque Brain , 2016, Cerebral cortex.

[43]  Yasushi Miyashita,et al.  Generation of fractal patterns for probing the visual memory , 1991, Neuroscience Research.

[44]  Ali Ghazizadeh,et al.  Flexible and Stable Value Coding Areas in Caudate Head and Tail Receive Anatomically Distinct Cortical and Subcortical Inputs , 2017, Front. Neuroanat..

[45]  N. P. Bichot,et al.  A Source for Feature-Based Attention in the Prefrontal Cortex , 2015, Neuron.

[46]  H. Spiers,et al.  Prefrontal and medial temporal lobe interactions in long-term memory , 2003, Nature Reviews Neuroscience.

[47]  T. Carew,et al.  Invertebrate learning and memory: from behavior to molecules. , 1986, Annual review of neuroscience.

[48]  I. Tsuda,et al.  Reward prediction based on stimulus categorization in primate lateral prefrontal cortex , 2008, Nature Neuroscience.

[49]  O. Hikosaka,et al.  Robust Representation of Stable Object Values in the Oculomotor Basal Ganglia , 2012, The Journal of Neuroscience.

[50]  Ali Ghazizadeh,et al.  Parallel basal ganglia circuits for decision making , 2018, Journal of Neural Transmission.

[51]  R. Desimone,et al.  Neural Mechanisms of Visual Working Memory in Prefrontal Cortex of the Macaque , 1996, The Journal of Neuroscience.

[52]  Takashi Kitamura,et al.  Engrams and circuits crucial for systems consolidation of a memory , 2017, Science.

[53]  Matthew L. Dixon,et al.  The lateral prefrontal cortex and complex value-based learning and decision making , 2014, Neuroscience & Biobehavioral Reviews.

[54]  R. Boakes,et al.  Motivational control after extended instrumental training , 1995 .

[55]  Fabian Grabenhorst,et al.  A dynamic code for economic object valuation in prefrontal cortex neurons , 2016, Nature Communications.

[56]  J. Maunsell.  Neuronal representations of cognitive state: reward or attention? , 2004, Trends in Cognitive Sciences.

[57]  D. R. Euston,et al.  The Role of Medial Prefrontal Cortex in Memory and Decision Making , 2012, Neuron.

[58]  O. Hikosaka,et al.  Influence of reward expectation on visuospatial processing in macaque lateral prefrontal cortex. , 2002, Journal of neurophysiology.

[59]  Timothy E. J. Behrens,et al.  Optimal decision making and the anterior cingulate cortex , 2006, Nature Neuroscience.

[60]  Yasushi Miyashita,et al.  Towards understanding of the cortical network underlying associative memory , 2008, Philosophical Transactions of the Royal Society B: Biological Sciences.

[61]  E. Miller,et al.  Different time courses of learning-related activity in the prefrontal cortex and striatum , 2005, Nature.

[62]  P. Strick,et al.  Basal-ganglia 'projections' to the prefrontal cortex of the primate. , 2002, Cerebral cortex.

[63]  Ali Ghazizadeh,et al.  Object-finding skill created by repeated reward experience , 2016, bioRxiv.

[64]  R. Blair,et al.  An alternative method for significance testing of waveform difference potentials. , 1993, Psychophysiology.

[65]  G. Winocur,et al.  Memory formation and long-term retention in humans and animals: Convergence towards a transformation account of hippocampal–neocortical interactions , 2010, Neuropsychologia.

[66]  A. Bonci,et al.  Transcranial magnetic stimulation of dorsolateral prefrontal cortex reduces cocaine use: A pilot study , 2016, European Neuropsychopharmacology.

[67]  M. Bouton,et al.  Behavioral and neurobiological mechanisms of extinction in Pavlovian and instrumental learning , 2014, Neurobiology of Learning and Memory.

[68]  G. Luppino,et al.  Projections from caudal ventrolateral prefrontal areas to brainstem preoculomotor structures and to Basal Ganglia and cerebellar oculomotor loops in the macaque. , 2015, Cerebral cortex.

[69]  David Gaffan,et al.  Frontal-temporal disconnection abolishes object discrimination learning set in macaque monkeys. , 2006, Cerebral cortex.