Contextual interaction between novelty and reward processing within the mesolimbic system

Medial temporal lobe (MTL) dependent long‐term memory for novel events is modulated by a circuitry that also responds to reward and includes the ventral striatum, dopaminergic midbrain, and medial orbitofrontal cortex (mOFC). This common neural network may reflect a functional link between novelty and reward whereby novelty motivates exploration in the search for rewards; a link also termed novelty “exploration bonus.” We used fMRI in a scene encoding paradigm to investigate the interaction between novelty and reward with a focus on neural signals akin to an exploration bonus. As expected, reward related long‐term memory for the scenes (after 24 hours) strongly correlated with activity of MTL, ventral striatum, and substantia nigra/ventral tegmental area (SN/VTA). Furthermore, the hippocampus showed a main effect of novelty, the striatum showed a main effect of reward, and the mOFC signalled both novelty and reward. An interaction between novelty and reward akin to an exploration bonus was found in the hippocampus. These data suggest that MTL novelty signals are interpreted in terms of their reward‐predicting properties in the mOFC, which biases striatal reward responses. The striatum together with the SN/VTA then regulates MTL‐dependent long‐term memory formation and contextual exploration bonus signals in the hippocampus. Hum Brain Mapp, 2011. © 2011 Wiley‐Liss, Inc.

[1]  P. Dayan,et al.  A common mechanism for adaptive scaling of reward and novelty , 2010, Human brain mapping.

[2]  Emery Brown,et al.  Trial Outcome and Associative Learning Signals in the Monkey Hippocampus , 2009, Neuron.

[3]  L. Devenport,et al.  Reward-induced stereotypy: modulation by the hippocampus. , 1981, Science.

[4]  Robert Turner,et al.  Image Distortion Correction in fMRI: A Quantitative Evaluation , 2002, NeuroImage.

[5]  Nikolaus Weiskopf,et al.  Optimal EPI parameters for reduction of susceptibility-induced BOLD sensitivity losses: A whole-brain analysis at 3 T and 1.5 T , 2006, NeuroImage.

[6]  Mark G. Packard,et al.  The dopaminergic mesencephalic projections to the hippocampal formation in the rat , 1997, Progress in Neuro-Psychopharmacology and Biological Psychiatry.

[7]  Karl J. Friston,et al.  Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning , 2004, Science.

[8]  W. Schultz,et al.  Responses of monkey dopamine neurons during learning of behavioral reactions. , 1992, Journal of neurophysiology.

[9]  ET Rolls,et al.  Learning and memory is reflected in the responses of reinforcement- related neurons in the primate basal forebrain , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[10]  J. Glowinski,et al.  Hippocampo‐prefrontal cortex pathway: Anatomical and electrophysiological characteristics , 2000, Hippocampus.

[11]  A. Grace,et al.  Limbic and cortical information processing in the nucleus accumbens , 2008, Trends in Neurosciences.

[12]  G Helms,et al.  Multi-parameter mapping of the human brain at 1mm resolution in less than 20 minutes , 2008 .

[13]  G. Hall,et al.  Enhancement of latent inhibition in rats with electrolytic lesions of the hippocampus. , 1995, Behavioral neuroscience.

[14]  H. Mallot,et al.  Reward modulates neuronal activity in the hippocampus of the rat , 2003, Behavioural Brain Research.

[15]  R. Knight Contribution of human hippocampal region to novelty detection , 1996, Nature.

[16]  M. W. Brown,et al.  Recognition memory: neuronal substrates of the judgement of prior occurrence , 1998, Progress in Neurobiology.

[17]  I. Weiner The "two-headed" latent inhibition model of schizophrenia: modeling positive and negative symptoms and their treatment , 2003, Psychopharmacology.

[18]  A G Barto,et al.  Toward a modern theory of adaptive networks: expectation and prediction. , 1981, Psychological review.

[19]  Peter Dayan,et al.  Dopamine: generalization and bonuses , 2002, Neural Networks.

[20]  Richard G M Morris,et al.  Dopaminergic modulation of the persistence of one-trial hippocampus-dependent memory. , 2006, Learning & memory.

[21]  E. Düzel,et al.  The novelty exploration bonus and its attentional modulation , 2009, Neuropsychologia.

[22]  R. Dolan,et al.  Dissociating prefrontal and hippocampal function in episodic memory encoding , 1997, Nature.

[23]  A. Baddeley,et al.  Context-dependent memory in two natural environments: on land and underwater. , 1975 .

[24]  Richard S. Frackowiak,et al.  Improved segmentation of deep brain grey matter structures using magnetization transfer (MT) parameter maps , 2009, NeuroImage.

[25]  U. Frey,et al.  Dopaminergic antagonists prevent long-term maintenance of posttetanic LTP in the CA1 region of rat hippocampal slices , 1990, Brain Research.

[26]  J. Lisman,et al.  The Hippocampal-VTA Loop: Controlling the Entry of Information into Long-Term Memory , 2005, Neuron.

[27]  Elyssa B. Margolis,et al.  Ventral tegmental area neurons in learned appetitive behavior and positive reinforcement. , 2007, Annual review of neuroscience.

[28]  E. N. Sokolov Higher nervous functions; the orienting reflex. , 1963, Annual review of physiology.

[29]  Richard C Saunders,et al.  Comparison of hippocampal, amygdala, and perirhinal projections to the nucleus accumbens: Combined anterograde and retrograde tracing study in the Macaque brain , 2002, The Journal of comparative neurology.

[30]  G. V. Van Hoesen,et al.  Hippocampal efferents reach widespread areas of cerebral cortex and amygdala in the rhesus monkey. , 1977, Science.

[31]  H. Heinze,et al.  Reward-Related fMRI Activation of Dopaminergic Midbrain Is Associated with Enhanced Hippocampus- Dependent Long-Term Memory Formation , 2005, Neuron.

[32]  E. T. Rolls,et al.  Neuronal responses related to the novelty and familiarity of visual stimuli in the substantia innominata, diagonal band of Broca and periventricular region of the primate basal forebrain , 2004, Experimental Brain Research.

[33]  S. Wiener,et al.  Position and behavioral modulation of synchronization of hippocampal and accumbens neuronal discharges in freely moving rats , 2000, Hippocampus.

[34]  U. Frey,et al.  Synaptic tagging: implications for late maintenance of hippocampal long-term potentiation , 1998, Trends in Neurosciences.

[35]  R Turner,et al.  Optimized EPI for fMRI studies of the orbitofrontal cortex , 2003, NeuroImage.

[36]  N. Bunzeck,et al.  Absolute Coding of Stimulus Novelty in the Human Substantia Nigra/VTA , 2006, Neuron.

[37]  R. Morris,et al.  Elements of a neurobiological theory of hippocampal function: the role of synaptic plasticity, synaptic tagging and schemas , 2006, The European journal of neuroscience.

[38]  P. Dayan,et al.  Tonic dopamine: opportunity costs and the control of response vigor , 2007, Psychopharmacology.

[39]  G. Rainer,et al.  Cognitive neuroscience: Neural mechanisms for detecting and remembering novel events , 2003, Nature Reviews Neuroscience.

[40]  E. Kandel,et al.  D1/D5 receptor agonists induce a protein synthesis-dependent late potentiation in the CA1 region of the hippocampus. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[41]  J. Glowinski,et al.  Anatomical and electrophysiological evidence for a direct projection from ammon's horn to the medial prefrontal cortex in the rat , 2004, Experimental Brain Research.

[42]  J. Ashburner,et al.  Nonlinear spatial normalization using basis functions , 1999, Human brain mapping.

[43]  R. Turner,et al.  Event-Related fMRI: Characterizing Differential Responses , 1998, NeuroImage.

[44]  R. Turner,et al.  Combined correction for geometric distortion and its interaction with head movement in fMRI , 2002 .

[45]  J. O'Doherty,et al.  Neural Responses during Anticipation of a Primary Taste Reward , 2002, Neuron.

[46]  Brian Knutson,et al.  Reward-Motivated Learning: Mesolimbic Activation Precedes Memory Formation , 2006, Neuron.

[47]  S. Ikemoto Dopamine reward circuitry: Two projection systems from the ventral midbrain to the nucleus accumbens–olfactory tubercle complex , 2007, Brain Research Reviews.

[48]  P. Matthews,et al.  Learning about pain: the neural substrate of the prediction error for aversive events. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[49]  P. Tobler,et al.  Functional imaging of the human dopaminergic midbrain , 2009, Trends in Neurosciences.

[50]  T. Jay Dopamine: a potential substrate for synaptic plasticity and memory mechanisms , 2003, Progress in Neurobiology.

[51]  Raymond J. Dolan,et al.  Anticipation of novelty recruits reward system and hippocampus while promoting recollection , 2007, NeuroImage.

[52]  Karl J. Friston,et al.  Modelling Geometric Deformations in Epi Time Series , 2022 .

[53]  Hans-Jochen Heinze,et al.  Mesolimbic novelty processing in older adults. , 2007, Cerebral cortex.

[54]  Mark G. Packard,et al.  Anterograde and retrograde tracing of projections from the ventral tegmental area to the hippocampal formation in the rat , 1994, Brain Research Bulletin.

[55]  Y. Smith,et al.  Anatomy of the dopamine system in the basal ganglia , 2000, Trends in Neurosciences.

[56]  M. Mesulam,et al.  From sensation to cognition. , 1998, Brain : a journal of neurology.

[57]  W. K. Cullen,et al.  Dopamine-dependent facilitation of LTP induction in hippocampal CA1 by exposure to spatial novelty , 2003, Nature Neuroscience.

[58]  E. Balint Memory and consciousness. , 1987, The International journal of psycho-analysis.

[59]  Mark D'Esposito,et al.  Rapid Prefrontal-Hippocampal Habituation to Novel Events , 2004, The Journal of Neuroscience.

[60]  Karl J. Friston,et al.  Segregating the functions of human hippocampus. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[61]  E. Rolls,et al.  Reward-Spatial View Representations and Learning in the Primate Hippocampus , 2005, The Journal of Neuroscience.

[62]  N. Daw,et al.  Striatal Activity Underlies Novelty-Based Choice in Humans , 2008, Neuron.

[63]  L. Tugan Muftuler,et al.  Multiple repetitions reveal functionally and anatomically distinct patterns of hippocampal activity during continuous recognition memory , 2008, Hippocampus.

[64]  Mircea Ariel Schoenfeld,et al.  Differentiation of idiopathic Parkinson's disease, multiple system atrophy, progressive supranuclear palsy, and healthy controls using magnetization transfer imaging , 2004, NeuroImage.

[65]  M. Mesulam,et al.  Trajectories of cholinergic pathways within the cerebral hemispheres of the human brain. , 1998, Brain : a journal of neurology.

[66]  R. F. Thompson,et al.  Hippocampus and trace conditioning of the rabbit's classically conditioned nictitating membrane response. , 1986, Behavioral neuroscience.

[67]  K. Berridge The debate over dopamine’s role in reward: the case for incentive salience , 2007, Psychopharmacology.

[68]  Jeffrey C. Cooper,et al.  Functional magnetic resonance imaging of reward prediction , 2005, Current opinion in neurology.

[69]  Nico Bunzeck,et al.  Reward Motivation Accelerates the Onset of Neural Novelty Signals in Humans to 85 Milliseconds , 2009, Current Biology.