Anticipation of novelty recruits reward system and hippocampus while promoting recollection

The dopaminergic midbrain, which comprises the substantia nigra and ventral tegmental area (SN/VTA), plays a central role in reward processing. This region is also activated by novel stimuli, raising the possibility that novelty and reward have shared functional properties. It is currently unclear whether functional aspects of reward processing in the SN/VTA, namely, activation by unexpected rewards and cues that predict reward, also characterize novelty processing. To address this question, we conducted an fMRI experiment during which subjects viewed symbolic cues that predicted either novel or familiar images of scenes with 75% validity. We show that SN/VTA was activated by cues predicting novel images as well as by unexpected novel images that followed familiarity-predictive cues, an ‘unexpected novelty’ response. The hippocampus, a region implicated in detecting and encoding novel stimuli, showed an anticipatory novelty response but differed from the response profile of SN/VTA in responding at outcome to expected and ‘unexpected’ novelty. In a behavioral extension of the experiment, recollection increased relative to familiarity when comparing delayed recognition memory for anticipated novel stimuli with unexpected novel stimuli. These data reveal commonalities in SN/VTA responses to anticipating reward and anticipating novel stimuli. We suggest that this anticipatory response codes a motivational exploratory novelty signal that, together with anticipatory activation of the hippocampus, leads to enhanced encoding of novel events. In more general terms, the data suggest that dopaminergic processing of novelty might be important in driving exploration of new environments.

[1]  Mircea Ariel Schoenfeld,et al.  Differentiation of idiopathic Parkinson's disease, multiple system atrophy, progressive supranuclear palsy, and healthy controls using magnetization transfer imaging , 2004, NeuroImage.

[2]  Chi-Shing Zee,et al.  Magnetic Resonance Imaging-Based Volumetric Analysis of Basal Ganglia Nuclei and Substantia Nigra in Patients with Parkinson’s Disease , 2006, Neurosurgery.

[3]  John P. Aggleton,et al.  Interleaving brain systems for episodic and recognition memory , 2006, Trends in Cognitive Sciences.

[4]  Mark F Bear,et al.  Reward timing in the primary visual cortex. , 2006, Science.

[5]  J. Delacour,et al.  A new one-trial test for neurobiological studies of memory in rats. 1: Behavioral data , 1988, Behavioural Brain Research.

[6]  T. Jay Dopamine: a potential substrate for synaptic plasticity and memory mechanisms , 2003, Progress in Neurobiology.

[7]  M. Spinella,et al.  EVOLUTIONARY MISMATCH, NEURAL REWARD CIRCUITS, AND PATHOLOGICAL GAMBLING , 2003, The International journal of neuroscience.

[8]  E. Kandel,et al.  D1/D5 receptor agonists induce a protein synthesis-dependent late potentiation in the CA1 region of the hippocampus. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[9]  S. Sajikumar,et al.  Late-associativity, synaptic tagging, and the role of dopamine during LTP and LTD , 2004, Neurobiology of Learning and Memory.

[10]  D. Sagi,et al.  Dynamics of Memory Representations in Networks with Novelty-Facilitated Synaptic Plasticity , 2006, Neuron.

[11]  W. Schultz Getting Formal with Dopamine and Reward , 2002, Neuron.

[12]  U. Frey,et al.  Dopaminergic antagonists prevent long-term maintenance of posttetanic LTP in the CA1 region of rat hippocampal slices , 1990, Brain Research.

[13]  A. Smit,et al.  Synapse Formation between Central Neurons Requires Postsynaptic Expression of the MEN1 Tumor Suppressor Gene , 2001, The Journal of Neuroscience.

[14]  W. Schultz,et al.  Responses of monkey dopamine neurons during learning of behavioral reactions. , 1992, Journal of neurophysiology.

[15]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[17]  R. Habib,et al.  Activation of midbrain structures by associative novelty and the formation of explicit memory in humans. , 2004, Learning & memory.

[18]  N. Lemon,et al.  Dopamine D1/D5 Receptors Gate the Acquisition of Novel Information through Hippocampal Long-Term Potentiation and Long-Term Depression , 2006, The Journal of Neuroscience.

[19]  Hans-Jochen Heinze,et al.  Human Hippocampal and Parahippocampal Activity during Visual Associative Recognition Memory for Spatial and Nonspatial Stimulus Configurations , 2003, The Journal of Neuroscience.

[20]  M Mishkin,et al.  Brain activity evidence for recognition without recollection after early hippocampal damage , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[21]  H. Heinze,et al.  Reward-Related fMRI Activation of Dopaminergic Midbrain Is Associated with Enhanced Hippocampus- Dependent Long-Term Memory Formation , 2005, Neuron.

[22]  A. Dale,et al.  Deconvolution of Event-Related fMRI Responses in Fast-Rate Experimental Designs: Tracking Amplitude Variations , 2000, Journal of Cognitive Neuroscience.

[23]  O Josephs,et al.  Event-related functional magnetic resonance imaging: modelling, inference and optimization. , 1999, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[24]  A. Yonelinas,et al.  Signal-Detection, Threshold, and Dual-Process Models of Recognition Memory: ROCs and Conscious Recollection , 1996, Consciousness and Cognition.

[25]  Jens C. Pruessner,et al.  Hippocampal volume is as variable in young as in older adults: Implications for the notion of hippocampal atrophy in humans , 2007, NeuroImage.

[26]  Brian Knutson,et al.  Dissociation of reward anticipation and outcome with event-related fMRI , 2001, Neuroreport.

[27]  U. Frey,et al.  The effect of dopaminergic D1 receptor blockade during tetanization on the expression of long-term potentiation in the rat CA1 region in vitro , 1991, Neuroscience Letters.

[28]  William G. Cochran,et al.  Experimental Designs, 2nd Edition , 1950 .

[29]  J. Lisman,et al.  The Hippocampal-VTA Loop: Controlling the Entry of Information into Long-Term Memory , 2005, Neuron.

[30]  Jeffrey C. Cooper,et al.  Functional magnetic resonance imaging of reward prediction , 2005, Current opinion in neurology.

[31]  M. Mishkin,et al.  Differential effects of early hippocampal pathology on episodic and semantic memory. , 1997, Science.

[32]  M. Mesulam,et al.  The central role of the prefrontal cortex in directing attention to novel events. , 2000, Brain : a journal of neurology.

[33]  J L Lancaster,et al.  Automated Talairach Atlas labels for functional brain mapping , 2000, Human brain mapping.

[34]  Brian Knutson,et al.  Anticipation of Increasing Monetary Reward Selectively Recruits Nucleus Accumbens , 2001, The Journal of Neuroscience.

[35]  Issidoros C. Sarinopoulos,et al.  The effect of anticipation and the specificity of sex differences for amygdala and hippocampus function in emotional memory , 2006, Proceedings of the National Academy of Sciences.

[36]  E. Tulving Memory and consciousness. , 1985 .

[37]  R. Cabeza,et al.  Triple dissociation in the medial temporal lobes: recollection, familiarity, and novelty. , 2006, Journal of neurophysiology.

[38]  M. Rugg,et al.  Brain activity before an event predicts later recollection , 2006, Nature Neuroscience.

[39]  W. Schultz,et al.  Adaptive Coding of Reward Value by Dopamine Neurons , 2005, Science.

[40]  T H Kelly,et al.  Exposure to novel environmental stimuli decreases amphetamine self-administration in rats. , 2001, Experimental and clinical psychopharmacology.

[41]  Brian Knutson,et al.  Reward-Motivated Learning: Mesolimbic Activation Precedes Memory Formation , 2006, Neuron.

[42]  Michael T. Bardo,et al.  Conditioned increase in place preference by access to novel objects: antagonism by MK-801 , 1999, Behavioural Brain Research.

[43]  Robert T. Knight,et al.  Effects of extensive temporal lobe damage or mild hypoxia on recollection and familiarity , 2002, Nature Neuroscience.

[44]  W. Schultz,et al.  Neuronal activity in monkey ventral striatum related to the expectation of reward , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[45]  N. Bunzeck,et al.  Absolute Coding of Stimulus Novelty in the Human Substantia Nigra/VTA , 2006, Neuron.

[46]  A. Ennaceur,et al.  A new one-trial test for neurobiological studies of memory in rats. III. Spatial vs. non-spatial working memory , 1992, Behavioural Brain Research.

[47]  R. Turner,et al.  Event-Related fMRI: Characterizing Differential Responses , 1998, NeuroImage.

[48]  J. Desmond,et al.  Making memories: brain activity that predicts how well visual experience will be remembered. , 1998, Science.

[49]  T. Nokes,et al.  Intrinsic reinforcing properties of putatively neutral stimuli in an instrumental two-lever discrimination task , 1996 .

[50]  H. Heinze,et al.  The Dopaminergic Midbrain Participates in Human Episodic Memory Formation: Evidence from Genetic Imaging , 2006, The Journal of Neuroscience.

[51]  Denise Manahan-Vaughan,et al.  Dopamine D 1 / D 5 Receptors Gate the Acquisition of Novel Information through Hippocampal Long-Term Potentiation and Long-Term Depression , 2006 .

[52]  C. Kirstein,et al.  Effects of novelty on behavior in the adolescent and adult rat. , 2006, Developmental psychobiology.

[53]  N. Hiroi,et al.  Genetic susceptibility to substance dependence , 2005, Molecular Psychiatry.

[54]  J. O'Doherty,et al.  Neural Responses during Anticipation of a Primary Taste Reward , 2002, Neuron.

[55]  D. Kumaran,et al.  An Unexpected Sequence of Events: Mismatch Detection in the Human Hippocampus , 2006, PLoS biology.

[56]  G. Rainer,et al.  Cognitive neuroscience: Neural mechanisms for detecting and remembering novel events , 2003, Nature Reviews Neuroscience.