The Hippocampus Codes the Uncertainty of Cue–Outcome Associations: An Intracranial Electrophysiological Study in Humans

Learning to predict upcoming outcomes based on environmental cues is essential for adaptative behavior. In monkeys, midbrain dopaminergic neurons code two statistical properties of reward: a prediction error at the outcome and uncertainty during the delay period between cues and outcomes. Although the hippocampus is sensitive to reward processing, and hippocampal–midbrain functional interactions are well documented, it is unknown whether it also codes the statistical properties of reward information. To address this question, we recorded local field potentials from intracranial electrodes in human hippocampus while subjects learned to associate cues of slot machines with various monetary reward probabilities (P). We found that the amplitudes of negative event-related potentials covaried with uncertainty at the outcome, being maximal for P = 0.5 and minimal for P = 0 and P = 1, regardless of winning or not. These results show that the hippocampus computes an uncertainty signal that may constitute a fundamental mechanism underlying the role of this brain region in a number of functions, including attention-based learning, associative learning, probabilistic classification, and binding of stimulus elements.

[1]  R. Douglas,et al.  The hippocampus and behavior. , 1967, Psychological bulletin.

[2]  R. Rescorla.  "Configural" conditioning in discrete-trial bar pressing. , 1972, Journal of comparative and physiological psychology.

[3]  Deepak N. Pandya,et al.  Some connections of the entorhinal (area 28) and perirhinal (area 35) cortices of the rhesus monkey. III. Efferent connections , 1975, Brain Research.

[4]  Deepak N. Pandya,et al.  Some connections of the entorhinal (area 28) and perirhinal (area 35) cortices of the rhesus monkey. II. Frontal lobe afferents , 1975, Brain Research.

[5]  J. Pearce,et al.  A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. , 1980, Psychological review.

[6]  W M Cowan,et al.  Subcortical afferents to the hippocampal formation in the monkey , 1980, The Journal of comparative neurology.

[7]  H. Niki,et al.  Hippocampal unit activity and delayed response in the monkey , 1985, Brain Research.

[8]  U. Frey,et al.  Dopaminergic antagonists prevent long-term maintenance of posttetanic LTP in the CA1 region of rat hippocampal slices , 1990, Brain Research.

[9]  M A Gluck,et al.  Computational models of the neural bases of learning and memory. , 1993, Annual review of neuroscience.

[10]  D. Amaral,et al.  Perirhinal and parahippocampal cortices of the macaque monkey: Cortical afferents , 1994, The Journal of comparative neurology.

[11]  L. Squire,et al.  Structure and function of declarative and nondeclarative memory systems. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[12]  M. Laruelle,et al.  Images in neuroscience. SPECT imaging of synaptic dopamine. , 1996, The American journal of psychiatry.

[13]  H. Eichenbaum,et al.  The hippocampus and memory for orderly stimulus relations. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[14]  Carol A. Tamminga.  Images in neuroscience , 1999 .

[15]  J. Glowinski,et al.  Hippocampo‐prefrontal cortex pathway: Anatomical and electrophysiological characteristics , 2000, Hippocampus.

[16]  A. Grace,et al.  Glutamatergic Afferents from the Hippocampus to the Nucleus Accumbens Regulate Activity of Ventral Tegmental Area Dopamine Neurons , 2001, The Journal of Neuroscience.

[17]  R. Wise,et al.  Novelty‐evoked elevations of nucleus accumbens dopamine: dependence on impulse flow from the ventral subiculum and glutamatergic neurotransmission in the ventral tegmental area , 2001, The European journal of neuroscience.

[18]  Peter Dayan,et al.  Expected and Unexpected Uncertainty: ACh and NE in the Neocortex , 2002, NIPS.

[19]  H. Mallot,et al.  Reward modulates neuronal activity in the hippocampus of the rat , 2003, Behavioural Brain Research.

[20]  Paul J. Harrison.  The hippocampus in schizophrenia: a review of the neuropathological evidence and its pathophysiological implications , 2004, Psychopharmacology.

[21]  Zin Z. Khaing,et al.  Gene expression in dopamine and GABA systems in an animal model of schizophrenia: effects of antipsychotic drugs , 2003, The European journal of neuroscience.

[22]  Michael J. Frank,et al.  Transitivity, flexibility, conjunctive representations, and the hippocampus. II. A computational analysis , 2003, Hippocampus.

[23]  Michael Van Elzakker,et al.  Transitivity, flexibility, conjunctive representations, and the hippocampus. I. An empirical analysis , 2003, Hippocampus.

[24]  W. Schultz,et al.  Discrete Coding of Reward Probability and Uncertainty by Dopamine Neurons , 2003, Science.

[25]  A. Grace,et al.  Afferent modulation of dopamine neuron firing differentially regulates tonic and phasic dopamine transmission , 2003, Nature Neuroscience.

[26]  François Mauguière,et al.  Early Amygdala Reaction to Fear Spreading in Occipital, Temporal, and Frontal Cortex A Depth Electrode ERP Study in Human , 2004, Neuron.

[27]  W. Hulstijn,et al.  Drug-induced stimulation and suppression of action monitoring in healthy volunteers , 2004, Psychopharmacology.

[28]  Colin Camerer,et al.  Neural Systems Responding to Degrees of Uncertainty in Human Decision-Making , 2005, Science.

[29]  Raymond J. Dolan,et al.  Information theory, novelty and hippocampal responses: unpredicted or unpredictable? , 2005, Neural Networks.

[30]  E. Rolls,et al.  Reward-Spatial View Representations and Learning in the Primate Hippocampus , 2005, The Journal of Neuroscience.

[31]  J. Lisman,et al.  The Hippocampal-VTA Loop: Controlling the Entry of Information into Long-Term Memory , 2005, Neuron.

[32]  Anthony A Grace,et al.  The Hippocampus Modulates Dopamine Neuron Responsivity by Regulating the Intensity of Phasic Neuron Activation , 2006, Neuropsychopharmacology.

[33]  K. Berman,et al.  Cerebral Cortex doi:10.1093/cercor/bhj004 Neural Coding of Distinct Statistical Properties of Reward Information in Humans , 2005 .

[34]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[35]  S. Quartz,et al.  Neural Differentiation of Expected Reward and Risk in Human Subcortical Structures , 2006, Neuron.

[36]  Karl J. Friston,et al.  Encoding uncertainty in the hippocampus , 2006, Neural Networks.

[37]  Brian Knutson,et al.  Reward-Motivated Learning: Mesolimbic Activation Precedes Memory Formation , 2006, Neuron.

[38]  A. Meyer-Lindenberg,et al.  Prefrontal-Hippocampal Coupling During Memory Processing Is Modulated by COMT Val158Met Genotype , 2006, Biological Psychiatry.

[39]  J. O'Doherty,et al.  Reward Value Coding Distinct From Risk Attitude-Related Uncertainty Coding in Human Reward Systems , 2006, Journal of neurophysiology.

[40]  A. Grace,et al.  Aberrant Hippocampal Activity Underlies the Dopamine Dysregulation in an Animal Model of Schizophrenia , 2007, The Journal of Neuroscience.

[41]  Raymond J. Dolan,et al.  Anticipation of novelty recruits reward system and hippocampus while promoting recollection , 2007, NeuroImage.

[42]  W. Schultz.  Behavioral dopamine signals , 2007, Trends in Neurosciences.

[43]  S. Quartz,et al.  Human Insula Activation Reflects Risk Prediction Errors As Well As Risk , 2008, The Journal of Neuroscience.

[44]  F. Mauguière,et al.  Clinical manifestations of insular lobe seizures: a stereo-electroencephalographic study , 2008, Clinical Neurophysiology.