The role of the hippocampus in weighting expectations during inference under uncertainty

Making inference under uncertainty requires an optimal weighting of prior expectations and observations. How this weighting is realized in the brain remains elusive. To investigate this, we recorded functional neuroimaging data while participants estimated a number based on noisy observations. Crucially, the prior expectation about the variability of observations (an expected variability) was manipulated. Consistent with normative models, when novel observations were characterized by higher expected or observed variability, participants' estimates relied more on expectations than novel observations and were characterized by higher stochasticity. Activity in hippocampus increased when novel evidence was characterized by higher expected or observed variability. Response in superior parietal cortex reflected a precision-weighted prediction error signal (i.e., the distance between observations and expectations) that was modulated by hippocampal activity. Our findings implicate the hippocampus during inference under uncertainty, suggesting a role in weighting prior representations over observations and in modulating responsivity of superior parietal cortex to prediction error.

[1]  C. Summerfield,et al.  Expectation (and attention) in visual cognition , 2009, Trends in Cognitive Sciences.

[2]  S. Dehaene,et al.  THREE PARIETAL CIRCUITS FOR NUMBER PROCESSING , 2003, Cognitive neuropsychology.

[3]  J. Tenenbaum,et al.  Special issue on “Probabilistic models of cognition , 2022 .

[4]  Michael S Landy,et al.  Statistical decision theory and the selection of rapid, goal-directed movements. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[5]  A. Nobre,et al.  Where and When to Pay Attention: The Neural Systems for Directing Attention to Spatial Locations and to Time Intervals as Revealed by Both PET and fMRI , 1998, The Journal of Neuroscience.

[6]  Michael N. Shadlen,et al.  Temporal context calibrates interval timing , 2010, Nature Neuroscience.

[7]  Matthijs A. A. van der Meer,et al.  Internally generated sequences in learning and executing goal-directed behavior , 2014, Trends in Cognitive Sciences.

[8]  Konrad Paul Kording,et al.  Estimating the sources of motor errors for adaptation and generalization , 2008, Nature Neuroscience.

[9]  A. Pouget,et al.  Probabilistic brains: knowns and unknowns , 2013, Nature Neuroscience.

[10]  Christina Zelano,et al.  Olfactory Predictive Codes and Stimulus Templates in Piriform Cortex , 2011, Neuron.

[11]  Daniel M. Wolpert,et al.  Making smooth moves , 2022 .

[12]  D. LeBihan,et al.  Modulation of Parietal Activation by Semantic Distance in a Number Comparison Task , 2001, NeuroImage.

[13]  Timothy E. J. Behrens,et al.  Dissociable effects of surprise and model update in parietal and anterior cingulate cortex , 2013, Proceedings of the National Academy of Sciences.

[14]  P. Glimcher Understanding dopamine and reinforcement learning: The dopamine reward prediction error hypothesis , 2011, Proceedings of the National Academy of Sciences.

[15]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[16]  K. Amunts,et al.  Probabilistic maps, morphometry, and variability of cytoarchitectonic areas in the human superior parietal cortex. , 2008, Cerebral cortex.

[17]  Adam Binch,et al.  Perception as Bayesian Inference , 2014 .

[18]  Nicholas L. Balderston,et al.  The human amygdala plays a stimulus specific role in the detection of novelty , 2011, NeuroImage.

[19]  Karl J. Friston,et al.  The Neural Representation of Prospective Choice during Spatial Planning and Decisions , 2017, PLoS biology.

[20]  N. Alpert,et al.  Conscious recollection and the human hippocampal formation: evidence from positron emission tomography. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[21]  James J. Knierim,et al.  CA3 Retrieves Coherent Representations from Degraded Input: Direct Evidence for CA3 Pattern Completion and Dentate Gyrus Pattern Separation , 2014, Neuron.

[22]  E. Todorov Optimality principles in sensorimotor control , 2004, Nature Neuroscience.

[23]  Uri Hasson,et al.  Multiple sensitivity profiles to diversity and transition structure in non-stationary input , 2012, NeuroImage.

[24]  J. Lisman,et al.  Storage, recall, and novelty detection of sequences by the hippocampus: Elaborating on the SOCRATIC model to account for normal and aberrant effects of dopamine , 2001, Hippocampus.

[25]  B. McNaughton,et al.  Hebb-Marr networks and the neurobiological representation of action in space. , 1990 .

[26]  C. Büchel,et al.  Placebo Analgesia: A Predictive Coding Perspective , 2014, Neuron.

[27]  Karl J. Friston,et al.  Generalisability, Random Effects & Population Inference , 1998, NeuroImage.

[28]  Timothy E. J. Behrens,et al.  Brain Systems for Probabilistic and Dynamic Prediction: Computational Specificity and Integration , 2013, PLoS biology.

[29]  J. Gray,et al.  Précis of The neuropsychology of anxiety: An enquiry into the functions of the septo-hippocampal system , 1982, Behavioral and Brain Sciences.

[30]  Hugo L. Fernandes,et al.  Differential Representations of Prior and Likelihood Uncertainty in the Human Brain , 2012, Current Biology.

[31]  A. Yuille,et al.  Object perception as Bayesian inference. , 2004, Annual review of psychology.

[32]  Robert C. Wilson,et al.  Is Model Fitting Necessary for Model-Based fMRI? , 2015, PLoS Comput. Biol..

[33]  Michael I. Jordan,et al.  An internal model for sensorimotor integration. , 1995, Science.

[34]  T. Dalgleish,et al.  Threat visibility modulates the defensive brain circuit underlying fear and anxiety , 2016, Neuroscience Letters.

[35]  Raymond J. Dolan,et al.  Information theory, novelty and hippocampal responses: unpredicted or unpredictable? , 2005, Neural Networks.

[36]  M. Landy,et al.  Decision making, movement planning and statistical decision theory , 2008, Trends in Cognitive Sciences.

[37]  Wei Ji Ma,et al.  Bayesian inference with probabilistic population codes , 2006, Nature Neuroscience.

[38]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[39]  Andy Clark,et al.  The many faces of precision (Replies to commentaries on “Whatever next? Neural prediction, situated agents, and the future of cognitive science”) , 2013, Front. Psychol..

[40]  C. Summerfield,et al.  Expectation in perceptual decision making: neural and computational mechanisms , 2014, Nature Reviews Neuroscience.

[41]  T. Robbins,et al.  Decision Making, Affect, and Learning: Attention and Performance XXIII , 2011 .

[42]  N. Kanwisher,et al.  The Generality of Parietal Involvement in Visual Attention , 1999, Neuron.

[43]  B. Strange,et al.  Adaptive anterior hippocampal responses to oddball stimuli , 2001, Hippocampus.

[44]  Karl J. Friston,et al.  A Bayesian model of context-sensitive value attribution , 2016, eLife.

[45]  Rajesh P. N. Rao,et al.  Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. , 1999 .

[46]  Matthijs A. A. van der Meer,et al.  Integrating hippocampus and striatum in decision-making , 2007, Current Opinion in Neurobiology.

[47]  Konrad Paul Kording,et al.  Review TRENDS in Cognitive Sciences Vol.10 No.7 July 2006 Special Issue: Probabilistic models of cognition Bayesian decision theory in sensorimotor control , 2022 .

[48]  Konrad Kording,et al.  Annals of the New York Academy of Sciences Bayesian Models: the Structure of the World, Uncertainty, Behavior, and the Brain , 2022 .

[49]  D. Knill,et al.  The Bayesian brain: the role of uncertainty in neural coding and computation , 2004, Trends in Neurosciences.

[50]  F. Petzschner,et al.  A Bayesian perspective on magnitude estimation , 2015, Trends in Cognitive Sciences.

[51]  M. Shadlen,et al.  Representation of Time by Neurons in the Posterior Parietal Cortex of the Macaque , 2003, Neuron.

[52]  K. Priftis,et al.  Brain damage: Neglect disrupts the mental number line , 2002, Nature.

[53]  M. Hasselmo,et al.  Free recall and recognition in a network model of the hippocampus: simulating effects of scopolamine on human memory function , 1997, Behavioural Brain Research.

[54]  Wei Ji Ma,et al.  Neural coding of uncertainty and probability. , 2014, Annual review of neuroscience.

[55]  Kevin J. Miller,et al.  Dorsal hippocampus contributes to model-based planning , 2017, Nature Neuroscience.

[56]  Timothy Edward John Behrens,et al.  Diffusion-Weighted Imaging Tractography-Based Parcellation of the Human Parietal Cortex and Comparison with Human and Macaque Resting-State Functional Connectivity , 2011, The Journal of Neuroscience.

[57]  D. Kumaran,et al.  Novelty signals: a window into hippocampal information processing , 2009, Trends in Cognitive Sciences.

[58]  S. Dehaene,et al.  The mental representation of parity and number magnitude. , 1993 .

[59]  A. Clark Whatever next? Predictive brains, situated agents, and the future of cognitive science. , 2013, The Behavioral and brain sciences.

[60]  Konrad Paul Kording,et al.  Sensory Cue Integration , 2011 .

[61]  M. Jazayeri Probabilistic sensory recoding , 2008, Current Opinion in Neurobiology.

[62]  M. Rushworth,et al.  Attention Systems and the Organization of the Human Parietal Cortex , 2001, The Journal of Neuroscience.

[63]  Nathaniel D. Daw,et al.  Trial-by-trial data analysis using computational models , 2011 .

[64]  Karl J. Friston,et al.  Encoding uncertainty in the hippocampus , 2006, Neural Networks.

[65]  J. Lisman,et al.  Hippocampus as comparator: Role of the two input and two output systems of the hippocampus in selection and registration of information , 2001, Hippocampus.

[66]  S. Rauch,et al.  Inhibited and Uninhibited Infants "Grown Up": Adult Amygdalar Response to Novelty , 2003, Science.

[67]  Karl J. Friston,et al.  A theory of cortical responses , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[68]  C. Stark,et al.  Pattern Separation in the Human Hippocampal CA3 and Dentate Gyrus , 2008, Science.

[69]  Konrad Paul Kording,et al.  Bayesian integration in sensorimotor learning , 2004, Nature.

[70]  R. Buckner,et al.  Self-projection and the brain , 2007, Trends in Cognitive Sciences.

[71]  J. Hohwy The Predictive Mind , 2013 .

[72]  J. Smallwood Distinguishing how from why the mind wanders: a process-occurrence framework for self-generated mental activity. , 2013, Psychological bulletin.

[73]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.