Inferences on a multidimensional social hierarchy use a grid-like code

Generalizing experiences to guide decision making in novel situations is a hallmark of flexible behavior. It has been hypothesized such flexibility depends on a cognitive map of an environment or task, but directly linking the two has proven elusive. Here, we find that discretely sampled abstract relationships between entities in an unseen two-dimensional (2-D) social hierarchy are reconstructed into a unitary 2-D cognitive map in the hippocampus and entorhinal cortex. We further show that humans utilize a grid-like code in several brain regions, including entorhinal cortex and medial prefrontal cortex, for inferred direct trajectories between entities in the reconstructed abstract space during discrete decisions. Moreover, these neural grid-like codes in the entorhinal cortex predict neural decision value computations in the medial prefrontal cortex and temporoparietal junction area during choice. Collectively, these findings show that grid-like codes are used by the human brain to infer novel solutions, even in abstract and discrete problems, and suggest a general mechanism underpinning flexible decision making and generalization.

[1]  A. Rangel,et al.  Informatic parcellation of the network involved in the computation of subjective value. , 2014, Social cognitive and affective neuroscience.

[2]  Allison G. Reid,et al.  The hippocampus supports deliberation during value-based decisions , 2019, eLife.

[3]  M. Rushworth,et al.  Connectivity-based subdivisions of the human right "temporoparietal junction area": evidence for different areas participating in different cortical networks. , 2012, Cerebral cortex.

[4]  Timothy E. J. Behrens,et al.  An Agent Independent Axis for Executed and Modeled Choice in Medial Prefrontal Cortex , 2013, Neuron.

[5]  H. Eichenbaum Prefrontal–hippocampal interactions in episodic memory , 2017, Nature Reviews Neuroscience.

[6]  Philipp Berens,et al.  CircStat: AMATLABToolbox for Circular Statistics , 2009, Journal of Statistical Software.

[7]  Kayla R. Velnoskey,et al.  The dorsomedial prefrontal cortex computes task-invariant relative subjective value for self and other , 2019, eLife.

[8]  S. Holm A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[9]  A. Bennett,et al.  Do animals have cognitive maps? , 1996, The Journal of experimental biology.

[10]  Timothy E. J. Behrens,et al.  Counterfactual Choice and Learning in a Neural Network Centered on Human Lateral Frontopolar Cortex , 2011, PLoS biology.

[11]  K. Amunts,et al.  Cytoarchitectonic mapping of the human amygdala, hippocampal region and entorhinal cortex: intersubject variability and probability maps , 2005, Anatomy and Embryology.

[12]  Tobias Staudigl,et al.  Hexadirectional Modulation of High-Frequency Electrophysiological Activity in the Human Anterior Medial Temporal Lobe Maps Visual Space , 2018, Current Biology.

[13]  Tobias Navarro Schröder,et al.  Hexadirectional coding of visual space in human entorhinal cortex , 2018, Nature Neuroscience.

[14]  Keqin Liu,et al.  Automatic Integration , 2020, 2006.15210.

[15]  I. Fried,et al.  Direct recordings of grid-like neuronal activity in human spatial navigation , 2013, Nature Neuroscience.

[16]  M. Kendall A NEW MEASURE OF RANK CORRELATION , 1938 .

[17]  Zeb Kurth-Nelson,et al.  What Is a Cognitive Map? Organizing Knowledge for Flexible Behavior , 2018, Neuron.

[18]  Shachar Maidenbaum,et al.  Grid-like hexadirectional modulation of human entorhinal theta oscillations , 2018, Proceedings of the National Academy of Sciences.

[19]  Steen Moeller,et al.  The Human Connectome Project's neuroimaging approach , 2016, Nature Neuroscience.

[20]  R. Dolan,et al.  Confidence in value-based choice , 2012, Nature Neuroscience.

[21]  Amy J. C. Cuddy,et al.  Universal dimensions of social cognition: warmth and competence , 2007, Trends in Cognitive Sciences.

[22]  M. Woolrich,et al.  Mechanisms underlying cortical activity during value-guided choice , 2011, Nature Neuroscience.

[23]  P. Dayan,et al.  Cortical substrates for exploratory decisions in humans , 2006, Nature.

[24]  Nikolaus Kriegeskorte,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .

[25]  M. Rushworth,et al.  Connectivity reveals relationship of brain areas for reward-guided learning and decision making in human and monkey frontal cortex , 2015, Proceedings of the National Academy of Sciences.

[26]  M. Mallar Chakravarty,et al.  Quantitative comparison of 21 protocols for labeling hippocampal subfields and parahippocampal subregions in in vivo MRI: Towards a harmonized segmentation protocol , 2015, NeuroImage.

[27]  Thomas H. B. FitzGerald,et al.  The Role of Human Orbitofrontal Cortex in Value Comparison for Incommensurable Objects , 2009, The Journal of Neuroscience.

[28]  Jörn Diedrichsen,et al.  Reliability of dissimilarity measures for multi-voxel pattern analysis , 2016, NeuroImage.

[29]  P. Glimcher,et al.  Free choice shapes normalized value signals in medial orbitofrontal cortex , 2018, Nature Communications.

[30]  Michael L Platt,et al.  Adaptations for social cognition in the primate brain , 2016, Philosophical Transactions of the Royal Society B: Biological Sciences.

[31]  P. Hluštík,et al.  Effects of spatial smoothing on fMRI group inferences. , 2008, Magnetic resonance imaging.

[32]  Timothy E. J. Behrens,et al.  Neural Mechanisms of Foraging , 2012, Science.

[33]  Razvan Pascanu,et al.  Vector-based navigation using grid-like representations in artificial agents , 2018, Nature.

[34]  Jonathan D. Cohen,et al.  Indirection and symbol-like processing in the prefrontal cortex and basal ganglia , 2013, Proceedings of the National Academy of Sciences.

[35]  M. Botvinick,et al.  The hippocampus as a predictive map , 2016 .

[36]  Dmitriy Aronov,et al.  Mapping of a non-spatial dimension by the hippocampal/entorhinal circuit , 2017, Nature.

[37]  Xiaoyang Long,et al.  A spatial map in the somatosensory cortex , 2018 .

[38]  Arne D. Ekstrom,et al.  Space, time, and episodic memory: The hippocampus is all over the cognitive map , 2018, Hippocampus.

[39]  Peter Bossaerts,et al.  Neural correlates of mentalizing-related computations during strategic interactions in humans , 2008, Proceedings of the National Academy of Sciences.

[40]  H. Eichenbaum,et al.  Can We Reconcile the Declarative Memory and Spatial Navigation Views on Hippocampal Function? , 2014, Neuron.

[41]  J. Daunizeau,et al.  Automatic integration of confidence in the brain valuation signal , 2015, Nature Neuroscience.

[42]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[43]  Matthew F S Rushworth,et al.  The Computation of Social Behavior , 2009, Science.

[44]  E. Tolman Cognitive maps in rats and men. , 1948, Psychological review.

[45]  Seongmin A. Park,et al.  Neural computations underlying strategic social decision-making in groups , 2019, Nature Communications.

[46]  Xiaojun Bao,et al.  Grid-like Neural Representations Support Olfactory Navigation of a Two-Dimensional Odor Space , 2019, Neuron.

[47]  Mark W Woolrich,et al.  Associative learning of social value , 2008, Nature.

[48]  Christian F. Doeller,et al.  Evidence for grid cells in a human memory network , 2010, Nature.

[49]  Xiaoyang Long,et al.  A novel somatosensory spatial navigation system outside the hippocampal formation , 2018, Cell Research.

[50]  Matthew F S Rushworth,et al.  Neural Mechanisms of Social Cognition in Primates. , 2018, Annual review of neuroscience.

[51]  D. Kumaran,et al.  The Emergence and Representation of Knowledge about Social and Nonsocial Hierarchies , 2012, Neuron.

[52]  R. Passingham The hippocampus as a cognitive map J. O'Keefe & L. Nadel, Oxford University Press, Oxford (1978). 570 pp., £25.00 , 1979, Neuroscience.

[53]  M. Fyhn,et al.  Spatial Representation in the Entorhinal Cortex , 2004, Science.

[54]  H. Eichenbaum,et al.  Interplay of Hippocampus and Prefrontal Cortex in Memory , 2013, Current Biology.

[55]  Timothy Edward John Behrens,et al.  How Green Is the Grass on the Other Side? Frontopolar Cortex and the Evidence in Favor of Alternative Courses of Action , 2009, Neuron.

[56]  K. Amunts,et al.  Centenary of Brodmann's Map — Conception and Fate , 2022 .

[57]  C. Frith,et al.  Mechanisms of social cognition. , 2012, Annual review of psychology.

[58]  M. Witter,et al.  Anatomical Organization of the Parahippocampal‐Hippocampal Network , 2000, Annals of the New York Academy of Sciences.

[59]  Nikolaus Weiskopf,et al.  Optimal EPI parameters for reduction of susceptibility-induced BOLD sensitivity losses: A whole-brain analysis at 3 T and 1.5 T , 2006, NeuroImage.

[60]  Joel Z. Leibo,et al.  Prefrontal cortex as a meta-reinforcement learning system , 2018, bioRxiv.

[61]  Stephen M. Smith,et al.  Threshold-free cluster enhancement: Addressing problems of smoothing, threshold dependence and localisation in cluster inference , 2009, NeuroImage.

[62]  Timothy E. J. Behrens,et al.  Organizing conceptual knowledge in humans with a gridlike code , 2016, Science.

[63]  Caswell Barry,et al.  The Tolman-Eichenbaum Machine: Unifying Space and Relational Memory through Generalization in the Hippocampal Formation , 2019, Cell.

[64]  V Hachinski,et al.  Vascular Factors in Cognitive Impairment‐Where Are We Now? , 2000, Annals of the New York Academy of Sciences.

[65]  T. Hafting,et al.  Microstructure of a spatial map in the entorhinal cortex , 2005, Nature.

[66]  M. Rushworth,et al.  Distinct Roles of Three Frontal Cortical Areas in Reward-Guided Behavior , 2011, The Journal of Neuroscience.

[67]  J. Wallis,et al.  Closed-Loop Theta Stimulation in the Orbitofrontal Cortex Prevents Reward-Based Learning , 2020, Neuron.

[68]  Kurt Gray,et al.  The MR2: A multi-racial, mega-resolution database of facial stimuli , 2016, Behavior research methods.

[69]  Matthew P. H. Gardner,et al.  Complementary Task Structure Representations in Hippocampus and Orbitofrontal Cortex during an Odor Sequence Task , 2019, Current Biology.

[70]  Neil Burgess,et al.  Using Grid Cells for Navigation , 2015, Neuron.

[71]  Antonio Rangel,et al.  The Decision Value Computations in the vmPFC and Striatum Use a Relative Value Code That is Guided by Visual Attention , 2011, The Journal of Neuroscience.

[72]  Nicolas W. Schuck,et al.  Human Orbitofrontal Cortex Represents a Cognitive Map of State Space , 2016, Neuron.

[73]  Russell A. Epstein,et al.  Human entorhinal cortex represents visual space using a boundary-anchored grid , 2017, Nature Neuroscience.