Grid-like and distance codes for representing word meaning in the human brain

Relational information about items in memory is thought to be represented in our brain thanks to an internal comprehensive model, also referred to as a "cognitive map". In the human neuroimaging literature, two signatures of bi-dimensional cognitive maps have been reported: the grid-like code and the distance-dependent code. While these kinds of representation were previously observed during spatial navigation and, more recently, during processing of perceptual stimuli, it is still an open question whether they also underlie the representation of the most basic items of language: words. Here we taught human participants the meaning of novel words as arbitrary labels for a set of audiovisual objects varying orthogonally in size and sound. The novel words were therefore conceivable as points in a navigable 2D map of meaning. While subjects performed a word comparison task, we recorded their brain activity using functional magnetic resonance imaging (fMRI). By applying a combination of representational similarity and fMRI-adaptation analyses, we found evidence of i) a grid-like code, in the right postero-medial entorhinal cortex, representing the relative angular positions of words in the word space, and ii) a distance-dependent code, in medial prefrontal, orbitofrontal, and mid-cingulate cortices, representing the Euclidean distance between words. Additionally, we found evidence that the brain also separately represents the single dimensions of word meaning: their implied size, encoded in visual areas, and their implied sound, in Heschl's gyrus/Insula. These results support the idea that the meaning of words, when they are organized along two dimensions, is represented in the human brain across multiple maps of different dimensionality.

[1]  T. Hartley,et al.  The Neurobiology of Mammalian Navigation , 2018, Current Biology.

[2]  Marc N. Coutanche,et al.  Creatures great and small: Real-world size of animals predicts visual cortex representations beyond taxonomic category , 2018, NeuroImage.

[3]  Russell A. Epstein,et al.  Distances between Real-World Locations Are Represented in the Human Hippocampus , 2011, The Journal of Neuroscience.

[4]  Christian F. Doeller,et al.  The Hippocampus Encodes Distances in Multidimensional Feature Space , 2019, Current Biology.

[5]  May-Britt Moser,et al.  The entorhinal grid map is discretized , 2012, Nature.

[6]  P. Dupont,et al.  Left perirhinal cortex codes for similarity in meaning between written words: Comparison with auditory word input , 2015, Neuropsychologia.

[7]  Russell A. Epstein,et al.  Coding of Object Size and Object Category in Human Visual Cortex , 2016, Cerebral cortex.

[8]  Timothy E. J. Behrens,et al.  Organizing conceptual knowledge in humans with a gridlike code , 2016, Science.

[9]  Andrew M. Wikenheiser,et al.  Over the river, through the woods: cognitive maps in the hippocampus and orbitofrontal cortex , 2016, Nature Reviews Neuroscience.

[10]  Arne D. Ekstrom,et al.  Cellular networks underlying human spatial navigation , 2003, Nature.

[11]  Troy A. Smith,et al.  Human hippocampus represents space and time during retrieval of real-world memories , 2015, Proceedings of the National Academy of Sciences.

[12]  Russell A. Epstein,et al.  The cognitive map in humans: spatial navigation and beyond , 2017, Nature Neuroscience.

[13]  D. Amaral,et al.  Entorhinal Cortex Lesions Disrupt the Relational Organization of Memory in Monkeys , 2004, The Journal of Neuroscience.

[14]  J. S. Guntupalli,et al.  The Representation of Biological Classes in the Human Brain , 2012, The Journal of Neuroscience.

[15]  Russell A. Epstein,et al.  Anchoring the neural compass: Coding of local spatial reference frames in human medial parietal lobe , 2014, Nature Neuroscience.

[16]  Emilio Kropff,et al.  Place cells, grid cells, and the brain's spatial representation system. , 2008, Annual review of neuroscience.

[17]  Marco Buiatti,et al.  Conceptual and Perceptual Dimensions of Word Meaning Are Recovered Rapidly and in Parallel during Reading , 2019, Journal of Cognitive Neuroscience.

[18]  Alexis Amadon,et al.  Word meaning in the ventral visual path: a perceptual to conceptual gradient of semantic coding , 2016, NeuroImage.

[19]  Joseph W. Kable,et al.  Subjective value, not a gridlike code, describes neural activity in ventromedial prefrontal cortex during value-based decision-making , 2019, NeuroImage.

[20]  N. Foo Conceptual Spaces—The Geometry of Thought , 2022 .

[21]  C. Ranganath,et al.  Functional subregions of the human entorhinal cortex , 2015, eLife.

[22]  Zeb Kurth-Nelson,et al.  What Is a Cognitive Map? Organizing Knowledge for Flexible Behavior , 2018, Neuron.

[23]  Nikolaus Kriegeskorte,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .

[24]  Michael C. Corballis,et al.  Space, time, and language , 2018, Cognitive Processing.

[25]  Thomas T. Hills,et al.  Foraging in Mind , 2020, Current Directions in Psychological Science.

[26]  T. Rogers,et al.  Where do you know what you know? The representation of semantic knowledge in the human brain , 2007, Nature Reviews Neuroscience.

[27]  E. Tolman Cognitive maps in rats and men. , 1948, Psychological review.

[28]  R. Shepard Attention and the metric structure of the stimulus space. , 1964 .

[29]  S. Thompson-Schill,et al.  The evocative power of words: activation of concepts by verbal and nonverbal means. , 2012, Journal of experimental psychology. General.

[30]  M. Piazza,et al.  The neuro-cognitive representations of symbols: the case of concrete words , 2017, Neuropsychologia.

[31]  Tobias Navarro Schröder,et al.  Grid-cell representations in mental simulation , 2016, eLife.

[32]  Peter Gärdenfors,et al.  Navigating cognition: Spatial codes for human thinking , 2018, Science.

[33]  Neil Burgess,et al.  Using Grid Cells for Navigation , 2015, Neuron.

[34]  Christian F. Doeller,et al.  Evidence for grid cells in a human memory network , 2010, Nature.

[35]  Russell A. Epstein,et al.  Human entorhinal cortex represents visual space using a boundary-anchored grid , 2017, Nature Neuroscience.

[36]  Xiaojun Bao,et al.  Grid-like Neural Representations Support Olfactory Navigation of a Two-Dimensional Odor Space , 2019, Neuron.

[37]  G. Schoenbaum,et al.  What the orbitofrontal cortex does not do , 2015, Nature Neuroscience.

[38]  Michael N. Jones,et al.  Foraging in Semantic Fields: How We Search Through Memory , 2015, Top. Cogn. Sci..

[39]  Nicolas W. Schuck,et al.  Human Orbitofrontal Cortex Represents a Cognitive Map of State Space , 2016, Neuron.

[40]  Paul J. Laurienti,et al.  An automated method for neuroanatomic and cytoarchitectonic atlas-based interrogation of fMRI data sets , 2003, NeuroImage.

[41]  M. Kiefer,et al.  The Sound of Concepts: Four Markers for a Link between Auditory and Conceptual Brain Systems , 2008, The Journal of Neuroscience.

[42]  R. Shepard The analysis of proximities: Multidimensional scaling with an unknown distance function. II , 1962 .

[43]  Morgan D Barense,et al.  Integrative and distinctive coding of visual and conceptual object features in the ventral visual stream , 2018, eLife.

[44]  G. Lupyan From chair to "chair": a representational shift account of object labeling effects on memory. , 2008, Journal of experimental psychology. General.

[45]  G. Lupyan,et al.  What makes words special? Words as unmotivated cues , 2015, Cognition.

[46]  Christian F. Doeller,et al.  Knowledge Across Reference Frames: Cognitive Maps and Image Spaces , 2020, Trends in Cognitive Sciences.

[47]  D. Amaral,et al.  The entorhinal cortex of the monkey: III. Subcortical afferents , 1987, The Journal of comparative neurology.

[48]  Tobias Navarro Schröder,et al.  Hexadirectional coding of visual space in human entorhinal cortex , 2018, Nature Neuroscience.

[49]  T. Hafting,et al.  Microstructure of a spatial map in the entorhinal cortex , 2005, Nature.

[50]  Manuela Piazza,et al.  Processing number and length in the parietal cortex: Sharing resources, not a common code , 2019, Cortex.

[51]  Manuela Piazza,et al.  Distance and Direction Codes Underlie Navigation of a Novel Semantic Space in the Human Brain , 2020, The Journal of Neuroscience.

[52]  I. Fried,et al.  Direct recordings of grid-like neuronal activity in human spatial navigation , 2013, Nature Neuroscience.