Individual differences in spatial cognition influence mental simulation of language

The factors that contribute to perceptual simulation during sentence comprehension remain underexplored. Extant research on perspective taking in language has largely focused on linguistic constraints, such as the role of pronouns in guiding perspective adoption. In the present study, we identify preferential usage of egocentric and allocentric reference frames in individuals, and test the two groups on a standard sentence-picture verification task. Across three experiments, we show that individual biases in spatial reference frame adoption observed in non-linguistic tasks influence visual simulation of perspective in language. Our findings suggest that typically reported grand-averaged effects may obscure important between-subject differences, and support proposals arguing for representational pluralism, where perceptual information is integrated dynamically and in a way that is sensitive to contextual and especially individual constraints.

[1]  Timothy P. McNamara,et al.  Systems of Spatial Reference in Human Memory , 2001, Cognitive Psychology.

[2]  M. Petrides,et al.  Cognitive Strategies Dependent on the Hippocampus and Caudate Nucleus in Human Navigation: Variability and Change with Practice , 2003, The Journal of Neuroscience.

[3]  Cosimo Urgesi,et al.  Vicarious motor activation during action perception: beyond correlational evidence , 2013, Front. Hum. Neurosci..

[4]  Tad T. Brunyé,et al.  When You and I Share Perspectives , 2009, Psychological science.

[5]  Jonathan R. Whitlock,et al.  Navigating from hippocampus to parietal cortex , 2008, Proceedings of the National Academy of Sciences.

[6]  Barbara Tversky,et al.  11 Mental models of spatial relations and transformations from language , 1999 .

[7]  G. Rizzolatti,et al.  Premotor cortex and the recognition of motor actions. , 1996, Brain research. Cognitive brain research.

[8]  B. Schönebeck,et al.  The neural basis of ego- and allocentric reference frames in spatial navigation: Evidence from spatio-temporal coupled current density reconstruction , 2006, Brain Research.

[9]  D R Proffitt,et al.  Updating displays after imagined object and viewer rotations. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[10]  William H. Warren,et al.  Chapter 8 – Self-Motion: Visual Perception and Visual Control , 1995 .

[11]  Peter König,et al.  Different strategies for spatial updating in yaw and pitch path integration , 2013, Front. Behav. Neurosci..

[12]  Michael P. Kaschak,et al.  Perception of motion affects language processing , 2005, Cognition.

[13]  William S Horton,et al.  Out of sight, out of mind: Occlusion and the accessibility of information in narrative comprehension , 2003, Psychonomic bulletin & review.

[14]  B. Bahrami,et al.  Coming of age: A review of embodiment and the neuroscience of semantics , 2012, Cortex.

[15]  Michael P. Kaschak,et al.  Grounding language in action , 2002, Psychonomic bulletin & review.

[16]  J. Decety,et al.  Effect of subjective perspective taking during simulation of action: a PET investigation of agency , 2001, Nature Neuroscience.

[17]  Diniz Lopes,et al.  ScriptingRT: A Software Library for Collecting Response Latencies in Online Studies of Cognition , 2013, PloS one.

[18]  Marc Jeannerod,et al.  The Agent is Right: When Motor Embodied Cognition is Space-Dependent , 2011, PloS one.

[19]  Guy Dove.  Beyond perceptual symbols: A call for representational pluralism , 2009, Cognition.

[20]  Barbara Tversky,et al.  Mental spatial transformations of objects and perspective , 2001, Spatial Cogn. Comput..

[21]  Y. Shtyrov,et al.  Automatic ultrarapid activation and inhibition of cortical motor systems in spoken word comprehension , 2014, Proceedings of the National Academy of Sciences.

[22]  Neil Stewart,et al.  Adobe Flash as a medium for online experimentation: A test of reaction time measurement capabilities , 2007, Behavior research methods.

[23]  Roel M. Willems,et al.  Body-specific representations of action verbs: Neural evidence from right- and left-handers , 2009, NeuroImage.

[24]  F. Vignemont,et al.  Habeas Corpus: The Sense of Ownership of One ' s Own Body , 2007 .

[25]  Friedemann Pulvermüller,et al.  When do you grasp the idea? MEG evidence for instantaneous idiom understanding , 2012, NeuroImage.

[26]  T. Matlock.  Fictive motion as cognitive simulation , 2004, Memory & cognition.

[27]  Lawrence W. Barsalou,et al.  Grounded Cognition: Past, Present, and Future , 2010, Top. Cogn. Sci..

[28]  M. Petrides,et al.  Retrosplenial and hippocampal brain regions in human navigation: complementary functional contributions to the formation and use of cognitive maps , 2007, The European journal of neuroscience.

[29]  Roberta L. Klatzky,et al.  Allocentric and Egocentric Spatial Representations: Definitions, Distinctions, and Interconnections , 1998, Spatial Cognition.

[30]  Rolf A. Zwaan,et al.  PSYCHOLOGICAL SCIENCE Research Article THE EFFECT OF IMPLIED ORIENTATION DERIVED FROM VERBAL CONTEXT ON PICTURE RECOGNITION , 2022 .

[31]  Hermann J Müller,et al.  Evidence of separable spatial representations in a virtual navigation task. , 2005, Journal of experimental psychology. Human perception and performance.

[32]  B. Schönebeck,et al.  Die Tunnelaufgabe: Eine Methode zur Untersuchung kognitiver Teilprozesse räumlicher Orientierungsleistungen , 2001 .

[33]  Nicole Etchamendy,et al.  Spontaneous navigational strategies and performance in the virtual town , 2007, Hippocampus.

[34]  B. Bergen,et al.  The case of the missing pronouns: Does mentally simulated perspective play a functional role in the comprehension of person? , 2013, Cognition.

[35]  Claudia Gianelli,et al.  Acting in perspective: the role of body and language as social tools , 2013, Psychological research.

[36]  Christian Büchel,et al.  Neural foundations of emerging route knowledge in complex spatial environments. , 2004, Brain research. Cognitive brain research.

[37]  C. Büchel,et al.  Differential Recruitment of the Hippocampus, Medial Prefrontal Cortex, and the Human Motion Complex during Path Integration in Humans , 2007, The Journal of Neuroscience.

[38]  Giuseppe Iaria,et al.  Gray Matter Differences Correlate with Spontaneous Strategies in a Human Virtual Navigation Task , 2007, The Journal of Neuroscience.

[39]  Martin J. Pickering,et al.  Perspective taking in language: integrating the spatial and action domains , 2013, Front. Hum. Neurosci..

[40]  Ludovica Labruna,et al.  A Functional Role for the Motor System in Language Understanding , 2011, Psychological science.

[41]  Weimin Mou,et al.  Allocentric and egocentric updating of spatial memories. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[42]  Hermann J. Müller,et al.  Human Brain Dynamics Accompanying Use of Egocentric and Allocentric Reference Frames during Navigation , 2010, Journal of Cognitive Neuroscience.

[43]  Vittorio Gallese,et al.  Listening to Action-related Sentences Activates Fronto-parietal Motor Circuits , 2005, Journal of Cognitive Neuroscience.

[44]  William H Warren,et al.  Path Integration from Optic Flow and Body Senses in a Homing Task , 2002, Perception.

[45]  Bradford Z. Mahon,et al.  A critical look at the embodied cognition hypothesis and a new proposal for grounding conceptual content , 2008, Journal of Physiology-Paris.

[46]  C. Lawton.  STRATEGIES FOR INDOOR WAYFINDING: THE ROLE OF ORIENTATION , 1996 .

[47]  Friedemann Pulvermüller,et al.  Meaning and the brain: The neurosemantics of referential, interactive, and combinatorial knowledge , 2012, Journal of Neurolinguistics.

[48]  Friedemann Pulvermüller,et al.  Brain Signatures of Meaning Access in Action Word Recognition , 2005, Journal of Cognitive Neuroscience.

[49]  Klaus Gramann,et al.  Spatial Cognition & Computation: an Interdisciplinary Journal Embodiment of Spatial Reference Frames and Individual Differences in Reference Frame Proclivity Embodiment of Spatial Reference Frames and Individual Differences in Reference Frame Proclivity , 2022 .

[50]  Automatic perceptual simulation of first language meanings during second language sentence processing in bilinguals. , 2014, Acta psychologica.

[51]  A. Wunderlich,et al.  Brain activation during human navigation: gender-different neural networks as substrate of performance , 2000, Nature Neuroscience.

[52]  C. Lawton.  Gender differences in way-finding strategies: Relationship to spatial ability and spatial anxiety , 1994 .

[53]  G Debus,et al.  [The "tunnel task": a method for examination of cognitive processes in spatial orientation performance]. , 2001, Zeitschrift fur experimentelle Psychologie : Organ der Deutschen Gesellschaft fur Psychologie.

[54]  S. Huettel,et al.  Males and females use different distal cues in a virtual environment navigation task. , 1998, Brain research. Cognitive brain research.

[55]  F. Pulvermüller,et al.  Grasping Ideas with the Motor System: Semantic Somatotopy in Idiom Comprehension , 2009 .

[56]  Rolf A. Zwaan,et al.  Language Comprehenders Mentally Represent the Shapes of Objects , 2002, Psychological science.

[57]  G. Rizzolatti,et al.  The Dynamics of Sensorimotor Cortical Oscillations during the Observation of Hand Movements: An EEG Study , 2012, PloS one.

[58]  B. Tversky,et al.  Perspective in Spatial Descriptions , 1996 .