When do language comprehenders mentally simulate locations?

Abstract Embodied approaches to comprehension propose that understanding language entails performing mental simulations of its content. The evidence, however, is mixed. Action-sentence Compatibility Effect studies (Glenberg and Kaschak 2002) report mental simulation of motor actions during processing of motion language. But the same studies find no evidence that language comprehenders perform spatial simulations of the corresponding locations. This challenges simulation-based approaches. If locations are not represented in simulation, but are still understood, then simulation may be unnecessary for understanding. We conducted a Location-sentence Compatibility experiment, to determine whether understanders mentally simulate locations. People did indeed simulate locations, but only when sentences used progressive (and not perfect) grammatical aspect. Moreover, mental simulations of locations differed for language about concrete versus abstract events. These findings substantiate the role of mental simulation in language understanding, while highlighting the importance of the grammatical form of utterances as well as their content.

[1]  Jerome A. Feldman,et al.  Embodied Verbal Semantics: Evidence from an Image-Verb Matching Task , 2003 .

[2]  Benjamin K. Bergen,et al.  Embodied Construction Grammar in Simulation-Based Language Understanding , 2003 .

[3]  Tad T. Brunyé,et al.  When You and I Share Perspectives , 2009, Psychological science.

[4]  N Carriedo,et al.  The role of verb tense and verb aspect in the foregrounding of information during reading , 1997, Memory & cognition.

[5]  Teenie Matlock,et al.  The Role of Grammatical Aspect in the Dynamics of Spatial Descriptions , 2010, Spatial Cognition.

[6]  Ronald W. Langacker,et al.  Remarks on English Aspect , 1982 .

[7]  George S. Cree,et al.  Evocation of functional and volumetric gestural knowledge by objects and words , 2008, Cognition.

[8]  Rolf A. Zwaan,et al.  PSYCHOLOGICAL SCIENCE Research Article THE EFFECT OF IMPLIED ORIENTATION DERIVED FROM VERBAL CONTEXT ON PICTURE RECOGNITION , 2022 .

[9]  Marta Kutas,et al.  Verb aspect and the activation of event knowledge. , 2007, Journal of experimental psychology. Learning, memory, and cognition.

[10]  Rolf A. Zwaan,et al.  How does verb aspect constrain event representations? , 2003, Memory & cognition.

[11]  Rolf A. Zwaan,et al.  Motor Resonance and Linguistic Focus , 2008, Quarterly journal of experimental psychology.

[12]  L. Barsalou,et al.  Perceptual simulation in property verification , 2004, Memory & cognition.

[13]  J. Feldman,et al.  Embodied meaning in a neural theory of language , 2004, Brain and Language.

[14]  Daniel C. Richardson,et al.  Spatial representations activated during real-time comprehension of verbs , 2003, Cogn. Sci..

[15]  L. Connell Representing object colour in language comprehension , 2007, Cognition.

[16]  L. Barsalou,et al.  Verifying Different-Modality Properties for Concepts Produces Switching Costs , 2003, Psychological science.

[17]  Rolf A. Zwaan,et al.  Language Comprehenders Mentally Represent the Shapes of Objects , 2002, Psychological science.

[18]  Franziska Frankfurter,et al.  Constructions: A construction grammar approach to argument structure: Adele E. Goldberg, Chicago, IL: The University of Chicago Press, 1995. xi + 265 pp , 1998 .

[19]  Teenie Matlock,et al.  The integration of figurative language and static depictions: An eye movement study of fictive motion , 2007, Cognition.

[20]  Teenie Matlock,et al.  The conceptual motivation of aspect , 2011 .

[21]  Michael P. Kaschak,et al.  Perception of motion affects language processing , 2005, Cognition.

[22]  Diane Pecher,et al.  Verifying Properties from Different Modalities for Concepts Produces Switching Costs , 2002 .

[23]  Joseph P. Magliano,et al.  Verb Aspect and Situation Models , 2000 .

[24]  Michael P. Kaschak,et al.  Grounding language in action , 2002, Psychonomic bulletin & review.

[25]  J. M. Peirce Aspect , 1871, Nature.

[26]  Mike Rinck,et al.  Episodic affordances contribute to language comprehension , 2009, Language and Cognition.

[27]  David J. Therriault,et al.  Short article: Verb aspect and perceptual simulations , 2009, Quarterly journal of experimental psychology.

[28]  S. Kosslyn,et al.  Neural foundations of imagery , 2001, Nature Reviews Neuroscience.

[29]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[30]  J. Fodor,et al.  The Modularity of Mind: An Essay on Faculty Psychology , 1984 .

[31]  Jeffrey M. Zacks,et al.  Event structure in perception and conception. , 2001, Psychological bulletin.

[32]  B. Bergen,et al.  Grammatical aspect and mental simulation , 2010, Brain and Language.

[33]  David R. Dowty Toward a semantic analysis of verb aspect and the English ‘imperfective’ progressive , 1977 .

[34]  G. Lakoff,et al.  Metaphors We Live by , 1981 .

[35]  Arthur M. Glenberg,et al.  The Motor System Contributes to Comprehension of Abstract Language , 2013, PloS one.

[36]  Rolf A. Zwaan Embodied cognition, perceptual symbols, and situation models , 1999 .

[37]  Srini Narayanan,et al.  Spatial and Linguistic Aspects of Visual Imagery in Sentence Comprehension , 2007, Cogn. Sci..

[38]  G. Lakoff,et al.  The Brain's concepts: the role of the Sensory-motor system in conceptual knowledge , 2005, Cognitive neuropsychology.

[39]  B. Bergen Experimental methods for simulation semantics , 2007 .

[40]  L. Barsalou,et al.  Situating Abstract Concepts , 2004 .

[41]  J. Fodor The Modularity of mind. An essay on faculty psychology , 1986 .

[42]  Daniel N. Bub,et al.  Language-Based Access to Gestural Components of Conceptual Knowledge , 2008, Quarterly journal of experimental psychology.

[43]  Benjamin K. Bergen,et al.  Sentence Understanding Engages Motor Processes , 2005 .

[44]  S. Petersen,et al.  Memory's echo: vivid remembering reactivates sensory-specific cortex. , 2000, Proceedings of the National Academy of Sciences of the United States of America.