Situation models, mental simulations, and abstract concepts in discourse comprehension

This article sets out to examine the role of symbolic and sensorimotor representations in discourse comprehension. It starts out with a review of the literature on situation models, showing how mental representations are constrained by linguistic and situational factors. These ideas are then extended to more explicitly include sensorimotor representations. Following Zwaan and Madden (2005), the author argues that sensorimotor and symbolic representations mutually constrain each other in discourse comprehension. These ideas are then developed further to propose two roles for abstract concepts in discourse comprehension. It is argued that they serve as pointers in memory, used (1) cataphorically to integrate upcoming information into a sensorimotor simulation, or (2) anaphorically integrate previously presented information into a sensorimotor simulation. In either case, the sensorimotor representation is a specific instantiation of the abstract concept.

[1]  W. Kintsch The role of knowledge in discourse comprehension: a construction-integration model. , 1988, Psychological review.

[2]  Max M. Louwerse,et al.  Symbol Interdependency in Symbolic and Embodied Cognition , 2011, Top. Cogn. Sci..

[3]  Lawrence W. Barsalou,et al.  Are Automatic Conceptual Cores the Gold Standard of Semantic Processing? The Context-Dependence of Spatial Meaning in Grounded Congruency Effects , 2015, Cogn. Sci..

[4]  L. Barsalou,et al.  Situating Abstract Concepts , 2004 .

[5]  Stevan Harnad,et al.  Symbol grounding problem , 1990, Scholarpedia.

[6]  Rolf A. Zwaan,et al.  PSYCHOLOGICAL SCIENCE Research Article THE EFFECT OF IMPLIED ORIENTATION DERIVED FROM VERBAL CONTEXT ON PICTURE RECOGNITION , 2022 .

[7]  Rolf A. Zwaan,et al.  Language Comprehenders Mentally Represent the Shapes of Objects , 2002, Psychological science.

[8]  G. Bower,et al.  Mental models in narrative comprehension. , 1990, Science.

[9]  Bradford Z. Mahon,et al.  What is embodied about cognition? , 2015, Language, cognition and neuroscience.

[10]  Yisheng Xu,et al.  Personal experience with narrated events modulates functional connectivity within visual and motor systems during story comprehension , 2015, Human brain mapping.

[11]  Rolf A. Zwaan,et al.  Revisiting Mental Simulation in Language Comprehension: Six Replication Attempts , 2012, PloS one.

[12]  Gabriella Vigliocco,et al.  Reconciling Embodied and Distributional Accounts of Meaning in Language , 2014, Top. Cogn. Sci..

[13]  F. Pulvermüller,et al.  Grasping Ideas with the Motor System: Semantic Somatotopy in Idiom Comprehension , 2009 .

[14]  Rolf A. Zwaan,et al.  Discourse comprehension. , 1997, Annual review of psychology.

[15]  J. Bransford,et al.  Sentence memory: A constructive versus interpretive approach ☆ ☆☆ , 1972 .

[16]  Rolf A. Zwaan Experiential traces and mental simulations in language comprehension , 2008 .

[17]  Julie C. Sedivy,et al.  Subject Terms: Linguistics Language Eyes & eyesight Cognition & reasoning , 1995 .

[18]  Guy Dove On the need for Embodied and Dis-Embodied Cognition , 2011, Front. Psychology.

[19]  S. Swinnen,et al.  Topological correlations of structural and functional networks in patients with traumatic brain injury , 2013, Front. Hum. Neurosci..

[20]  B. Bahrami,et al.  Coming of age: A review of embodiment and the neuroscience of semantics , 2012, Cortex.

[21]  Rolf A. Zwaan Embodiment and language comprehension: reframing the discussion , 2014, Trends in Cognitive Sciences.

[22]  Rolf A. Zwaan,et al.  Constructing Multidimensional Situation Models During Reading , 1998 .

[23]  K. A. Ericsson,et al.  Long-term working memory. , 1995, Psychological review.

[24]  Lawrence W. Barsalou,et al.  Contextual Processing of Abstract Concepts Reveals Neural Representations of Nonlinguistic Semantic Content , 2013, Journal of Cognitive Neuroscience.

[25]  Lawrence W. Barsalou,et al.  Language and simulation in conceptual processing , 2008 .

[26]  Roel M. Willems,et al.  Simulating Fiction: Individual Differences in Literature Comprehension Revealed with fMRI , 2015, PloS one.

[27]  Roger M. Cooper,et al.  The control of eye fixation by the meaning of spoken language: A new methodology for the real-time investigation of speech perception, memory, and language processing. , 1974 .

[28]  P. Johnson-Laird,et al.  Mental Models: Towards a Cognitive Science of Language, Inference, and Consciousness , 1985 .

[29]  Gabriel Recchia,et al.  Effect size matters: the role of language statistics and perceptual simulation in conceptual processing , 2015 .

[30]  M. Tanenhaus,et al.  Actions and affordances in syntactic ambiguity resolution. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[31]  James Cutting,et al.  Re-Presentations of Space in Hollywood Movies: An Event-Indexing Analysis , 2015, Cogn. Sci..

[32]  A. Glenberg,et al.  Mental models contribute to foregrounding during text comprehension , 1987 .

[33]  Rolf A. Zwaan,et al.  The Construction of Situation Models in Narrative Comprehension: An Event-Indexing Model , 1995 .

[34]  Jeffrey M. Zacks,et al.  The activation of modality-specific representations during discourse processing , 2013, Brain and Language.

[35]  Walter Kintsch,et al.  Comprehension: A Paradigm for Cognition , 1998 .

[36]  Mike Rinck,et al.  Assessing the influence of dimensional focus during situation model construction , 2006, Memory & cognition.

[37]  Rolf A. Zwaan The Immersed Experiencer: Toward An Embodied Theory Of Language Comprehension , 2003 .

[38]  W. Kintsch,et al.  Strategies of discourse comprehension , 1983 .

[39]  Rolf A. Zwaan,et al.  Grounding Cognition: Introduction to Grounding Cognition: The Role of Perception and Action in Memory, Language, and Thinking , 2005 .

[40]  E. Maguire,et al.  The functional neuroanatomy of comprehension and memory: the importance of prior knowledge. , 1999, Brain : a journal of neurology.

[41]  R. Paget The Origin of Speech , 1927, Nature.

[42]  Arthur C. Graesser,et al.  Dimensions of situation model construction in narrative comprehension. , 1995 .

[43]  M. Gernsbacher,et al.  The cataphoric use of the indefinite this in spoken narratives , 1989, Memory & cognition.

[44]  L. Tyler,et al.  Modulation of motor and premotor cortices by actions, action words and action sentences , 2009, Neuropsychologia.

[45]  E. Shoben,et al.  Differential Context Effects in the Comprehension of Abstract and Concrete Verbal Materials , 1983 .

[46]  Jeffrey M. Zacks,et al.  The Brain's Cutting-Room Floor: Segmentation of Narrative Cinema , 2010, Front. Hum. Neurosci..

[47]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[48]  Rolf A. Zwaan,et al.  Sentential Context Modulates the Involvement of the Motor Cortex in Action Language Processing: An fMRI Study , 2013, Front. Hum. Neurosci..

[49]  Rolf A. Zwaan,et al.  Action in cognition: The case of language , 2009, Language and Cognition.

[50]  Rolf A. Zwaan,et al.  Indexing space and time in film understanding , 2001 .

[51]  G. Vigliocco,et al.  The representation of abstract words: why emotion matters. , 2011, Journal of experimental psychology. General.

[52]  Walter Kintsch,et al.  Toward a model of text comprehension and production. , 1978 .

[53]  Rolf A. Zwaan,et al.  Embodied Sentence Comprehension , 2005 .

[54]  Jeffrey R. Binder,et al.  The Neural Career of Sensory-motor Metaphors , 2011, Journal of Cognitive Neuroscience.

[55]  M. Kutas,et al.  Semantic integration in reading: engagement of the right hemisphere during discourse processing. , 1999, Brain : a journal of neurology.

[56]  P. Schwanenflugel Why are Abstract Concepts Hard to Understand , 2013 .