Moving words: dynamic representations in language comprehension

Eighty-two participants listened to sentences and then judged whether two sequentially presented visual objects were the same. On critical trials, participants heard a sentence describe the motion of a ball toward or away from the observer (e.g., “The pitcher hurled the softball to you”). Seven hundred and fifty milliseconds after the offset of the sentence, a picture of an object was presented for 500 ms, followed by another picture. On critical trials, the two pictures depicted the kind of ball mentioned in the sentence. The second picture was displayed 175 ms after the first. Crucially, it was either slightly larger or smaller than the first picture, thus suggesting movement of the ball toward or away from the observer. Participants responded more quickly when the implied movement of the balls matched the movement described in the sentence. This result provides support for the view that language comprehension involves dynamic perceptual simulations. © 2004 Cognitive Science Society, Inc. All rights reserved.

[1]  Rolf A. Zwaan,et al.  Language Comprehenders Mentally Represent the Shapes of Objects , 2002, Psychological science.

[2]  R. Shepard,et al.  Mental Rotation of Three-Dimensional Objects , 1971, Science.

[3]  A. Glenberg,et al.  What memory is for: Creating meaning in the service of action , 1997, Behavioral and Brain Sciences.

[4]  C. Reed,et al.  Conceptual effects on representational momentum. , 1996, Journal of experimental psychology. Human perception and performance.

[5]  J. Bharucha,et al.  Judged displacement in apparent vertical and horizontal motion , 1988, Perception & psychophysics.

[6]  N. Kanwisher,et al.  Activation in Human MT/MST by Static Images with Implied Motion , 2000, Journal of Cognitive Neuroscience.

[7]  J. Freyd,et al.  A velocity effect for representational momentum , 1985 .

[8]  Rolf A. Zwaan,et al.  Spatial iconicity affects semantic relatedness judgments , 2003, Psychonomic bulletin & review.

[9]  Rolf A. Zwaan,et al.  The Effect of Implied Orientation Derived from Verbal Context on Picture Recognition , 2001, Psychological science.

[10]  Daniel C. Richardson,et al.  Spatial representations activated during real-time comprehension of verbs , 2003, Cogn. Sci..

[11]  Rolf A. Zwaan,et al.  Hemispheric differences in semantic-relatedness judgments , 2003, Cognition.

[12]  Ian M. Thornton,et al.  Representational momentum: New findings, new directions , 2002 .

[13]  H. Bülthoff,et al.  Learning to recognize objects , 1999, Trends in Cognitive Sciences.

[14]  E. Loftus,et al.  Reconstruction of automobile destruction: An example of the interaction between language and memory , 1974 .

[15]  A Pollatsek,et al.  On the use of counterbalanced designs in cognitive research: a suggestion for a better and more powerful analysis. , 1995, Journal of experimental psychology. Learning, memory, and cognition.

[16]  Zenon W. Pylyshyn,et al.  Computation and Cognition: Toward a Foundation for Cognitive Science , 1984 .

[17]  Rolf A. Zwaan The Immersed Experiencer: Toward An Embodied Theory Of Language Comprehension , 2003 .

[18]  Michael J. Spivey,et al.  Oculomotor mechanisms activated by imagery and memory: eye movements to absent objects , 2001, Psychological research.

[19]  Diane Pecher,et al.  Verifying Properties from Different Modalities for Concepts Produces Switching Costs , 2002 .

[20]  Narendra Ahuja,et al.  Learning to recognize objects , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[21]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[22]  J. Freyd Dynamic mental representations. , 1987, Psychological review.

[23]  Norman G. Vinson,et al.  Sources of object-specific effects in representational momentum , 2002 .