Quick Linguistic Representations and Precise Perceptual Representations: Language Statistics and Perceptual Simulations under Time Constraints

Many studies have argued that language comprehension requires perceptual simulation. In previous work we have demonstrated that because language encodes perceptual relations, comprehenders can also rely on language statistics to bootstrap meaning through limited grounding. The extent comprehenders do this depends on the nature of the cognitive task, the stimulus, the individual, as well as the speed of processing, with linguistic representations preceding perceptual simulation. In the current study we report results that investigated whether time constraints impacted the use of perceptual and linguistic factors during language processing. Participants made fast or slow speeded judgments about whether pairs of words were semantically related. Subjects were also instructed to either respond as quickly as possible to the words they were presented, or respond as accurately as possible. The perceptual factor was operationalized as an iconicity rating of the stimulus pairs occurring in a particular orientation in the real world and the linguistic factor was operationalized as the frequency of the stimulus pairs in language. The linguistic factor best explained the RTs when subjects had to respond quickly. On the other hand, when given more time to respond, both linguistic and perceptual factors explained response times. These findings support the view that language processing is both linguistic and embodied, with linguistic representations being relevant for quick good-enough representations and perceptual simulations being important for more precise information.

[1]  Eliot R. Smith,et al.  Embodied Grounding: Social, Cognitive, Affective, and Neuroscientific Approaches , 2008 .

[2]  K. Fernow New York , 1896, American Potato Journal.

[3]  Michael P. Kaschak,et al.  Grounding language in action , 2002, Psychonomic bulletin & review.

[4]  Patrick Jeuniaux,et al.  Language comprehension is both embodied and symbolic , 2008 .

[5]  Rolf A. Zwaan,et al.  Grounding Cognition: Introduction to Grounding Cognition: The Role of Perception and Action in Memory, Language, and Thinking , 2005 .

[6]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[7]  M. Louwerse A Case for Symbol Interdependency 1 Symbolic or Embodied representations : A Case for Symbol Interdependency , 2008 .

[8]  T. Landauer,et al.  A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. , 1997 .

[9]  M. Louwerse Embodied relations are encoded in language , 2008, Psychonomic bulletin & review.

[10]  Mia Setic,et al.  The influence of vertical spatial orientation on property verification , 2007 .

[11]  Max M. Louwerse,et al.  A Taste of Words: Linguistic Context and Perceptual Simulation Predict the Modality of Words , 2011, Cogn. Sci..

[12]  Rolf A. Zwaan,et al.  Language Comprehenders Mentally Represent the Shapes of Objects , 2002, Psychological science.

[13]  Zenon W. Pylyshyn,et al.  Computation and Cognition: Toward a Foundation for Cognitive Science , 1984 .

[14]  Rolf A. Zwaan,et al.  Spatial iconicity affects semantic relatedness judgments , 2003, Psychonomic bulletin & review.

[15]  Rolf A. Zwaan,et al.  PSYCHOLOGICAL SCIENCE Research Article THE EFFECT OF IMPLIED ORIENTATION DERIVED FROM VERBAL CONTEXT ON PICTURE RECOGNITION , 2022 .

[16]  L. Barsalou Grounded cognition. , 2008, Annual review of psychology.

[17]  M. Louwerse,et al.  The linguistic and embodied nature of conceptual processing , 2010, Cognition.

[18]  Alex M. Andrew,et al.  Computation and Cognition: Towards A Foundation for Cognitive Science, by Zenon W. Pylyshyn, MIT Press, Cambridge, Mass., xxiii + 292 pp., £26.15 , 1985, Robotica.

[19]  Danielle S. McNamara,et al.  Handbook of latent semantic analysis , 2007 .

[20]  Rolf A. Zwaan,et al.  Short article: Language comprehenders retain implied shape and orientation of objects , 2009, Quarterly journal of experimental psychology.

[21]  Stanley B Klein,et al.  What memory is. , 2015, Wiley interdisciplinary reviews. Cognitive science.

[22]  D. McDermott LANGUAGE OF THOUGHT , 2012 .

[23]  R. Baayen,et al.  Mixed-effects modeling with crossed random effects for subjects and items , 2008 .

[24]  M. Louwerse,et al.  Neurological Evidence Linguistic Processes Precede Perceptual Simulation in Conceptual Processing , 2012, Front. Psychology.

[25]  Max M. Louwerse,et al.  Symbol Interdependency in Symbolic and Embodied Cognition , 2011, Top. Cogn. Sci..