Language and vertical space: On the automaticity of language action interconnections

Grounded models of language processing propose a strong connection between language and sensorimotor processes (Barsalou, 1999, 2008; Glenberg & Kaschak, 2002). However, it remains unclear how functional and automatic these connections are for understanding diverse sets of words (Ansorge, Kiefer, Khalid, Grassl, & König, 2010). Here, we investigate whether words referring to entities with a typical location in the upper or lower visual field (e.g., sun, ground) automatically influence subsequent motor responses even when language-processing levels are kept minimal. The results show that even subliminally presented words influence subsequent actions, as can be seen in a reversed compatibility effect. These finding have several implications for grounded language processing models. Specifically, these results suggest that language-action interconnections are not only the result of strategic language processes, but already play an important role during pre-attentional language processing stages.

[1]  Amy Needham,et al.  Intuitions about support in 4.5-month-old infants , 1993, Cognition.

[2]  S. Dehaene,et al.  A direct intracranial record of emotions evoked by subliminal words. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[3]  Barbara Kaup,et al.  Reading “Sun” and Looking Up: The Influence of Language on Saccadic Eye Movements in the Vertical Dimension , 2013, PloS one.

[4]  Rolf A. Zwaan,et al.  Seeing, acting, understanding: motor resonance in language comprehension. , 2006, Journal of experimental psychology. General.

[5]  Barbara Kaup,et al.  When up-words meet down-sentences: evidence for word- or sentence-based compatibility effects? , 2012, Cognitive Processing.

[6]  D. Lakens High Skies and Oceans Deep: Polarity Benefits or Mental Simulation? , 2011, Front. Psychology.

[7]  Srini Narayanan,et al.  Spatial and Linguistic Aspects of Visual Imagery in Sentence Comprehension , 2007, Cogn. Sci..

[8]  J. Hoffmann,et al.  Conscious control over the content of unconscious cognition , 2003, Cognition.

[9]  Jijia Zhang,et al.  Neural mechanisms of shifts of spatial attention induced by object words with spatial associations: an ERP study , 2013, Experimental Brain Research.

[10]  M. Hautus Corrections for extreme proportions and their biasing effects on estimated values ofd′ , 1995 .

[11]  I. Johnsrude,et al.  Somatotopic Representation of Action Words in Human Motor and Premotor Cortex , 2004, Neuron.

[12]  C. Eriksen,et al.  Pre- and poststimulus activation of response channels: a psychophysiological analysis. , 1988, Journal of experimental psychology. Human perception and performance.

[13]  Michael P. Kaschak,et al.  Putting words in perspective , 2004, Memory & cognition.

[14]  P. Haggard,et al.  Subliminal priming of actions influences sense of control over effects of action , 2010, Cognition.

[15]  E. Bernat,et al.  Event-related brain potentials differentiate positive and negative mood adjectives during both supraliminal and subliminal visual processing. , 2001, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[16]  M. Eimer Facilitatory and inhibitory effects of masked prime stimuli on motor activation and behavioural performance. , 1999, Acta psychologica.

[17]  Barbara Kaup,et al.  Embodiment and second-language: Automatic activation of motor responses during processing spatially associated L2 words and emotion L2 words in a vertical Stroop paradigm , 2014, Brain and Language.

[18]  Michael P. Kaschak,et al.  Grounding language in action , 2002, Psychonomic bulletin & review.

[19]  Marc Jeannerod,et al.  Cross-talk between Language Processes and Overt Motor Behavior in the First 200 msec of Processing , 2006, Journal of Cognitive Neuroscience.

[20]  Sean Duffy,et al.  Spatial Representations Elicit Dual-Coding Effects in Mental Imagery , 2009, Cogn. Sci..

[21]  Barbara Kaup,et al.  Do task-irrelevant direction-associated motion verbs affect action planning? Evidence from a Stroop paradigm , 2012, Memory & cognition.

[22]  C. Umilta,et al.  Simon effect with and without awareness of the accessory stimulus. , 2006, Journal of experimental psychology. Human perception and performance.

[23]  Stephanie Ortigue,et al.  The Neural Basis of Love as a Subliminal Prime: An Event-related Functional Magnetic Resonance Imaging Study , 2007, Journal of Cognitive Neuroscience.

[24]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[25]  B. Kaup,et al.  Root versus roof: automatic activation of location information during word processing , 2011, Psychonomic bulletin & review.

[26]  Rolf A. Zwaan,et al.  Embodied Language: A Review of the Role of the Motor System in Language Comprehension , 2008, Quarterly journal of experimental psychology.

[27]  George S. Cree,et al.  Evocation of functional and volumetric gestural knowledge by objects and words , 2008, Cognition.

[28]  N A Macmillan,et al.  Detection theory analysis of group data: estimating sensitivity from average hit and false-alarm rates. , 1985, Psychological bulletin.

[29]  E. Maylor,et al.  No difference between conscious and nonconscious visuomotor control: Evidence from perceptual learning in the masked prime task , 2008, Consciousness and Cognition.

[30]  Michael E R Nicholls,et al.  The highs and lows of the interaction between word meaning and space. , 2013, Journal of experimental psychology. Human perception and performance.

[31]  S. Dehaene,et al.  The priming method: imaging unconscious repetition priming reveals an abstract representation of number in the parietal lobes. , 2001, Cerebral cortex.

[32]  P. König,et al.  Space-Valence Priming with Subliminal and Supraliminal Words , 2013, Front. Psychology.

[33]  Rolf A. Zwaan,et al.  Motor Resonance and Linguistic Focus , 2008, Quarterly journal of experimental psychology.

[34]  S. Dehaene,et al.  Towards a cognitive neuroscience of consciousness: basic evidence and a workspace framework , 2001, Cognition.

[35]  A. Glenberg,et al.  Processing Abstract Language Modulates Motor System Activity , 2008, Quarterly journal of experimental psychology.

[36]  Denis G. Pelli,et al.  ECVP '07 Abstracts , 2007, Perception.

[37]  J. Pratt,et al.  Journal of Experimental Psychology: General The Cost and Benefit of Implicit Spatial Cues for Visual Attention , 2012 .

[38]  L. Vainio,et al.  Motor inhibition associated with the affordance of briefly displayed objects , 2011, Quarterly journal of experimental psychology.

[39]  D. Lakens Polarity correspondence in metaphor congruency effects: structural overlap predicts categorization times for bipolar concepts presented in vertical space. , 2012, Journal of experimental psychology. Learning, memory, and cognition.

[40]  L. Barsalou,et al.  Head Up, Foot Down , 2008, Psychological science.

[41]  Terhi Mustonen,et al.  Mapping the identity of a viewed hand in the motor system: evidence from stimulus-response compatibility. , 2011, Journal of experimental psychology. Human perception and performance.

[42]  Michael P. Kaschak,et al.  The Action-Sentence Compatibility Effect: It's All in the Timing , 2006, Cogn. Sci..

[43]  J B Poline,et al.  Cerebral mechanisms of word masking and unconscious repetition priming , 2001, Nature Neuroscience.

[44]  M. Coles Modern mind-brain reading: psychophysiology, physiology, and cognition. , 1989, Psychophysiology.

[45]  P. König,et al.  Testing the theory of embodied cognition with subliminal words , 2010, Cognition.

[46]  Rolf A. Zwaan,et al.  Embodied Sentence Comprehension , 2005 .

[47]  Friedemann Pulvermüller,et al.  Brain mechanisms linking language and action , 2005, Nature Reviews Neuroscience.

[48]  J. Stroop Studies of interference in serial verbal reactions. , 1992 .

[49]  A. Borghi,et al.  Sentence comprehension and action: Effector specific modulation of the motor system , 2007, Brain Research.

[50]  Derek Besner,et al.  The stroop effect and the myth of automaticity , 1997, Psychonomic bulletin & review.

[51]  M. Bowerman The origins of children's spatial semantic categories: Cognitive vs. linguistic determinants , 1996 .

[52]  Michele T. Diaz,et al.  Unconscious Word Processing Engages a Distributed Network of Brain Regions , 2007, Journal of Cognitive Neuroscience.

[53]  Yang Seok Cho,et al.  Polarity correspondence: A general principle for performance of speeded binary classification tasks. , 2006, Psychological bulletin.

[54]  W. Brewer,et al.  Mental models of the earth: A study of conceptual change in childhood , 1992, Cognitive Psychology.

[55]  S. Klapp,et al.  The negative compatibility effect: Unconscious inhibition influences reaction time and response selection , 2002 .

[56]  L. Mulder,et al.  Use of partial stimulus information in response processing. , 1988, Journal of experimental psychology. Human perception and performance.

[57]  A. Glenberg,et al.  Action-based language: A theory of language acquisition, comprehension, and production , 2012, Cortex.

[58]  S. Levinson Space in language and cognition: Explorations in cognitive diversity , 2003 .

[59]  M. Masson,et al.  Using confidence intervals in within-subject designs , 1994, Psychonomic bulletin & review.

[60]  M. Eimer,et al.  Effects of masked stimuli on motor activation: behavioral and electrophysiological evidence. , 1998, Journal of experimental psychology. Human perception and performance.

[61]  Mark Johnson,et al.  The Metaphorical Structure of the Human Conceptual System , 1980, Cogn. Sci..

[62]  Barbara Kaup,et al.  From top to bottom: spatial shifts of attention caused by linguistic stimuli , 2012, Cognitive Processing.

[63]  H. Kornhuber,et al.  Hirnpotentialänderungen bei Willkürbewegungen und passiven Bewegungen des Menschen: Bereitschaftspotential und reafferente Potentiale , 1965, Pflüger's Archiv für die gesamte Physiologie des Menschen und der Tiere.

[64]  M. Jeannerod,et al.  Subliminal display of action words interferes with motor planning: A combined EEG and kinematic study , 2008, Journal of Physiology-Paris.

[65]  M. Eimer,et al.  Locus of Inhibition in the Masked Priming of Response Alternatives , 2002, Journal of motor behavior.

[66]  M. Eimer,et al.  Response facilitation and inhibition in subliminal priming , 2003, Biological Psychology.