Iconic Gestures Prime Words

Using a cross-modal semantic priming paradigm, both experiments of the present study investigated the link between the mental representations of iconic gestures and words. Two groups of the participants performed a primed lexical decision task where they had to discriminate between visually presented words and nonwords (e.g., flirp). Word targets (e.g., bird) were preceded by video clips depicting either semantically related (e.g., pair of hands flapping) or semantically unrelated (e.g., drawing a square with both hands) gestures. The duration of gestures was on average 3,500 ms in Experiment 1 but only 1,000 ms in Experiment 2. Significant priming effects were observed in both experiments, with faster response latencies for related gesture-word pairs than unrelated pairs. These results are consistent with the idea of interactions between the gestural and lexical representational systems, such that mere exposure to iconic gestures facilitates the recognition of semantically related words.

[1]  D. McNeill.  So you think gestures are nonverbal , 1985 .

[2]  Nicoletta Caramelli,et al.  Behavioural and neurophysiological evidence of semantic interaction between iconic gestures and words , 2008, Cognitive neuropsychology.

[3]  J. Lannoy,et al.  Gestures and Speech: Psychological Investigations , 1991 .

[4]  R. Krauss,et al.  Word Familiarity Predicts Temporal Asynchrony of Hand Gestures and Speech , 2010 .

[5]  Nicoletta Caramelli,et al.  Meaning in Words, Gestures, and Mental Images , 2009 .

[6]  Thomas A. Schreiber,et al.  The University of South Florida free association, rhyme, and word fragment norms , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[7]  J Grainger,et al.  Orthographic processing in visual word recognition: a multiple read-out model. , 1996, Psychological review.

[8]  S. Vereza.  Philosophy in the flesh: the embodied mind and its challenge to Western thought , 2001 .

[9]  G. Beattie,et al.  What properties of talk are associated with the generation of spontaneous iconic hand gestures? , 2002, The British journal of social psychology.

[10]  M. Wiener,et al.  Nonverbal behavior and nonverbal communication , 1972 .

[11]  T. McNamara.  Semantic Priming: Perspectives from Memory and Word Recognition , 2005 .

[12]  Lidia Suárez,et al.  Distributional analyses in auditory lexical decision: Neighborhood density and word-frequency effects , 2009, Psychonomic bulletin & review.

[13]  D. McNeill.  Gesture and Thought , 2005 .

[14]  Sotaro Kita,et al.  What does cross-linguistic variation in semantic coordination of speech and gesture reveal? Evidence for an interface representation of spatial thinking and speaking , 2003 .

[15]  David A Balota,et al.  Additive and interactive effects on response time distributions in visual word recognition. , 2007, Journal of experimental psychology. Learning, memory, and cognition.

[16]  Rachel I. Mayberry,et al.  Language and Gesture: Gesture production during stuttered speech: insights into the nature of gesture–speech integration , 2000 .

[17]  G. Bower.  Mood and memory. , 1981, The American psychologist.

[18]  J. H. Neely.  Semantic priming effects in visual word recognition: A selective review of current findings and theories. , 1991 .

[19]  D. Balota,et al.  Are lexical decisions a good measure of lexical access? The role of word frequency in the neglected decision stage. , 1984, Journal of experimental psychology. Human perception and performance.

[20]  Sotaro Kita,et al.  How does linguistic framing of events influence co-speech gestures? , 2007 .

[21]  J. H. Neely.  Semantic priming and retrieval from lexical memory: Roles of inhibitionless spreading activation and limited-capacity attention. , 1977 .

[22]  M. Coltheart,et al.  358,534 nonwords: The ARC Nonword Database , 2002, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[23]  Nancy R. Smith,et al.  Symbolic Functioning in Childhood , 1981 .

[24]  D. McDermott.  LANGUAGE OF THOUGHT , 2012 .

[25]  Susan Goldin-Meadow,et al.  Using the Hands to Identify Who Does What to Whom: Gesture and Speech Go Hand-in-Hand , 2009, Cogn. Sci..

[26]  Rebecca Treiman,et al.  The English Lexicon Project , 2007, Behavior research methods.

[27]  R. Krauss,et al.  Nonverbal Behavior and Nonverbal Communication: What do Conversational Hand Gestures Tell Us? , 1996 .

[28]  Michael P. Kaschak,et al.  Body posture facilitates retrieval of autobiographical memories , 2007, Cognition.

[29]  J. Fodor,et al.  Connectionism and cognitive architecture: A critical analysis , 1988, Cognition.

[30]  G. Miller,et al.  Cognitive science. , 1981, Science.

[31]  D. McNeill.  Hand and Mind: What Gestures Reveal about Thought , 1992 .

[32]  R. Krauss.  Why Do We Gesture When We Speak? , 1998 .

[33]  J. Jonides,et al.  On the Cost and Benefit of Cost and Benefit , 1984 .

[34]  D. Casasanto,et al.  Motor action and emotional memory , 2010, Cognition.

[35]  Sotaro Kita,et al.  How representational gestures help speaking , 2000 .

[36]  Alan S. Brown,et al.  Information Processing and Cognition: The Loyola Symposium , 1976 .

[37]  Allan Collins,et al.  A spreading-activation theory of semantic processing , 1975 .

[38]  K. Forster.  Priming and the Effects of Sentence and Lexical Contexts on Naming Time: Evidence for Autonomous Lexical Processing* , 1981 .

[39]  M. Posner,et al.  Attention and cognitive control. , 1975 .