Do We Really Gesture More When It Is More Difficult?

Representational co-speech gestures are generally assumed to be increasingly produced in more difficult compared with easier verbal tasks, as maintained by theories suggesting that gestures arise from processing difficulties during speech production. However, the gestures-as-simulated-action framework proposes that more representational gestures are produced with stronger rather than weaker mental representations that are activated in terms of mental simulation in the embodied cognition framework. We tested these two conflicting assumptions by examining verbal route descriptions that were accompanied by spontaneous directional gestures. Easy descriptions with strong activation were accompanied more often by gestures than difficult descriptions with weak activation. Furthermore, only gesture-speech matches-but not gesture-picture matches-were increasingly produced with difficult lateral directions compared with easy nonlateral directions. We argue that lateral gesture-speech matches underlie stronger activated mental representations in mental imagery. Thus, all results are in line with the gestures-as-simulated-action framework and provide evidence against the view that gestures result from processing difficulties.

[1]  Mika Naito,et al.  Repetition Priming in Children and Adults: Age-Related Dissociation between Implicit and Explicit Memory. , 1990 .

[2]  B. Tversky,et al.  Internal and external spatial frameworks for representing described scenes , 1992 .

[3]  N. Franklin,et al.  Parsing surrounding space into regions , 1995, Memory & cognition.

[4]  A. Glenberg,et al.  What memory is for: Creating meaning in the service of action , 1997, Behavioral and Brain Sciences.

[5]  Margaret Wilson,et al.  Six views of embodied cognition , 2002, Psychonomic bulletin & review.

[6]  Arturo E. Hernandez,et al.  Within- and between-language priming differ: evidence from repetition of pictures in Spanish-English bilinguals. , 2002, Journal of experimental psychology. Learning, memory, and cognition.

[7]  Jennifer M. Shephard,et al.  Imagined rotations of self versus objects: an fMRI study , 2005, Neuropsychologia.

[8]  D. McNeill Hand and Mind: What Gestures Reveal about Thought , 1992 .

[9]  A W Ellis,et al.  Two loci of repetition priming in the recognition of familiar faces. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[10]  Jeffrey M. Zacks,et al.  Imagined Viewer and Object Rotations Dissociated with Event-Related fMRI , 2003, Journal of Cognitive Neuroscience.

[11]  W. S. Farrell Coding left and right. , 1979, Journal of experimental psychology. Human perception and performance.

[12]  Nelson Cowan,et al.  Working Memory Capacity , 2005 .

[13]  Sotaro Kita,et al.  How representational gestures help speaking , 2000 .

[14]  Allan Collins,et al.  A spreading-activation theory of semantic processing , 1975 .

[15]  Cesare Cornoldi,et al.  Visuo-spatial working memory and individual differences , 2003 .

[16]  R. A. Carlson,et al.  What do the hands externalize in simple arithmetic? , 2007, Journal of experimental psychology. Learning, memory, and cognition.

[17]  S. Goldin-Meadow,et al.  Gesturing makes learning last , 2008, Cognition.

[18]  Susan M. Wagner,et al.  Probing the Mental Representation of Gesture: Is Handwaving Spatial?. , 2004 .

[19]  Jeffrey M. Zacks,et al.  Imagined transformations of bodies: an fMRI investigation , 1999, Neuropsychologia.

[20]  S. Goldin-Meadow,et al.  Gesturing Gives Children New Ideas About Math , 2009, Psychological science.

[21]  Julie D. Anderson,et al.  Age of acquisition and repetition priming effects on picture naming of children who do and do not stutter. , 2008, Journal of fluency disorders.

[22]  W. Levelt Speaking: From Intention to Articulation , 1990 .

[23]  B. Tversky,et al.  Searching imagined environments. , 1990 .

[24]  Susan Goldin-Meadow,et al.  Early gesture selectively predicts later language learning. , 2009, Developmental science.

[25]  M. Jeannerod Neural Simulation of Action: A Unifying Mechanism for Motor Cognition , 2001, NeuroImage.

[26]  Sotaro Kita,et al.  What does cross-linguistic variation in semantic coordination of speech and gesture reveal? Evidence for an interface representation of spatial thinking and speaking , 2003 .

[27]  W S Maki,et al.  Processing locational and orientational information , 1977, Memory & cognition.

[28]  C. B. Cave Very Long-Lasting Priming in Picture Naming , 1997 .

[29]  K. Forster,et al.  REPETITION PRIMING AND FREQUENCY ATTENUATION IN LEXICAL ACCESS , 1984 .

[30]  M. Alibali,et al.  The function of gesture in learning to count: more than keeping track * , 1999 .

[31]  A. Wohlschläger,et al.  Mental and manual rotation. , 1998, Journal of experimental psychology. Human perception and performance.

[32]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[33]  Jeffrey M. Zacks,et al.  Neuroimaging Studies of Mental Rotation: A Meta-analysis and Review , 2008, Journal of Cognitive Neuroscience.

[34]  S Monsell,et al.  The Locus of Repetition Priming of Spoken Word Production , 1992, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[35]  Autumn B. Hostetter,et al.  Visible embodiment: Gestures as simulated action , 2008, Psychonomic bulletin & review.

[36]  M. Alibali,et al.  Gesture and the process of speech production: We think, therefore we gesture , 2000 .

[37]  Susan M. Wagner,et al.  Explaining Math: Gesturing Lightens the Load , 2001, Psychological science.

[38]  Jonathan Grainger,et al.  ERP effects of short interval masked associative and repetition priming , 2009, Journal of Neurolinguistics.

[39]  J. Henderson,et al.  Linearization strategies during language production , 1998, Memory & cognition.

[40]  B. Butterworth,et al.  Gesture, speech, and computational stages: a reply to McNeill. , 1989, Psychological review.

[41]  Sotaro Kita,et al.  When Input and Output Diverge: Mismatches in Gesture, Speech, and Image , 2004 .

[42]  K. Grill-Spector,et al.  Repetition and the brain: neural models of stimulus-specific effects , 2006, Trends in Cognitive Sciences.

[43]  Michael P. Kaschak,et al.  Grounding language in action , 2002, Psychonomic bulletin & review.

[44]  L. Barsalou Grounded cognition. , 2008, Annual review of psychology.

[45]  Ezequiel Morsella,et al.  The role of gestures in spatial working memory and speech. , 2004, The American journal of psychology.

[46]  R. Henson,et al.  Neural response suppression, haemodynamic repetition effects, and behavioural priming , 2003, Neuropsychologia.

[47]  S. Levinson Space in language and cognition: Explorations in cognitive diversity , 2003 .

[48]  Sarah H. Creem-Regehr,et al.  Neural correlates of two imagined egocentric transformations , 2007, NeuroImage.

[49]  Maurizio Gentilucci,et al.  Please Scroll down for Article the Quarterly Journal of Experimental Psychology Spoken Language and Arm Gestures Are Controlled by the Same Motor Control System , 2022 .

[50]  S. Goldin-Meadow,et al.  Making children gesture brings out implicit knowledge and leads to learning. , 2007, Journal of experimental psychology. General.

[51]  S. Goldin-Meadow,et al.  Differences in Early Gesture Explain SES Disparities in Child Vocabulary Size at School Entry , 2009, Science.

[52]  S. Kosslyn,et al.  Motor processes in mental rotation , 1998, Cognition.

[53]  Yihsiu Chen,et al.  Language and Gesture: Lexical gestures and lexical access: a process model , 2000 .

[54]  Sotaro Kita,et al.  Conceptualisation load triggers gesture production , 2007 .

[55]  B. Tversky,et al.  Perspective in Spatial Descriptions , 1996 .