Verbal working memory predicts co-speech gesture: Evidence from individual differences

Gesture facilitates language production, but there is debate surrounding its exact role. It has been argued that gestures lighten the load on verbal working memory (VWM; Goldin-Meadow, Nusbaum, Kelly, & Wagner, 2001), but gestures have also been argued to aid in lexical retrieval (Krauss, 1998). In the current study, 50 speakers completed an individual differences battery that included measures of VWM and lexical retrieval. To elicit gesture, each speaker described short cartoon clips immediately after viewing. Measures of lexical retrieval did not predict spontaneous gesture rates, but lower VWM was associated with higher gesture rates, suggesting that gestures can facilitate language production by supporting VWM when resources are taxed. These data also suggest that individual variability in the propensity to gesture is partly linked to cognitive capacities.

[1]  E. A. Stine,et al.  Age differences in reading time allocation for propositionally dense sentences. , 1994 .

[2]  P. Liddle,et al.  Negative Features, Retrieval Processes and Verbal Fluency in Schizophrenia , 1993, British Journal of Psychiatry.

[3]  Sotaro Kita,et al.  Relations between syntactic encoding and co-speech gestures: Implications for a model of speech and gesture production , 2007 .

[4]  Randi C. Martin,et al.  Lexical‐semantic retention and speech production:further evidence from normal and brain‐damaged participants for a phrasal scope of planning , 2004, Cognitive neuropsychology.

[5]  Yihsiu Chen,et al.  Language and Gesture: Lexical gestures and lexical access: a process model , 2000 .

[6]  Martha W. Alibali,et al.  Gesture in Spatial Cognition: Expressing, Communicating, and Thinking About Spatial Information , 2005, Spatial Cogn. Comput..

[7]  D. Thal,et al.  Communicative gestures in children with delayed onset of oral expressive vocabulary. , 1992, Journal of speech and hearing research.

[8]  Susan M. Wagner,et al.  Explaining Math: Gesturing Lightens the Load , 2001, Psychological science.

[9]  Susan Goldin-Meadow,et al.  Gesturing Saves Cognitive Resources When Talking About Nonpresent Objects , 2010, Cogn. Sci..

[10]  Sotaro Kita,et al.  How representational gestures help speaking , 2000 .

[11]  Palmer Morrel-Samuels,et al.  Word familiarity predicts temporal asynchrony of hand gestures and speech. , 1992 .

[12]  Aging and word-finding: a comparison of spontaneous and constrained naming tests. , 2000 .

[13]  D. Riva,et al.  Developmental Aspects of Verbal Fluency and Confrontation Naming in Children , 2000, Brain and Language.

[14]  T. Gollan,et al.  Semantic and letter fluency in Spanish-English bilinguals. , 2002, Neuropsychology.

[15]  Sophia Vinogradov,et al.  Both processing speed and semantic memory organization predict verbal fluency in schizophrenia , 2003, Schizophrenia Research.

[16]  J. D. Ruiter The production of gesture and speech , 2000 .

[17]  Timothy A. Salthouse,et al.  The Role of Processing Resources in Cognitive Aging , 1988 .

[18]  Lars Marstaller,et al.  Individual differences in the gesture effect on working memory , 2013, Psychonomic bulletin & review.

[19]  R. Krauss,et al.  The Role of Speech-Related Arm/Hand Gestures in Word Retrieval , 2001 .

[20]  R. Krauss Why Do We Gesture When We Speak? , 1998 .

[21]  E. Bialystok,et al.  Effect of language proficiency and executive control on verbal fluency performance in bilinguals , 2010, Cognition.

[22]  D. McNeill Hand and Mind: What Gestures Reveal about Thought , 1992 .

[23]  R. Krauss,et al.  PSYCHOLOGICAL SCIENCE Research Article GESTURE, SPEECH, AND LEXICAL ACCESS: The Role of Lexical Movements in Speech Production , 2022 .

[24]  Michael F. Bunting,et al.  Working memory span tasks: A methodological review and user’s guide , 2005, Psychonomic bulletin & review.

[25]  S. Kita,et al.  Individual Differences in Frequency and Saliency of Speech-Accompanying Gestures: The Role of Cognitive Abilities and Empathy , 2013, Journal of experimental psychology. General.

[26]  F. Craik,et al.  Lexical access in bilinguals: Effects of vocabulary size and executive control , 2008, Journal of Neurolinguistics.

[27]  S. Goldin-Meadow,et al.  The resilience of gesture in talk: gesture in blind speakers and listeners , 2001 .

[28]  K. Hawkins,et al.  Norms and the relationship of Boston Naming Test performance to vocabulary and education: A review , 2002 .

[29]  Cristobal Carnero,et al.  Usefulness of a 15-item version of the Boston Naming Test in neuropsychological assessment of low-educational elders with dementia. , 2002, The journals of gerontology. Series B, Psychological sciences and social sciences.

[30]  S. Hamby,et al.  Neuropsychological assessment of relatively intact individuals: pychometric lessons from an HIV+ sample. , 1997, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[31]  L Robert Slevc,et al.  Saying what's on your mind: working memory effects on sentence production. , 2011, Journal of experimental psychology. Learning, memory, and cognition.

[32]  R. Klatzky,et al.  Teachers’ gestures facilitate students’ learning: A lesson in symmetry , 2003 .

[33]  Randi C. Martin,et al.  Short-term retention of lexical-semantic representations: Implications for speech production , 2001, Memory.

[34]  T. Tombaugh,et al.  Normative data stratified by age and education for two measures of verbal fluency: FAS and animal naming. , 1999, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[35]  M. Alibali,et al.  Gesture's role in speaking, learning, and creating language. , 2013, Annual review of psychology.

[36]  Daniel J. Acheson,et al.  Verbal working memory and language production: Common approaches to the serial ordering of verbal information. , 2009, Psychological bulletin.

[37]  Martha W. Alibali,et al.  Raise your hand if you’re spatial: Relations between verbal and spatial skills and gesture production , 2007 .

[38]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[39]  John Sibert,et al.  AD Model Builder: using automatic differentiation for statistical inference of highly parameterized complex nonlinear models , 2012, Optim. Methods Softw..

[40]  M. Alibali,et al.  Effects of Visibility between Speaker and Listener on Gesture Production: Some Gestures Are Meant to Be Seen , 2001 .

[41]  Susan Duncan,et al.  Growth points in thinking-for-speaking , 1998 .

[42]  Susan M. Wagner,et al.  Probing the Mental Representation of Gesture: Is Handwaving Spatial?. , 2004 .

[43]  Robert J. Hartsuiker,et al.  Language production and working memory: The case of subject-verb agreement , 2006 .