Long‐Term Effects of Gestures on Memory for Foreign Language Words Trained in the Classroom

Language and gesture are viewed as highly interdependent systems. Besides supporting communication, gestures also have an impact on memory for verbal information compared to pure verbal encoding in native but also in foreign language learning. This article presents a within-subject longitudinal study lasting 14 months that tested the use of gestures in the classroom, with the experimenter presenting the items to be acquired. Participants learned 36 words distributed across two training conditions: In the audio-visual condition subjects read, heard, and spoke the words; in the gestural condition subjects additionally accompanied the words with symbolic gestures. Memory performance was assessed through cued native-to-foreign translation tests at five time points. The results show that gestures significantly enhance vocabulary learning in quantity and over time. The findings are discussed in terms of Klimesch's connectivity model (CM) of information processing. Thereafter, a code, a word, is better integrated into long-term memory if it is deep, that is, if it is comprised of many interconnected components.

[1]  D. Grandjean,et al.  Emotional expression and vocabulary learning in adults and children , 2013, Cognition & emotion.

[2]  Rolf A. Zwaan,et al.  Embodied Language: A Review of the Role of the Motor System in Language Comprehension , 2008, Quarterly journal of experimental psychology.

[3]  Lisa Feldman Barrett,et al.  Emotion Words Shape Emotion Percepts , 2022 .

[4]  S. Goldin-Meadow,et al.  Pointing sets the stage for learning language--and creating language. , 2007, Child development.

[5]  M. Tomasello,et al.  A new look at infant pointing. , 2007, Child development.

[6]  S. Kelly,et al.  Neural correlates of bimodal speech and gesture comprehension , 2004, Brain and Language.

[7]  Andreas Hennenlotter,et al.  Neural correlates of the processing of co-speech gestures , 2008, NeuroImage.

[8]  L. Allen The Effects of Emblematic Gestures on the Development and Access of Mental Representations of French Expressions , 1995 .

[9]  K. Kriegstein,et al.  Gestures Enhance Foreign Language Learning , 2012, Biolinguistics.

[10]  Chun-yan Guo,et al.  Retrieval of concrete words involves more contextual information than abstract words: Multiple components for the concreteness effect , 2012, Brain and Language.

[11]  F. Craik,et al.  Depth of processing and the retention of words , 1975 .

[12]  S. Greenberg,et al.  Affective orientation influences memory for emotional and neutral words. , 2012, The American journal of psychology.

[13]  E. Macaro Strategies for Language Learning and for Language Use: Revising the Theoretical Framework , 2006 .

[14]  F. Craik Levels of processing: Past, present... and future? , 2002, Memory.

[15]  R. Adolphs,et al.  Verbal and nonverbal emotional memory following unilateral amygdala damage. , 2001, Learning & memory.

[16]  Friedemann Pulvermüller,et al.  A Role for the Motor System in Binding Abstract Emotional Meaning , 2011, Cerebral cortex.

[17]  Steven Graham,et al.  Word frequency and subsequent memory effects studied using event-related fMRI , 2003, NeuroImage.

[18]  K. Emmorey,et al.  Journal of Experimental Psychology : Learning , Memory , and Cognition Effects of Iconicity and Semantic Relatedness on Lexical Access in American Sign Language , 2010 .

[19]  Spencer D. Kelly,et al.  Gesture Gives a Hand to Language and Learning: Perspectives from Cognitive Neuroscience, Developmental Psychology and Education , 2008, Lang. Linguistics Compass.

[20]  S. R. Schmidt,et al.  The emotional memory effect: Differential processing or item distinctiveness? , 2007, Memory & cognition.

[21]  L. F. Barrett,et al.  Context Is Routinely Encoded During Emotion Perception , 2010, Psychological science.

[22]  Peter E. Carels Pantomime in the Foreign Language Classroom , 1981 .

[23]  S. Goldin-Meadow,et al.  Constructing communication by hand , 2002 .

[24]  C. Hulme,et al.  Speech and language processing mechanisms in verbal serial recall , 2006 .

[25]  P. Sheeran,et al.  Dealing with feeling: a meta-analysis of the effectiveness of strategies derived from the process model of emotion regulation. , 2012, Psychological bulletin.

[26]  A. Friederici,et al.  The impact of iconic gestures on foreign language word learning and its neural substrate , 2011, Human brain mapping.

[27]  Laura Morett,et al.  How the Hands Cue the Mind: The Effects of Iconicity and Enactment on Sign Language Acquisition , 2012, CogSci.

[28]  Francesca M. M. Citron Neural correlates of written emotion word processing: A review of recent electrophysiological and hemodynamic neuroimaging studies , 2012, Brain and Language.

[29]  T. Kircher,et al.  Supramodal Representation of Emotions , 2011, The Journal of Neuroscience.

[30]  Susan Goldin-Meadow,et al.  Learning words by hand: Gesture's role in predicting vocabulary development , 2008, First language.

[31]  Wolfgang Klimesch A connectivity model for semantic processing , 1987 .

[32]  S. Kelly,et al.  Please Scroll down for Article Language and Cognitive Processes Brief Training with Co-speech Gesture Lends a Hand to Word Learning in a Foreign Language , 2022 .

[33]  Suzanne Donnenwerth-Nolan,et al.  Does motoric imagery facilitate memory for sentences? A selective interference test , 1981 .

[34]  R. L. Cohen,et al.  On the generality of some memory laws , 1981 .

[35]  Luke Plonsky,et al.  SYSTEMATIC REVIEW ARTICLE The Effectiveness of Second Language Strategy Instruction: A Meta-analysis , 2011 .

[36]  S. Goldin-Meadow,et al.  Why people gesture when they speak , 1998, Nature.

[37]  Elizabeth A. Phelps,et al.  How arousal modulates memory: Disentangling the effects of attention and retention , 2004, Cognitive, affective & behavioral neuroscience.

[38]  A. Paivio Mental imagery in associative learning and memory , 1969 .

[39]  Rolf A. Zwaan,et al.  Inferences about action engage action systems , 2008, Brain and Language.

[40]  F. Craik,et al.  Levels of Pro-cessing: A Framework for Memory Research , 1975 .

[41]  The role of emotion in word learning , 2010 .

[42]  Thomas C. Gunter,et al.  The Role of Iconic Gestures in Speech Disambiguation: ERP Evidence , 2007, Journal of Cognitive Neuroscience.

[43]  Friedemann Pulvermüller,et al.  Brain mechanisms linking language and action , 2005, Nature Reviews Neuroscience.

[44]  Roger A. Barker,et al.  Dynamic causal modelling of effective connectivity from fMRI: Are results reproducible and sensitive to Parkinson's disease and its treatment? , 2010, NeuroImage.

[45]  Courtney C. Dornburg,et al.  Disentangling encoding versus retrieval explanations of the bizarreness effect: Implications for distinctiveness , 2005, Memory & cognition.

[46]  A. Baddeley,et al.  Word length and the structure of short-term memory , 1975 .

[47]  G. Lakoff,et al.  The Brain's concepts: the role of the Sensory-motor system in conceptual knowledge , 2005, Cognitive neuropsychology.

[48]  C. Hulme,et al.  Working Memory Development: The Effects of Speech Rate, Word Length, and Acoustic Similarity on Serial Recall. , 1989 .

[49]  Friedemann Pulvermüller,et al.  Reading cinnamon activates olfactory brain regions , 2006, NeuroImage.

[50]  Manuela Macedonia,et al.  Learning a Second Language Naturally the Voice Movement Icon Approach , 2013 .

[51]  Susan Goldin-Meadow,et al.  Gesturing makes memories that last. , 2010, Journal of memory and language.

[52]  Zeshu Shao,et al.  The Role of Synchrony and Ambiguity in Speech–Gesture Integration during Comprehension , 2011, Journal of Cognitive Neuroscience.

[53]  The role of attention in the associative binding of emotionally arousing words , 2012, Psychonomic bulletin & review.

[54]  J. Asher The Total Physical Response Technique of Learning , 1969 .

[55]  Sotaro Kita,et al.  On-line Integration of Semantic Information from Speech and Gesture: Insights from Event-related Brain Potentials , 2007, Journal of Cognitive Neuroscience.

[56]  M. Tellier The effect of gestures on second language memorisation by young children , 2008 .

[57]  Roel M. Willems,et al.  When language meets action: the neural integration of gesture and speech. , 2007, Cerebral cortex.

[58]  Elizabeth A. Kensinger,et al.  Memory enhancement for emotional words: Are emotional words more vividly remembered than neutral words? , 2003, Memory & cognition.

[59]  Thomas R. Knösche,et al.  Body in mind: How gestures empower foreign language learning , 2011 .

[60]  Roel M. Willems,et al.  Neural evidence for the interplay between language, gesture, and action: A review , 2007, Brain and Language.