How I See What You're Saying: The Role of Gestures in Native and Foreign Language Listening Comprehension

In what ways do native language (NL) speakers and foreign language (FL) learners differ in understanding the same messages delivered with or without gestures? To answer this question, seventh- and eighth-grade NL and FL learners of English in the United States and Norway were shown a video of a speaker describing, in English, a cartoon image that the viewers could not see. For half the viewers, the speaker's gestures were visible; for the others they were not. Participants drew a picture of each description, which was later coded for recall of explicit information, comprehension of logically implied information, and distortions. Overall, NL listeners produced the most accurate drawings; the presence of gestures did not appreciably facilitate NL comprehension. In contrast, the availability of gestures had a measurable effect on FL listener performance: It enabled them to produce drawings within native-like range. However, lack of gestures negatively impacted FL listener comprehension and recall. Regardless of condition, distortions in FL responses were significantly more frequent than in NL responses. All participants reported valuing visual cues in communication, yet their understanding of their value for their actual drawing performance was inconsistent, suggesting a difference between visual cue preference and visual cue dependence. [ABSTRACT FROM AUTHOR]

[1]  Larry Vandergrift.  Recent developments in second and foreign language listening comprehension research , 2007, Language Teaching.

[2]  S. Goldin-Meadow,et al.  What the teacher's hands tell the student's mind about math. , 1999 .

[3]  A. Garnham,et al.  The role of conversational hand gestures in a narrative task , 2007 .

[4]  Martha W. Alibali,et al.  The Role of Gesture in Children's Comprehension of Spoken Language:Now They Need It, Now They Don't , 2000 .

[5]  R. Klatzky,et al.  Teachers’ gestures facilitate students’ learning: A lesson in symmetry , 2003 .

[6]  Spencer D. Kelly,et al.  Gesture Gives a Hand to Language and Learning: Perspectives from Cognitive Neuroscience, Developmental Psychology and Education , 2008, Lang. Linguistics Compass.

[7]  Gary J. Ockey,et al.  Construct implications of including still image or video in computer-based listening tests , 2007 .

[8]  T. Harris.  Listening with your Eyes: The Importance of Speech-Related Gestures in the Language Classroom , 2003 .

[9]  Jeremy I. Skipper,et al.  Co‐speech gestures influence neural activity in brain regions associated with processing semantic information , 2009, Human brain mapping.

[10]  Michelle Perry,et al.  How many do you see? The use of nonspoken representations in first-grade mathematics lessons , 2001 .

[11]  Elvis Wagner.  The effect of the use of video texts on ESL listening test-taker performance , 2010 .

[12]  Marcos Peñate Cabrera,et al.  The effects of repetition, comprehension checks, and gestures, on primary school children in an EFL situation , 2001 .

[13]  T. Trabasso,et al.  Offering a Hand to Pragmatic Understanding: The Role of Speech and Gesture in Comprehension and Memory , 1999 .

[14]  D. McNeill,et al.  Gesture and the Poetics of Prose , 1991 .

[15]  Nobuko Osada,et al.  Listening Comprehension Research: A Brief Review of the Past Thirty Years , 2004 .

[16]  Shahrzad Mahootian,et al.  The Role of Gesture in Bilingual Education: Does Gesture Enhance Learning? , 2004 .

[17]  Wing Chee So,et al.  Mnemonic effect of iconic gesture and beat gesture in adults and children: Is meaning in gesture important for memory recall? , 2012 .

[18]  John T. E. Richardson,et al.  Eta Squared and Partial Eta Squared as Measures of Effect Size in Educational Research. , 2011 .

[19]  Susan Goldin-Meadow,et al.  From children's hands to adults' ears: gesture's role in the learning process. , 2003, Developmental psychology.

[20]  A. Kendon.  Do Gestures Communicate? A Review , 1994 .

[21]  S. Kelly,et al.  Please Scroll down for Article Language and Cognitive Processes Brief Training with Co-speech Gesture Lends a Hand to Word Learning in a Foreign Language , 2022 .

[22]  Natalia Trujillo,et al.  Gesture influences the processing of figurative language in non-native speakers: ERP evidence , 2010, Neuroscience Letters.

[23]  Christine C. M. Goh,et al.  How Much Do Learners Know about the Factors That Influence Their Listening Comprehension , 1999 .

[24]  Marianne Gullberg,et al.  INTRODUCTION TO GESTURE AND SLA: TOWARD AN INTEGRATED APPROACH , 2008, Studies in Second Language Acquisition.

[25]  M. Argyle,et al.  A Cross-Cultural Study of the Communication of Extra-Verbal Meaning by Gesture , 1975 .

[26]  Susan Kellerman,et al.  ‘I See What You Mean’: The Role of Kinesic Behaviour in Listening and Implications for Foreign and Second Language Learning , 1992 .

[27]  Virginia Volterra,et al.  Gestures and some key issues in the study of language development , 2008 .

[28]  L. Allen.  The Effects of Emblematic Gestures on the Development and Access of Mental Representations of French Expressions , 1995 .

[29]  K. Sweeney,et al.  Revealing implicit understanding through enthymemes: a rhetorical method for the analysis of talk , 2007, Medical education.

[30]  M. Tellier.  The effect of gestures on second language memorisation by young children , 2008 .

[31]  Steven G. McCafferty,et al.  Gesture and Creating Zones of Proximal Development for Second Language Learning , 2002 .

[32]  K. Willmes,et al.  Neural interaction of speech and gesture: Differential activations of metaphoric co-verbal gestures , 2009, Neuropsychologia.

[33]  Heather Shovelton,et al.  Mapping the Range of Information Contained in the Iconic Hand Gestures that Accompany Spontaneous Speech , 1999 .

[34]  Junko Mori,et al.  The Achievement of Intersubjectivity through Embodied Completions: A Study of Interactions Between First and Second Language Speakers , 2006 .

[35]  Jonas Obleser,et al.  Integration of iconic gestures and speech in left superior temporal areas boosts speech comprehension under adverse listening conditions , 2010, NeuroImage.

[36]  Larry Vandergrift,et al.  1. LISTENING TO LEARN OR LEARNING TO LISTEN? , 2004, Annual Review of Applied Linguistics.

[37]  D. Hardison.  Second-language spoken word identification: Effects of perceptual training, visual cues, and phonetic environment , 2005, Applied Psycholinguistics.

[38]  Spencer D. Kelly,et al.  When actions speak too much louder than words: Hand gestures disrupt word learning when phonetic demands are high , 2012 .

[39]  D. Hardison,et al.  The Role of Gestures and Facial Cues in Second Language Listening Comprehension , 2005 .

[40]  Margaret Gwendoline Riseborough,et al.  Physiographic gestures as decoding facilitators: Three experiments exploring a neglected facet of communication , 1981 .

[41]  Susan Goldin-Meadow,et al.  Children Learn When Their Teacher's Gestures and Speech Differ , 2005, Psychological science.

[42]  E. Maris,et al.  Two Sides of the Same Coin , 2010, Psychological science.

[43]  Anne Lazaraton,et al.  Gesture and Speech in the Vocabulary Explanations of One ESL Teacher: A Microanalytic Inquiry. , 2004 .

[44]  Euen Hyuk Jung,et al.  The Role of Discourse Signaling Cues in Second Language Listening Comprehension , 2003 .

[45]  Michael Tomasello,et al.  The Effect of Video Context on Foreign Language Learning , 1992 .