Gesture Gives a Hand to Language and Learning: Perspectives from Cognitive Neuroscience, Developmental Psychology and Education

People of all ages, cultures and backgrounds gesture when they speak. These hand movements are so natural and pervasive that researchers across many fields – from linguistics to psychology to neuroscience – have claimed that the two modalities form an integrated system of meaning during language production and comprehension. This special relationship has implications for a variety of research and applied domains. Gestures may provide unique insights into language and cognitive development, and also help clinicians identify, understand and even treat developmental disorders in childhood. In addition, research in education suggests that teachers can use gesture to become even more effective in several fundamental aspects of their profession, including communication, assessment of student knowledge, and the ability to instill a profound understanding of abstract concepts in traditionally difficult domains such as language and mathematics. This work converging from multiple perspectives will push researchers and practitioners alike to view hand gestures in a new and constructive way.

[1]  Kimberly J. Montgomery,et al.  Communicative hand gestures and object-directed hand movements activated the mirror neuron system. , 2007, Social cognitive and affective neuroscience.

[2]  S F Warren,et al.  Relative treatment effects of two prelinguistic communication interventions on language development in toddlers with developmental delays vary by maternal characteristics. , 2001, Journal of speech, language, and hearing research : JSLHR.

[3]  P. Holcomb,et al.  An electrophysiological investigation of semantic priming with pictures of real objects. , 1999, Psychophysiology.

[4]  S. Goldin-Meadow,et al.  Beyond words: the importance of gesture to researchers and learners. , 2000, Child development.

[5]  Shahrzad Mahootian,et al.  The Role of Gesture in Bilingual Education: Does Gesture Enhance Learning? , 2004 .

[6]  Susan Goldin-Meadow,et al.  Gestures convey substantive information about a child’s thoughts to ordinary listeners , 1999 .

[7]  Stefan Kopp,et al.  Synthesizing multimodal utterances for conversational agents , 2004, Comput. Animat. Virtual Worlds.

[8]  E. Bates,et al.  Language and gesture in late talkers. , 1988, Journal of speech and hearing research.

[9]  Leslie Goldsmith,et al.  Putting Language Back in the Body: Speech and Gesture on Three Time Frames , 2002, Developmental neuropsychology.

[10]  Marianne Gullberg International Review of Applied Linguistics. , 2006 .

[11]  Hao Yan,et al.  More than just a pretty face: conversational protocols and the affordances of embodiment , 2001, Knowl. Based Syst..

[12]  G. Rizzolatti,et al.  Understanding motor events: a neurophysiological study , 2004, Experimental Brain Research.

[13]  Roel M. Willems,et al.  Neural evidence for the interplay between language, gesture, and action: A review , 2007, Brain and Language.

[14]  S. Kelly,et al.  Neural correlates of bimodal speech and gesture comprehension , 2004, Brain and Language.

[15]  Jennifer H. Pfeifer,et al.  Understanding emotions in others: mirror neuron dysfunction in children with autism spectrum disorders , 2006, Nature Neuroscience.

[16]  M. Alibali,et al.  Gesture-Speech Mismatch and Mechanisms of Learning: What the Hands Reveal about a Child′s State of Mind , 1993, Cognitive Psychology.

[17]  Sotaro Kita,et al.  What does cross-linguistic variation in semantic coordination of speech and gesture reveal? Evidence for an interface representation of spatial thinking and speaking , 2003 .

[18]  T. P. Carpenter,et al.  Cognitively Guided Instruction: A Knowledge Base for Reform in Primary Mathematics Instruction , 1996, The Elementary School Journal.

[19]  Patric Bach,et al.  Communicating hands: ERPs elicited by meaningful symbolic hand postures , 2004, Neuroscience Letters.

[20]  Michelle Perry,et al.  How many do you see? The use of nonspoken representations in first-grade mathematics lessons , 2001 .

[21]  S. Goldin-Meadow,et al.  The mismatch between gesture and speech as an index of transitional knowledge , 1986, Cognition.

[22]  Aina Puce,et al.  Electrophysiology and brain imaging of biological motion. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[23]  J. Reynolds,et al.  Hand signalling in dyadic proximal communication: social strengths of children with autism who do not speak , 2000 .

[24]  James Bartolotti,et al.  An intentional stance modulates the integration of gesture and speech during comprehension , 2007, Brain and Language.

[25]  M. Azmitia,et al.  Social influences on children's cognition: state of the art and future directions. , 1989, Advances in child development and behavior.

[26]  S. Goldin-Meadow,et al.  The Role of Gesture in Learning: Do Children Use Their Hands to Change Their Minds? , 2006 .

[27]  R. Ilmoniemi,et al.  Functional links between motor and language systems , 2005, The European journal of neuroscience.

[28]  S. Goldin-Meadow,et al.  Assessing Knowledge Through Gesture: Using Children's Hands to Read Their Minds , 1992 .

[29]  Alan C. Evans,et al.  Specific Involvement of Human Parietal Systems and the Amygdala in the Perception of Biological Motion , 1996, The Journal of Neuroscience.

[30]  E. F. Masur,et al.  Gestural development, dual-directional signaling, and the transition to words , 1983 .

[31]  D. Poeppel,et al.  Towards a functional neuroanatomy of speech perception , 2000, Trends in Cognitive Sciences.

[32]  R. B. Church,et al.  A comparison between children's and adults' ability to detect conceptual information conveyed through representational gestures. , 1998, Child development.

[33]  Wolff-Michael Roth,et al.  On Performing Concepts during Science Lectures. , 2007 .

[34]  Thomas C. Gunter,et al.  The Role of Iconic Gestures in Speech Disambiguation: ERP Evidence , 2007, Journal of Cognitive Neuroscience.

[35]  Martha W. Alibali,et al.  Divergence of verbal expression and embodied knowledge: Evidence from speech and gesture in children with specific language impairment , 2001 .

[36]  Susan B. Empson,et al.  A longitudinal study of invention and understanding in children's multidigit addition and subtraction , 1998 .

[37]  Susan Goldin-Meadow,et al.  Is gesture-speech mismatch a general index of transitional knowledge? , 1992 .

[38]  Jeremy I. Skipper,et al.  Speech-associated gestures, Broca’s area, and the human mirror system , 2007, Brain and Language.

[39]  D M Buffington,et al.  Procedures for Teaching Appropriate Gestural Communication Skills to Children with Autism , 1998, Journal of autism and developmental disorders.

[40]  Spencer D. Kelly,et al.  Can Children Detect Conceptual Information Conveyed Through Other Children's Nonverbal Behaviors? , 1997 .

[41]  Olga Capirci,et al.  From communication to language in two modalities , 1994 .

[42]  F. Dick,et al.  Language, gesture, and the developing brain. , 2002, Developmental psychobiology.

[43]  L. Allen The Effects of Emblematic Gestures on the Development and Access of Mental Representations of French Expressions , 1995 .

[44]  D. McNeill,et al.  Speech-gesture mismatches: Evidence for one underlying representation of linguistic and nonlinguistic information , 1998 .

[45]  T. Trabasso,et al.  Offering a Hand to Pragmatic Understanding: The Role of Speech and Gesture in Comprehension and Memory , 1999 .

[46]  Virginia Volterra,et al.  Spoken and gestural production in a naming task by young children with Down syndrome , 2007, Brain and Language.

[47]  Spencer D. Kelly,et al.  Gesture, brain, and language , 2007, Brain and Language.

[48]  D. Perrett,et al.  Imitation, mirror neurons and autism , 2001, Neuroscience & Biobehavioral Reviews.

[49]  Seana Coulson,et al.  Iconic gestures prime related concepts: An ERP study , 2007, Psychonomic bulletin & review.

[50]  D. Povinelli,et al.  Reconstructing the evolution of mind. , 1993, The American psychologist.

[51]  Susan M. Wagner,et al.  Probing the Mental Representation of Gesture: Is Handwaving Spatial?. , 2004 .

[52]  S. Goldin-Meadow,et al.  Why people gesture when they speak , 1998, Nature.

[53]  Ipke Wachsmuth,et al.  Communicative Rhythm in Gesture and Speech , 1999, Gesture Workshop.

[54]  Roel M. Willems,et al.  When language meets action: the neural integration of gesture and speech. , 2007, Cerebral cortex.

[55]  Ursula Bellugi,et al.  Contrasting profiles of language development in children with williams and down syndromes , 1997 .

[56]  M. C. Caselli,et al.  Relationship between gestures and words in children with Down's syndrome and typically developing children in the early stages of communicative development. , 2003, International journal of language & communication disorders.

[57]  M. C. Caselli,et al.  Gestures and words in early development of children with Down syndrome. , 1998, Journal of speech, language, and hearing research : JSLHR.

[58]  S Goldin-Meadow,et al.  Comprehension and production of gesture in combination with speech in one-word speakers , 1992, Journal of Child Language.

[59]  Susan Goldin-Meadow,et al.  Transitional knowledge in the acquisition of concepts , 1988 .

[60]  R. Krauss,et al.  Do conversational hand gestures communicate? , 1991, Journal of personality and social psychology.

[61]  Morton Wiener,et al.  Age-related changes in hand and arm movements as nonverbal communication: Some conceptualizations and an empirical exploration. , 1975 .

[62]  S. Goldin-Meadow,et al.  Gesturing makes learning last , 2008, Cognition.

[63]  N. Brady,et al.  Prelinguistic predictors of language growth in children with developmental disabilities. , 2004, Journal of speech, language, and hearing research : JSLHR.

[64]  R. Krauss Why Do We Gesture When We Speak? , 1998 .

[65]  Istvan Molnar-Szakacs,et al.  Beyond superior temporal cortex: intersubject correlations in narrative speech comprehension. , 2008, Cerebral cortex.

[66]  Marianne Gullberg,et al.  Some reasons for studying gesture and second language acquisition (Hommage à Adam Kendon) , 2006 .

[67]  Susan Goldin-Meadow,et al.  A Helping Hand in Assessing Children's Knowledge: Instructing Adults to Attend to Gesture , 2002 .

[68]  Gertrude Moskowitz,et al.  The Classroom Interaction of Outstanding Foreign Language Teachers , 1976 .

[69]  Agnes Flöel,et al.  Language perception activates the hand motor cortex: implications for motor theories of speech perception , 2003, The European journal of neuroscience.

[70]  D. Thal,et al.  Validity of a parent report measure of vocabulary and syntax for preschool children with language impairment. , 1999, Journal of speech, language, and hearing research : JSLHR.

[71]  M. Arbib,et al.  Language within our grasp , 1998, Trends in Neurosciences.

[72]  Catherine Lord,et al.  Predicting outcomes of children referred for autism using the MacArthur-Bates Communicative Development Inventory. , 2007, Journal of speech, language, and hearing research : JSLHR.

[73]  J. D. Ruiter The production of gesture and speech , 2000 .

[74]  David F. Armstrong,et al.  Original Signs: Gesture, Sign, and the Sources of Language , 1999 .

[75]  M. Kutas,et al.  Reading senseless sentences: brain potentials reflect semantic incongruity. , 1980, Science.

[76]  Justine Cassell,et al.  Gesture and the dynamic dimension of language : essays in honor of David McNeill , 2007 .

[77]  D. Hardison,et al.  The Role of Gestures and Facial Cues in Second Language Listening Comprehension , 2005 .

[78]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[79]  K. Amunts,et al.  Broca's region: from action to language. , 2005, Physiology.

[80]  Tony Charman,et al.  Measuring early language development in preschool children with autism spectrum disorder using the MacArthur Communicative Development Inventory (Infant Form) , 2003, Journal of Child Language.

[81]  J. Piaget Six Psychological Studies , 1967 .

[82]  Susan Goldin-Meadow,et al.  Children Learn When Their Teacher's Gestures and Speech Differ , 2005, Psychological science.

[83]  G. Calvert,et al.  Multisensory integration: methodological approaches and emerging principles in the human brain , 2004, Journal of Physiology-Paris.

[84]  Andreas Hennenlotter,et al.  Neural correlates of the processing of co-speech gestures , 2008, NeuroImage.

[85]  M. Alibali How children change their minds: strategy change can be gradual or abrupt. , 1999, Developmental psychology.

[86]  Susan Goldin-Meadow,et al.  Assessing knowledge conveyed in gesture : Do teachers have the upper hand ? , 1997 .

[87]  Sotaro Kita,et al.  On-line Integration of Semantic Information from Speech and Gesture: Insights from Event-related Brain Potentials , 2007, Journal of Cognitive Neuroscience.

[88]  Asli Ozyurek,et al.  Gesture, language, and brain , 2007 .

[89]  Laura L. Namy,et al.  Developmental changes in neural activity to familiar words and gestures , 2007, Brain and Language.

[90]  M. Alibali,et al.  Gesture and the process of speech production: We think, therefore we gesture , 2000 .

[91]  Susan M. Wagner,et al.  Explaining Math: Gesturing Lightens the Load , 2001, Psychological science.

[92]  P. Mundy,et al.  Nonverbal communication and early language acquisition in children with Down syndrome and in normally developing children. , 1995, Journal of speech and hearing research.

[93]  M. Alibali,et al.  Transitions in concept acquisition: using the hand to read the mind. , 1993, Psychological review.

[94]  Ying Choon Wu,et al.  How iconic gestures enhance communication: An ERP study , 2007, Brain and Language.

[95]  G. Rizzolatti,et al.  A unifying view of the basis of social cognition , 2004, Trends in Cognitive Sciences.

[96]  Stefan Kopp,et al.  Trading Spaces: How Humans and Humanoids Use Speech and Gesture to Give Directions , 2007 .

[97]  Susan Goldin-Meadow,et al.  Language and Gesture: Gesture and the transition from one- to two-word speech: when hand and mouth come together , 2000 .

[98]  Michael C. Corballis,et al.  From Hand to Mouth: The Origins of Language , 2002 .

[99]  Vittorio Gallese,et al.  Listening to Action-related Sentences Activates Fronto-parietal Motor Circuits , 2005, Journal of Cognitive Neuroscience.

[100]  S Goldin-Meadow,et al.  What's communication got to do with it? Gesture in children blind from birth. , 1997, Developmental psychology.

[101]  Pat Mirenda,et al.  Predictors of expressive vocabulary growth in children with autism. , 2007, Journal of speech, language, and hearing research : JSLHR.

[102]  D. McNeill Gesture and Thought , 2005 .

[103]  R. Mccathren,et al.  Teacher-Implemented Prelinguistic Communication Intervention , 2000 .

[104]  S F Warren,et al.  Intentional communication elicits language-facilitating maternal responses in dyads with children who have developmental disabilities. , 2001, American journal of mental retardation : AJMR.

[105]  S. Calculator Use of Enhanced Natural Gestures to Foster Interactions Between Children With Angelman Syndrome and Their Parents , 2002 .

[106]  Heather Shovelton,et al.  Mapping the Range of Information Contained in the Iconic Hand Gestures that Accompany Spontaneous Speech , 1999 .

[107]  S. Goldin-Meadow,et al.  Hearing Gesture: How Our Hands Help Us Think , 2003 .

[108]  A. Kendon Gesture: Visible Action as Utterance , 2004 .

[109]  Justine Cassell,et al.  22 The Body in Communication: Lessons from the Near-Human , 2007 .

[110]  R. Breckinridge Church,et al.  Using Gesture and Speech to Capture Transitions in Learning , 1999 .

[111]  M. Rugg,et al.  Event-related potentials and recognition memory , 2007, Trends in Cognitive Sciences.

[112]  S. Goldin-Meadow,et al.  Making children gesture brings out implicit knowledge and leads to learning. , 2007, Journal of experimental psychology. General.

[113]  M. Studdert-Kennedy Hand and Mind: What Gestures Reveal About Thought. , 1994 .

[114]  J. Brian,et al.  Early Language and Communication Development of Infants Later Diagnosed with Autism Spectrum Disorder , 2006, Journal of developmental and behavioral pediatrics : JDBP.