How Do Gestures Influence Thinking and Speaking? The Gesture-for-Conceptualization Hypothesis

People spontaneously produce gestures during speaking and thinking. The authors focus here on gestures that depict or indicate information related to the contents of concurrent speech or thought (i.e., representational gestures). Previous research indicates that such gestures have not only communicative functions, but also self-oriented cognitive functions. In this article, the authors propose a new theoretical framework, the gesture-for-conceptualization hypothesis, which explains the self-oriented functions of representational gestures. According to this framework, representational gestures affect cognitive processes in 4 main ways: gestures activate, manipulate, package, and explore spatio-motoric information for speaking and thinking. These four functions are shaped by gesture’s ability to schematize information, that is, to focus on a small subset of available information that is potentially relevant to the task at hand. The framework is based on the assumption that gestures are generated from the same system that generates practical actions, such as object manipulation; however, gestures are distinct from practical actions in that they represent information. The framework provides a novel, parsimonious, and comprehensive account of the self-oriented functions of gestures. The authors discuss how the framework accounts for gestures that depict abstract or metaphoric content, and they consider implications for the relations between self-oriented and communicative functions of gestures.

[1]  Sotaro Kita,et al.  Gestural depiction of motion events in narrative increases symbolic distance with age , 2018 .

[2]  S. Goldin-Meadow,et al.  Gesture as representational action: A paper about function , 2016, Psychonomic Bulletin & Review.

[3]  Rebecca Boncoddo,et al.  Chapter 7. Gestures highlight perceptual-motor representations in thinking , 2017 .

[4]  Elizabeth Kirk,et al.  Gesture Facilitates Children’s Creative Thinking , 2017, Psychological science.

[5]  S. Kita,et al.  Hand Matters: Left-Hand Gestures Enhance Metaphor Explanation , 2017, Journal of experimental psychology. Learning, memory, and cognition.

[6]  S. Goldin-Meadow,et al.  Does language shape silent gesture? , 2016, Cognition.

[7]  Sotaro Kita,et al.  Co-thought and co-speech gestures are generated by the same action generation process. , 2016, Journal of experimental psychology. Learning, memory, and cognition.

[8]  Susan Goldin-Meadow,et al.  What makes a movement a gesture? , 2016, Cognition.

[9]  Emiel Krahmer,et al.  Can you handle this? The impact of object affordances on how co-speech gestures are produced , 2015, Language, cognition and neuroscience.

[10]  S. Goldin-Meadow,et al.  From action to abstraction: Gesture as a mechanism of change. , 2015, Developmental review : DR.

[11]  S. Goldin-Meadow,et al.  The influence of communication mode on written language processing and beyond , 2015, Behavioral and Brain Sciences.

[12]  Aaron Weinberg,et al.  Characterizing instructor gestures in a lecture in a proof-based mathematics class , 2015 .

[13]  Tyler Marghetis,et al.  Cognitive Linguistics and the Concept(s) of Number , 2015 .

[14]  T. Shipley,et al.  Student Gestures Aid Penetrative Thinking , 2015 .

[15]  John B. Black,et al.  Coordinating Gesture, Word, and Diagram: Explanations for Experts and Novices , 2015, Spatial Cogn. Comput..

[16]  Wing Chee So,et al.  Producing Gestures Facilitates Route Learning , 2014, PloS one.

[17]  Susan Goldin-Meadow,et al.  Teaching moral reasoning through gesture. , 2014, Developmental science.

[18]  Autumn B. Hostetter,et al.  Action Attenuates the Effect of Visibility on Gesture Rates , 2014, Cogn. Sci..

[19]  S. Kita,et al.  Children use gesture to interpret novel verb meanings. , 2014, Child development.

[20]  Fred Paas,et al.  Toward a more embedded/extended perspective on the cognitive function of gestures , 2014, Front. Psychol..

[21]  S. Kita Production of Speech-Accompanying Gesture , 2014 .

[22]  S. Goldin-Meadow,et al.  From Action to Abstraction , 2014, Psychological science.

[23]  Robert L. Goldstone,et al.  Concreteness Fading in Mathematics and Science Instruction: a Systematic Review , 2014 .

[24]  Lars Marstaller,et al.  Individual differences in the gesture effect on working memory , 2013, Psychonomic bulletin & review.

[25]  Amelia Yeo,et al.  Students learn more when their teacher has learned to gesture effectively , 2013 .

[26]  TINBERGEN AN ARISTOTELIAN ? COMPARISON OF TINBERGEN ’ S FOUR WHYS AND ARISTOTLE ’ S FOUR CAUSES , 2013 .

[27]  Sotaro Kita,et al.  The Effect of Left-Hand Gestures on Metaphor Explanation , 2013, CogSci.

[28]  Susan Goldin-Meadow,et al.  Gestures, but not meaningless movements, lighten working memory load when explaining math , 2012, Language and cognitive processes.

[29]  Mitchell J. Nathan,et al.  Embodiment in Mathematics Teaching and Learning: Evidence From Learners' and Teachers' Gestures , 2012 .

[30]  Sotaro Kita,et al.  Gesture structure affects syntactic structure in speech , 2012, CogSci.

[31]  J. Gómez,et al.  Pointing gestures as a cognitive tool in young children: experimental evidence. , 2011, Journal of experimental child psychology.

[32]  Sotaro Kita,et al.  Spontaneous Gestures Influence Strategy Choices in Problem Solving , 2011, Psychological science.

[33]  Mike Stieff,et al.  When is a molecule three dimensional? A task-specific role for imagistic reasoning in advanced chemistry† , 2011 .

[34]  Autumn B. Hostetter,et al.  When do gestures communicate? A meta-analysis. , 2011, Psychological bulletin.

[35]  S. Kita,et al.  The nature of gestures ' beneficial role in spatial problem solving , 2013 .

[36]  Martha W. Alibali,et al.  Cognitive skills and gesture–speech redundancy: Formulation difficulty or communicative strategy? , 2011 .

[37]  Martha W. Alibali,et al.  Gesture During Mental Rotation , 2011, CogSci.

[38]  Susan Goldin-Meadow,et al.  Action’s Influence on Thought: The Case of Gesture , 2010, Perspectives on psychological science : a journal of the Association for Psychological Science.

[39]  Sian L. Beilock,et al.  Gesture Changes Thought by Grounding It in Action , 2010, Psychological science.

[40]  Martha W. Alibali,et al.  Language, gesture, action! A test of the Gesture as Simulated Action framework , 2010 .

[41]  Ben Fletcher,et al.  The Semantic Specificity Hypothesis: When Gestures Do Not Depend Upon the Presence of a Listener , 2010 .

[42]  D. Casasanto,et al.  Motor action and emotional memory , 2010, Cognition.

[43]  Martha W. Alibali,et al.  Gesture highlights perceptually present information for speakers , 2010 .

[44]  Michael K. Tanenhaus,et al.  Embodied communication: Speakers’ gestures affect listeners’ actions , 2009, Cognition.

[45]  Sotaro Kita,et al.  Competing conceptual representations trigger co-speech representational gestures , 2009 .

[46]  Jürgen Streeck,et al.  Gesturecraft: The manu-facture of meaning , 2009 .

[47]  S. Goldin-Meadow,et al.  Gesturing Gives Children New Ideas About Math , 2009, Psychological science.

[48]  Sotaro Kita,et al.  Co-speech gestures do not originate from speech production processes: Evidence from the relationship between co-thought and co-speech gestures , 2009 .

[49]  S. Goldin-Meadow,et al.  The natural order of events: How speakers of different languages represent events nonverbally , 2008, Proceedings of the National Academy of Sciences.

[50]  Melissa Singer,et al.  The Role of Gesture in Meaning Construction , 2008 .

[51]  A. Cienki,et al.  Metaphor and Gesture , 2008 .

[52]  Autumn B. Hostetter,et al.  Visible embodiment: Gestures as simulated action , 2008, Psychonomic bulletin & review.

[53]  Kenneth R. Koedinger,et al.  Trade-Offs Between Grounded and Abstract Representations: Evidence From Algebra Problem Solving , 2008, Cogn. Sci..

[54]  S. Goldin-Meadow,et al.  Gesturing makes learning last , 2008, Cognition.

[55]  S. Kita,et al.  Spontaneous gestures during mental rotation tasks: insights into the microdevelopment of the motor strategy. , 2008, Journal of experimental psychology. General.

[56]  S. Goldin-Meadow,et al.  Making children gesture brings out implicit knowledge and leads to learning. , 2007, Journal of experimental psychology. General.

[57]  K. Pine,et al.  The effects of prohibiting gestures on children's lexical retrieval ability. , 2007, Developmental science.

[58]  M. Swerts,et al.  The Effects of Visual Beats on Prosodic Prominence: Acoustic Analyses, Auditory Perception and Visual Perception. , 2007 .

[59]  Sotaro Kita,et al.  Conceptualisation load triggers gesture production , 2007 .

[60]  Sotaro Kita,et al.  Metaphor explanation attenuates the right-hand preference for depictive co-speech gestures that imitate actions , 2007, Brain and Language.

[61]  Martha W. Alibali,et al.  I see it in my hands’ eye: Representational gestures reflect conceptual demands , 2007 .

[62]  A. Garnham,et al.  The role of conversational hand gestures in a narrative task , 2007 .

[63]  Emiel Krahmer,et al.  The Effects of Visual Beats on Prosodic Prominence: Acoustic Analyses, Auditory Perception and Visual Perception. , 2007 .

[64]  Stacy B. Ehrlich,et al.  The importance of gesture in children's spatial reasoning. , 2006, Developmental psychology.

[65]  Kirsten R. Butcher Learning from Text with Diagrams: Promoting Mental Model Development and Inference Generation. , 2006 .

[66]  C. Lévi-Strauss,et al.  Experimental investigation , 2013 .

[67]  Mary Hegarty,et al.  The Role of Gestures in Mental Animation , 2005, Spatial Cogn. Comput..

[68]  Susan M. Wagner,et al.  How our hands help us learn , 2005, Trends in Cognitive Sciences.

[69]  D. McNeill Gesture and Thought , 2005 .

[70]  K. Pine,et al.  More gestures than answers: children learning about balance. , 2004, Developmental psychology.

[71]  A. Kendon Gesture: Visible Action as Utterance , 2004 .

[72]  Susan M. Wagner,et al.  Probing the Mental Representation of Gesture: Is Handwaving Spatial?. , 2004 .

[73]  Ezequiel Morsella,et al.  The role of gestures in spatial working memory and speech. , 2004, The American journal of psychology.

[74]  James E. Driskell,et al.  The Effect of Gesture on Speech Production and Comprehension , 2003, Hum. Factors.

[75]  H. H. Clark Pointing and placing. , 2003 .

[76]  Sotaro Kita,et al.  What does cross-linguistic variation in semantic coordination of speech and gesture reveal? Evidence for an interface representation of spatial thinking and speaking , 2003 .

[77]  S. Goldin-Meadow,et al.  Hearing Gesture: How Our Hands Help Us Think , 2003 .

[78]  Margaret Wilson,et al.  Six views of embodied cognition , 2002, Psychonomic bulletin & review.

[79]  G. Lakoff,et al.  Where mathematics comes from : how the embodied mind brings mathematics into being , 2002 .

[80]  Susan M. Wagner,et al.  Explaining Math: Gesturing Lightens the Load , 2001, Psychological science.

[81]  M. Alibali,et al.  Effects of Visibility between Speaker and Listener on Gesture Production: Some Gestures Are Meant to Be Seen , 2001 .

[82]  Sotaro Kita,et al.  Cultural specificity of spatial schemas as manifested in spontaneous gestures. , 2001 .

[83]  R Wesp,et al.  Gestures maintain spatial imagery. , 2001, The American journal of psychology.

[84]  M. Alibali,et al.  Gesture and the process of speech production: We think, therefore we gesture , 2000 .

[85]  Sotaro Kita,et al.  How representational gestures help speaking , 2000 .

[86]  J. D. Ruiter The production of gesture and speech , 2000 .

[87]  Yihsiu Chen,et al.  Language and Gesture: Lexical gestures and lexical access: a process model , 2000 .

[88]  Mark Rowlands,et al.  The body in mind , 1999 .

[89]  Pierre Feyereisen,et al.  Mental Imagery and Production of Hand Gestures While Speaking in Younger and Older Adults , 1999 .

[90]  G. Beattie,et al.  An experimental investigation of the role of iconic gestures in lexical access using the tip-of-the-tongue phenomenon. , 1999, British journal of psychology.

[91]  R. Guttentag,et al.  THE EFFECTS OF RESTRICTING HAND GESTURE PRODUCTION ON LEXICAL RETRIEVAL AND FREE RECALL , 1998 .

[92]  Cornelia Müller,et al.  Redebegleitende Gesten : Kulturgeschichte, Theorie, Sprachvergleich , 1998 .

[93]  Sotaro Kita,et al.  Movement Phase in Signs and Co-Speech Gestures, and Their Transcriptions by Human Coders , 1997, Gesture Workshop.

[94]  Susan Goldin-Meadow,et al.  Assessing knowledge conveyed in gesture : Do teachers have the upper hand ? , 1997 .

[95]  B. Butterworth,et al.  Iconic gestures, imagery, and word retrieval in speech , 1997 .

[96]  Jürgen Streeck,et al.  How to do things with things , 1996 .

[97]  Daniel L. Schwartz,et al.  Shuttling Between Depictive Models and Abstract Rules: Induction and Fallback , 1996, Cogn. Sci..

[98]  R. Krauss,et al.  PSYCHOLOGICAL SCIENCE Research Article GESTURE, SPEECH, AND LEXICAL ACCESS: The Role of Lexical Movements in Speech Production , 2022 .

[99]  A. Kendon Do Gestures Communicate? A Review , 1994 .

[100]  P. Johnson-Laird,et al.  PSYCHOLOGICAL SCIENCE Research Article HOW DIAGRAMS CAN IMPROVE REASONING , 2022 .

[101]  M. Alibali,et al.  Gesture-Speech Mismatch and Mechanisms of Learning: What the Hands Reveal about a Child′s State of Mind , 1993, Cognitive Psychology.

[102]  M. Alibali,et al.  Transitions in concept acquisition: using the hand to read the mind. , 1993, Psychological review.

[103]  S. Goldin-Meadow,et al.  Assessing Knowledge Through Gesture: Using Children's Hands to Read Their Minds , 1992 .

[104]  D. McNeill Hand and Mind: What Gestures Reveal about Thought , 1992 .

[105]  K. Bock Regulating mental energy: Performance units in language production , 1992 .

[106]  J. Annett Relations between verbal and gestural explanations , 1990 .

[107]  W. Levelt,et al.  Speaking: From Intention to Articulation , 1990 .

[108]  B. Butterworth,et al.  Gesture, speech, and computational stages: a reply to McNeill. , 1989, Psychological review.

[109]  Susan Goldin-Meadow,et al.  Transitional knowledge in the acquisition of concepts , 1988 .

[110]  Mark L. Johnson The body in the mind: the bodily basis of meaning , 1987 .

[111]  S. Goldin-Meadow,et al.  The mismatch between gesture and speech as an index of transitional knowledge , 1986, Cognition.

[112]  Bernard Rimé,et al.  Effects of relative immobilization on the speaker's nonverbal behavior and on the dialogue imagery level , 1984 .

[113]  G. Lakoff,et al.  Metaphors We Live by , 1982 .

[114]  J. Gibson The Ecological Approach to Visual Perception , 1979 .

[115]  Giyoo Hatano,et al.  Performance of expert abacus operators , 1977, Cognition.

[116]  N. Freedman Hands, Words, and Mind: On the Structuralization of Body Movements During Discourse and the Capacity for Verbal Representation , 1977 .

[117]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[118]  P. Ekman,et al.  The Repertoire of Nonverbal Behavior: Categories, Origins, Usage, and Coding , 1969 .

[119]  J. Guilford,et al.  The nature of human intelligence. , 1968 .

[120]  Ralph H. Peterson Can You Handle It? , 1959 .

[121]  E. Goffman The Presentation of Self in Everyday Life , 1959 .

[122]  A. Anastasi Individual differences. , 2020, Annual review of psychology.