Gesture and speech in interaction: An overview

Gestures and speech interact. They are linked in language production and perception, with their interaction contributing to felicitous communication. The multifaceted nature of these interactions has attracted considerable attention from the speech and gesture community. This article provides an overview of our current understanding of manual and head gesture form and function, of the principle functional interactions between gesture and speech aiding communication, transporting meaning and producing speech. Furthermore, we present an overview of research on temporal speech-gesture synchrony, including the special role of prosody in speech-gesture alignment. In addition, we provide a summary of tools and data available for gesture analysis, and describe speech-gesture interaction models and simulations in technical systems. This overview also serves as an introduction to a Special Issue covering a wide range of articles on these topics. We provide links to the Special Issue throughout this paper.

[1]  D. Bolinger.  INTONATION AND GESTURE , 1983 .

[2]  J. Ohala,et al.  An Ethological Perspective on Common Cross-Language Utilization of F₀ of Voice , 1984, Phonetica.

[3]  M. Swerts,et al.  The Effects of Visual Beats on Prosodic Prominence: Acoustic Analyses, Auditory Perception and Visual Perception. , 2007 .

[4]  Roman Jakobson,et al.  Motor signs for ‘Yes’ and ‘No’ , 1972, Language in Society.

[5]  Stefan Kopp,et al.  Individualized Gesturing Outperforms Average Gesturing - Evaluating Gesture Production in Virtual Humans , 2010, IVA.

[6]  Stefanie Shattuck-Hufnagel,et al.  THE TIMING OF SPEECH-ACCOMPANYING GESTURES WITH RESPECT TO PROSODY , 2004 .

[7]  D. Loehr,et al.  Temporal, structural, and pragmatic synchrony between intonation and gesture , 2012 .

[8]  Laura Vincze,et al.  Types of Nods. The Polysemy of a Social Signal , 2010, LREC.

[9]  Fred Cummins,et al.  The temporal relation between beat gestures and speech , 2011 .

[10]  A. Kendon.  Gesture: Visible Action as Utterance , 2004 .

[11]  Martha W. Alibali,et al.  Raise your hand if you’re spatial: Relations between verbal and spatial skills and gesture production , 2007 .

[12]  Michael Neff,et al.  An annotation scheme for conversational gestures: how to economically capture timing and form , 2007, Lang. Resour. Evaluation.

[13]  Betty Tuller,et al.  A “Dynamic Pattern” Perspective on the Control and Coordination of Movement , 1983 .

[14]  Maurizio Gentilucci,et al.  The motor system and the relationships between speech and gesture , 2007 .

[15]  David McNeill,et al.  So you do think gestures are nonverbalp Reply to Feyereisen (1987). , 1987 .

[16]  Hennie Brugman,et al.  Annotating Multi-media/Multi-modal Resources with ELAN , 2004, LREC.

[17]  Stefan Kopp,et al.  Systematicity and Idiosyncrasy in Iconic Gesture Use: Empirical Analysis and Computational Modeling , 2009, Gesture Workshop.

[18]  S. Goldin-Meadow,et al.  Beyond words: the importance of gesture to researchers and learners. , 2000, Child development.

[19]  Sotaro Kita,et al.  How representational gestures help speaking , 2000 .

[20]  Emiel Krahmer,et al.  Does our speech change when we cannot gesture? , 2014, Speech Commun..

[21]  A. Dittmann,et al.  Relationship between vocalizations and head nods as listener responses. , 1968, Journal of personality and social psychology.

[22]  Justine Cassell,et al.  Recovering the temporal structure of natural gesture , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[23]  Stefan Kopp,et al.  The Behavior Markup Language: Recent Developments and Challenges , 2007, IVA.

[24]  Judith Holler,et al.  Handling pain: The semantic interplay of speech and co-speech hand gestures in the description of pain sensations , 2013, Speech Commun..

[25]  Susan Shaiman,et al.  Effects of perturbation and prosody on the coordination of speech and gesture , 2014, Speech Commun..

[26]  Zofia Malisz,et al.  Listener head gestures and verbal feedback expressions in a distraction task , 2012, Interspeech 2012.

[27]  Petra Wagner,et al.  Exploring annotation of head gesture forms in spontaneous human interaction. , 2013 .

[28]  Cynthia Breazeal,et al.  Detecting the Trustworthiness of Novel Partners in Economic Exchange , 2012, Psychological science.

[29]  Kirsten Bergmann,et al.  A Virtual Agent as Vocabulary Trainer: Iconic Gestures Help to Improve Learners' Memory Performance , 2013, IVA.

[30]  D. McNeill.  So you think gestures are nonverbal , 1985 .

[31]  Dirk Heylen,et al.  Listening Heads , 2006, ZiF Workshop.

[32]  Jeffery A. Jones,et al.  Visual Prosody and Speech Intelligibility , 2004, Psychological science.

[33]  A. Murat Tekalp,et al.  Analysis of Head Gesture and Prosody Patterns for Prosody-Driven Head-Gesture Animation , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Alan Cienki,et al.  Aktionsarten, Speech and Gesture , 2013 .

[35]  Loredana Cerrato,et al.  Investigating Communicative Feedback Phenomena across Languages and Modalities , 2007 .

[36]  Hedda Lausberg,et al.  Methods in Gesture Research: , 2009 .

[37]  H. Rosenfeld,et al.  The Nonverbal Context of Verbal Listener Responses , 1981 .

[38]  Elisabetta Bevacqua.  Computational model of listener behavior for Embodied Conversational Agents , 2010 .

[39]  U. Hadar,et al.  Head movement during listening turns in conversation , 1985 .

[40]  Ulrike Gut,et al.  Annotation and Analysis of Conversational Gestures in the TASX environment , 2003, Künstliche Intell..

[41]  Willem J. M. Levelt,et al.  Pointing and voicing in deictic expressions , 1985 .

[42]  Uri Hadar,et al.  The timing of shifts of head postures during conservation , 1984 .

[43]  Dirk Heylen,et al.  A Multimodal Analysis of Vocal and Visual Backchannels in Spontaneous Dialogs , 2011, INTERSPEECH.

[44]  Adam Kendon,et al.  Some uses of the head shake , 2002 .

[45]  Evelyn Z. McClave.  Linguistic functions of head movements in the context of speech , 2000 .

[46]  Dawn Knight,et al.  The future of multimodal corpora , 2011 .

[47]  Björn Granström,et al.  Analysis and Synthesis of Multimodal Verbal and Non-verbal Interaction for Animated Interface Agents , 2007, COST 2102 Workshop.

[48]  A. Murat Tekalp,et al.  Combined Gesture-Speech Analysis and Speech Driven Gesture Synthesis , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[49]  Cüneyt M. Taskiran,et al.  Head pose tracking and gesture detection using block motion vectors on mobile devices , 2007, Mobility '07.

[50]  J. Allwood,et al.  A study of gestural feedback expressions , 2006 .

[51]  Stefan Kopp,et al.  Modeling Embodied Feedback with Virtual Humans , 2006, ZiF Workshop.

[52]  A. Blakeman,et al.  Naso-occipital vestibulo-ocular reflex responses in normal subjects , 2000, IEEE Engineering in Medicine and Biology Magazine.

[53]  Hiroshi Ishiguro,et al.  Analysis of relationship between head motion events and speech in dialogue conversations , 2014, Speech Communication.

[54]  R. Mayer,et al.  An embodiment effect in computer-based learning with animated pedagogical agents. , 2012, Journal of experimental psychology. Applied.

[55]  S. Goldin-Meadow,et al.  The role of gesture in communication and thinking , 1999, Trends in Cognitive Sciences.

[56]  Stefan Kopp,et al.  Towards a Common Framework for Multimodal Generation: The Behavior Markup Language , 2006, IVA.

[57]  Ying Wu,et al.  Vision-Based Gesture Recognition: A Review , 1999, Gesture Workshop.

[58]  Gaëlle Ferré,et al.  A multimodal approach to markedness in spoken French , 2014, Speech Commun..

[59]  J. Pierrehumbert,et al.  Intonational structure in Japanese and English , 1986, Phonology.

[60]  Andrea Corradini.  Real-Time Gesture Recognition by Means of Hybrid Recognizers , 2001, Gesture Workshop.

[61]  Samuel R. Buss,et al.  3D Computer Graphics: A Mathematical Introduction with OpenGL , 2003 .

[62]  D. McNeill,et al.  A straight path-to where? Reply to Butterworth and Hadar. , 1989, Psychological review.

[63]  Stacy Marsella,et al.  Nonverbal Behavior Generator for Embodied Conversational Agents , 2006, IVA.

[64]  K. Tuite.  The production of gesture , 1993 .

[65]  Stan Sclaroff,et al.  Automatic detection of relevant head gestures in American Sign Language communication , 2002, Object recognition supported by user interaction for service robots.

[66]  Peter Wittenburg,et al.  Multimodal Annotations in Gesture and Sign Language Studies , 2002, LREC.

[67]  Dirk Heylen,et al.  First Impressions: Users' Judgments of Virtual Agents' Personality and Interpersonal Attitude in First Encounters , 2012, IVA.

[68]  J. Cassell.  Computer Vision for Human–Machine Interaction: A Framework for Gesture Generation and Interpretation , 1998 .

[69]  Jan Peter De Ruiter,et al.  On the audiovisual integration of speech and gesture , 2012 .

[70]  Gaëlle Ferré,et al.  Timing Relationships between Speech and Co-Verbal Gestures in Spontaneous French , 2010, LREC 2010.

[71]  Uri Hadar,et al.  Kinematics of head movements accompanying speech during conversation , 1983 .

[72]  Jean-Marc Odobez,et al.  Using self-context for multimodal detection of head nods in face-to-face interactions , 2012, ICMI '12.

[73]  Jörg Peters,et al.  Gesprächsanalytisches Transkriptionssystem 2 (GAT 2) , 2009 .

[74]  Maja Pantic,et al.  Towards the automatic detection of spontaneous agreement and disagreement based on nonverbal behaviour: A survey of related cues, databases, and tools , 2013, Image Vis. Comput..

[75]  M. Selting.  Gesprächsanalytisches Transkriptionssystem (GAT): 2102 , 1998 .

[76]  Stefan Kopp,et al.  Verbal or Visual? How Information is Distributed across Speech and Gesture in Spatial Dialog , 2006 .

[77]  Bülent Sankur,et al.  Robust classification of face and head gestures in video , 2011, Image Vis. Comput..

[78]  Frank A. Pintar,et al.  Physical properties of the human head: mass, center of gravity and moment of inertia. , 2009, Journal of biomechanics.

[79]  D. Heylen.  Challenges ahead: head movements and other social acts during conversations , 2005 .

[80]  Mark T. Maybury,et al.  Multimedia Annotation, Querying, and Analysis in Anvil , 2011 .

[81]  Theodore Raphan,et al.  Rotation axes of the head during positioning, head shaking, and locomotion. , 2007, Journal of neurophysiology.

[82]  Peng Lu,et al.  Head Gesture Recognition Based on Bayesian Network , 2005, IbPRIA.

[83]  Francesc Alías,et al.  Gesture synthesis adapted to speech emphasis , 2014, Speech Commun..

[84]  A.C.M. Rietveld,et al.  On the relation between pitch excursion size and prominence , 1985 .

[85]  Trevor Darrell,et al.  Contextual recognition of head gestures , 2005, ICMI '05.

[86]  M. Dohen,et al.  Pointing is 'special' , 2009 .

[87]  Jean-Luc Schwartz,et al.  The speech focus position effect on jaw-finger coordination in a pointing task. , 2008, Journal of speech, language, and hearing research : JSLHR.

[88]  J. Holler,et al.  The Effect of Common Ground on How Speakers Use Gesture and Speech to Represent Size Information , 2007 .

[89]  D. Bolinger.  Intonation and its parts : melody in spoken English , 1987 .

[90]  Louis Goldstein,et al.  Towards an articulatory phonology , 1986, Phonology.

[91]  Kawai Chui,et al.  Temporal patterning of speech and iconic gestures in conversational discourse , 2005 .

[92]  Sotaro Kita,et al.  Movement Phase in Signs and Co-Speech Gestures, and Their Transcriptions by Human Coders , 1997, Gesture Workshop.

[93]  Carolin Kirchhof,et al.  So What's Your Affiliation With Gesture? , 2011 .

[94]  Matthew Stone,et al.  Speaking with hands: creating animated conversational characters from recordings of human performance , 2004, SIGGRAPH 2004.

[95]  J. Cassell,et al.  Embodied conversational agents , 2000 .

[96]  Craig Martell.  FORM: An Extensible, Kinematically-based Gesture Annotation Scheme , 2002, LREC.

[97]  A. Kendon.  Some Relationships Between Body Motion and Speech , 1972 .

[98]  M. Alibali,et al.  The function of gesture in learning to count: more than keeping track * , 1999 .

[99]  Peter Bull,et al.  Body movement and emphasis in speech , 1985 .

[100]  M. Alibali,et al.  Effects of Visibility between Speaker and Listener on Gesture Production: Some Gestures Are Meant to Be Seen , 2001 .

[101]  Jeesun Kim,et al.  Tracking eyebrows and head gestures associated with spoken prosody , 2014, Speech Commun..

[102]  Hans-Peter Seidel,et al.  Annotated New Text Engine Animation Animation Lexicon Animation Gesture Profiles MR : . . . JL : . . . Gesture Generation Video Annotated Gesture Script , 2007 .

[103]  Michael Kipp,et al.  Gesture generation by imitation: from human behavior to computer character animation , 2005 .

[104]  Jürgen Streeck,et al.  Depicting by gesture , 2008 .

[105]  Costanza Navarretta,et al.  The MUMIN coding scheme for the annotation of feedback, turn management and sequencing phenomena , 2007, Lang. Resour. Evaluation.

[106]  Jan Peter de Ruiter,et al.  The Interplay Between Gesture and Speech in the Production of Referring Expressions: Investigating the Tradeoff Hypothesis , 2012, Top. Cogn. Sci..

[107]  R. Krauss,et al.  The Role of Speech-Related Arm/Hand Gestures in Word Retrieval , 2001 .

[108]  Brian Butterworth,et al.  Gesture and Silence as Indicators of Planning in Speech , 1978 .

[109]  Zeshu Shao,et al.  The Role of Synchrony and Ambiguity in Speech–Gesture Integration during Comprehension , 2011, Journal of Cognitive Neuroscience.

[110]  Piero Cosi,et al.  Multimodal Score: an ANVIL based Annotation scheme for multimodal audio-video analysis , 2004 .

[111]  H. H. Clark,et al.  Referring as a collaborative process , 1986, Cognition.

[112]  Mariët Theune,et al.  To Beat or Not to Beat: Beat Gestures in Direction Giving , 2009, Gesture Workshop.

[113]  Yukiko I. Nakano,et al.  Estimating User's Conversational Engagement Based on Gaze Behaviors , 2008, IVA.

[114]  Judith Holler,et al.  Pragmatic aspects of representational gestures: Do speakers use them to clarify verbal ambiguity for the listener? , 2003 .

[115]  Zsófia Ruttkay,et al.  Presenting in Style by Virtual Humans , 2007, COST 2102 Workshop.

[116]  Autumn B. Hostetter,et al.  Effects of personality and social situation on representational gesture production , 2012 .

[117]  Núria Esteve-Gibert,et al.  Infants temporally coordinate gesture-speech combinations before they produce their first words , 2014, Speech Commun..

[118]  Alan Cienki,et al.  Metaphor, gesture, and thought , 2008 .

[119]  D. McNeill.  Gesture and Thought , 2005 .

[120]  Wolff‐Michael Roth.  Gestures: Their Role in Teaching and Learning , 2001 .

[121]  D. Bolinger.  Contrastive Accent and Contrastive Stress , 1961 .

[122]  Emiel Krahmer,et al.  Facial expression and prosodic prominence: Effects of modality and facial area , 2008, J. Phonetics.

[123]  Stefan Kopp,et al.  The Relation of Speech and Gestures: Temporal Synchrony Follows Semantic Synchrony , 2011 .

[124]  Björn Granström,et al.  Inside out - Acoustic and visual aspects of verbal and non-verbal communication : Keynote Paper , 2007 .

[125]  J. Bavelas,et al.  Listener Responses as a Collaborative Process: The Role of Gaze , 2002 .

[126]  C. Goodwin.  Conversational Organization: Interaction Between Speakers and Hearers , 1981 .

[127]  M. Swerts,et al.  Prosody as a Marker of Information Flow in Spoken Discourse , 1994 .

[128]  M. Alibali,et al.  Transitions in concept acquisition: using the hand to read the mind. , 1993, Psychological review.

[129]  D. McNeill.  Hand and Mind: What Gestures Reveal about Thought , 1992 .

[130]  Stephanie D. Teasley,et al.  Perspectives on socially shared cognition , 1991 .

[131]  J. Goldsmith.  Autosegmental and Metrical Phonology , 1990 .

[132]  D. Slobin.  From “thought and language” to “thinking for speaking” , 1996 .

[133]  Petra Wagner,et al.  Evaluating a minimally invasive laboratory architecture for recording multimodal conversational data , 2012, Interspeech 2012.

[134]  Alan Wexelblat,et al.  An approach to natural gesture in virtual environments , 1995, TCHI.

[135]  Dani Byrd,et al.  Spatiotemporal coupling between speech and manual motor actions , 2014, J. Phonetics.

[136]  Janet Beavin Bavelas,et al.  Gestures as Part of Speech: Methodological Implications , 1994 .

[137]  Julia Hirschberg,et al.  Turn-taking cues in task-oriented dialogue , 2011, Comput. Speech Lang..

[138]  Paul Boersma,et al.  Praat, a system for doing phonetics by computer , 2002 .

[139]  Jean-Claude Martin,et al.  Gesture and emotion: Can basic gestural form features discriminate emotions? , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[140]  Alistair D. N. Edwards,et al.  Hand Tension as a Gesture Segmentation Cue , 1996, Gesture Workshop.

[141]  Thomas C. Schmidt.  Transcribing and annotating spoken language with EXMARaLDA , 2004 .

[142]  Jana Bressem,et al.  Rethinking gesture phases: Articulatory features of gestural movement? , 2011 .

[143]  E. Schegloff.  Structures of Social Action: On some gestures' relation to talk , 1985 .

[144]  Paul Jaak Treffner,et al.  Gestures and Phases: The Dynamics of Speech-Hand Communication , 2008 .

[145]  Nicholas Christenfeld,et al.  Filled pauses and gestures: It's not coincidence , 1991 .

[146]  E. Thelen,et al.  Hand, mouth and brain. The dynamic emergence of speech and gesture , 1999 .

[147]  S. Duncan,et al.  Some Signals and Rules for Taking Speaking Turns in Conversations , 1972 .

[148]  Palmer Morrel-Samuels,et al.  Word familiarity predicts temporal asynchrony of hand gestures and speech. , 1992 .

[149]  Kristinn R. Thórisson,et al.  Integrating Simultaneous Input from Speech, Gaze, and Hand Gestures , 1991, AAAI Workshop on Intelligent Multimedia Interfaces.

[150]  Sotaro Kita,et al.  What does cross-linguistic variation in semantic coordination of speech and gesture reveal? Evidence for an interface representation of spatial thinking and speaking , 2003 .

[151]  Maurizio Mancini,et al.  Implementing Expressive Gesture Synthesis for Embodied Conversational Agents , 2005, Gesture Workshop.

[152]  Takaaki Kuratate,et al.  Linking facial animation, head motion and speech acoustics , 2002, J. Phonetics.

[153]  Carlos Gussenhoven,et al.  Discreteness and Gradience in Intonational Contrasts , 1999 .

[154]  Herbert H. Clark,et al.  Grounding in communication , 1991, Perspectives on socially shared cognition.

[155]  S. Goldin-Meadow,et al.  Why people gesture when they speak , 1998, Nature.

[156]  Stefan Kopp,et al.  Increasing the expressiveness of virtual agents: autonomous generation of speech and gesture for spatial description tasks , 2009, AAMAS.

[157]  Peter Hagoort,et al.  Exploring the cognitive infrastructure of communication , 2012 .

[158]  Gerhard Rigoll,et al.  Hidden Markov model based continuous online gesture recognition , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[159]  A. Dittmann,et al.  Body movement and speech rhythm in social conversation. , 1969, Journal of personality and social psychology.

[160]  Stefan Kopp,et al.  Data-based analysis of speech and gesture: the Bielefeld Speech and Gesture Alignment corpus (SaGA) and its applications , 2013, Journal on Multimodal User Interfaces.

[161]  M. Alibali,et al.  Gesture and the process of speech production: We think, therefore we gesture , 2000 .

[162]  Petra Wagner,et al.  D64: a corpus of richly recorded conversational interaction , 2013, Journal on Multimodal User Interfaces.

[163]  Susan M. Wagner,et al.  Explaining Math: Gesturing Lightens the Load , 2001, Psychological science.

[164]  Loredana Cerrato,et al.  A method for the detection of communicative head nods in expressive speech , 2006 .

[165]  Anders Eriksson,et al.  Syllable prominence: a matter of vocal effort, phonetic distinct-ness and top-down processing , 2001, INTERSPEECH.

[166]  A. Altorfer,et al.  Measurement and meaning of head movements in everyday face-to-face communicative interaction , 2000, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[167]  Seiichi Yamamoto,et al.  On eye-gaze and turn-taking , 2010, EGIHMI '10.

[168]  J. D. Ruiter.  The production of gesture and speech , 2000 .

[169]  Laura Vincze,et al.  Comments by words, face and body , 2012, Journal on Multimodal User Interfaces.

[170]  Rick Dale,et al.  Behavior Matching in Multimodal Communication Is Synchronized , 2012, Cogn. Sci..

[171]  Ray L. Birdwhistell,et al.  Introduction to kinesics : an annotation system for analysis of body motion and gesture , 1952 .

[172]  Dafydd Gibbon,et al.  CoGesT: a Formal Transcription System for Conversational Gesture , 2004, LREC.

[173]  Stacy Marsella,et al.  How to Train Your Avatar: A Data Driven Approach to Gesture Generation , 2011, IVA.

[174]  Isabella Poggi.  The Lexicon and the Alphabet of Gesture, Gaze, and Touch , 2001, IVA.

[175]  Björn Granström,et al.  Auditory visual prominence , 2009, Journal on Multimodal User Interfaces.

[176]  Susan Goldin-Meadow,et al.  Using the Hands to Identify Who Does What to Whom: Gesture and Speech Go Hand-in-Hand , 2009, Cogn. Sci..

[177]  Michael Kipp,et al.  From Human Gesture to Synthetic Action , 2001 .

[178]  Mattias Heldner,et al.  Continuer relevance spaces , 2012 .

[179]  B. Butterworth,et al.  Gesture, speech, and computational stages: a reply to McNeill. , 1989, Psychological review.

[180]  Stefan Kopp,et al.  Generation and Evaluation of Communicative Robot Gesture , 2012, Int. J. Soc. Robotics.

[181]  Martha W. Alibali,et al.  I see it in my hands’ eye: Representational gestures reflect conceptual demands , 2007 .

[182]  Z. Vendler.  Linguistics in Philosophy , 1967 .

[183]  S. Jun,et al.  Prosodic typology : the phonology of intonation and phrasing , 2014 .

[184]  Sotaro Kita,et al.  On-line Integration of Semantic Information from Speech and Gesture: Insights from Event-related Brain Potentials , 2007, Journal of Cognitive Neuroscience.

[185]  Roddy Cowie,et al.  Acoustic correlates of emotion dimensions in view of speech synthesis , 2001, INTERSPEECH.

[186]  Evelyn McClave,et al.  Gestural beats: The rhythm hypothesis , 1994 .

[187]  Stefan Kopp,et al.  Towards integrated microplanning of language and iconic gesture for multimodal output , 2004, ICMI '04.

[188]  Janet Beavin Bavelas,et al.  Gesturing on the telephone: Independent effects of dialogue and visibility. , 2008 .

[189]  Dirk Heylen,et al.  Head Gestures, Gaze and the Principles of Conversational Structure , 2006, Int. J. Humanoid Robotics.

[190]  Stefan Kopp,et al.  A spreading-activation model of the semantic coordination of speech and gesture , 2013, CogSci.

[191]  Petra Wagner,et al.  On automatic prominence detection for German , 2007, INTERSPEECH.

[192]  Stefan Kopp,et al.  Modeling the Semantic Coordination of Speech and Gesture under Cognitive and Linguistic Constraints , 2013, IVA.

[193]  Autumn B. Hostetter,et al.  Visible embodiment: Gestures as simulated action , 2008, Psychonomic bulletin & review.

[194]  Sotaro Kita,et al.  Competing conceptual representations trigger co-speech representational gestures , 2009 .

[195]  C. Pelachaud,et al.  Generating Listening Behaviour , 2011 .

[196]  J. Terken.  Fundamental frequency and perceived prominence of accented syllables. , 1991, The Journal of the Acoustical Society of America.