Gesticulation behaviors for virtual humans

Gesture and speech are two very important behaviors for virtual humans. They are not isolated from each other but generally employed simultaneously in the service of the same intention. An underlying PaT-Net parallel finite state machine may be used to coordinate them both. Gesture selection is not arbitrary. Typical movements correlated with specific textual elements are used to select and produce gesticulation online. This enhances the expressiveness of speaking virtual humans.

[1]  M. B. Emeneau,et al.  The Gesture Language of the Hindu Dance , 1942 .

[2]  Ted Shawn.  Every little movement : a book about François Delsarte, the man and his philosophy, his science and applied aesthetics, the application of this science to the art of the dance, the influence of Delsarte on American dance , 1968 .

[3]  M. Wiener,et al.  Nonverbal behavior and nonverbal communication , 1972 .

[4]  John Bulwer.  Chirologia or the Natural Language of the Hand , 1974 .

[5]  N. Freedman,et al.  Communicative Structures and Psychic Structures , 1977, The Downstate Series of Research in Psychiatry and Psychology.

[6]  N. Freedman.  Hands, Words, and Mind: On the Structuralization of Body Movements During Discourse and the Capacity for Verbal Representation , 1977 .

[7]  W. Lamb,et al.  Body Code: The Meaning in Movement , 1979 .

[8]  David McNeill,et al.  The conceptual basis of language , 1979 .

[9]  A. Kendon.  Gesticulation and Speech: Two Aspects of the Process of Utterance , 1981 .

[10]  Martha Davis.  Understanding Body Movement: An Annotated Bibliography , 1982 .

[11]  A. Lecours,et al.  The Biological foundations of gestures : motor and semiotic aspects , 1986 .

[12]  Daniel Thalmann,et al.  Simulation of object and human skin formations in a grasping task , 1989, SIGGRAPH.

[13]  Michael M. Cohen,et al.  Modeling Coarticulation in Synthetic Visual Speech , 1993 .

[14]  Norman I. Badler,et al.  Simulating humans: computer graphics animation and control , 1993 .

[15]  William T. Freeman,et al.  Television control by hand gestures , 1994 .

[16]  Mark Steedman,et al.  Animated conversation: rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents , 1994, SIGGRAPH.

[17]  Francis K. H. Quek,et al.  Toward a vision-based hand gesture interface , 1994 .

[18]  Yuntao Cui,et al.  Learning-based hand sign recognition using SHOSLIF-M , 1995, Proceedings of IEEE International Conference on Computer Vision.

[19]  Ken-ichi Anjyo,et al.  Fourier principles for emotion-based human figure animation , 1995, SIGGRAPH.

[20]  Lance Williams,et al.  Motion signal processing , 1995, SIGGRAPH.

[21]  Norman I. Badler,et al.  Casualty Modeling for Real-Time Medical Training , 1996, Presence: Teleoperators & Virtual Environments.

[22]  Norman I. Badler,et al.  Task-Level Object Grasping for Simulated Agents , 1996, Presence: Teleoperators & Virtual Environments.

[23]  Christopher W. Geib,et al.  Planning for animation , 1996 .

[24]  Ken Perlin,et al.  Improv: a system for scripting interactive actors in virtual worlds , 1996, SIGGRAPH.

[25]  Michael F. Cohen,et al.  Efficient generation of motion transitions using spacetime constraints , 1996, SIGGRAPH.

[26]  Daniel Thalmann,et al.  Integration of motion control techniques for virtual human and avatar real-time animation , 1997, VRST '97.

[27]  Norman I. Badler,et al.  Real-time virtual humans , 1997, Proceedings The Fifth Pacific Conference on Computer Graphics and Applications.

[28]  Norman I. Badler,et al.  A Virtual Human Presenter , 1997 .

[29]  Norman I. Badler,et al.  Virtual humans for animation, ergonomics, and simulation , 1997, Proceedings IEEE Nonrigid and Articulated Motion Workshop.

[30]  Norman I. Badler,et al.  Animating expressivity through effort elements , 1999, SIGGRAPH '99.