To gesture or not to gesture: what is the question?

Computer synthesized characters are expected to make appropriate face, limb, and body gestures during communicative acts. We focus on non-facial movements and try to elucidate what is intended with the notions of "gesture" and "naturalness". We argue that looking only at the psychological notion of gesture and gesture type is insufficient to capture movement qualities needed by an animated character. Movement observation science, specifically Laban Movement Analysis and its Effort and Shape components with motion phrasing provide essential gesture components (I. Bartenieff and D. Lewis, 1980). We assert that the expression of movement qualities from the Effort dimensions are needed to make a gesture naturally crystallize out of abstract movements. Finally, we point out that nonfacial gestures must involve the rest of the body to appear natural and convincing. A system called EMOTE has been implemented which applies parameterized Effort and Shape qualities to movements and thereby forms improved synthetic gestures.

[1]  W. Lamb.  Posture and gesture : an introduction to the study of physical behaviour , 1965 .

[2]  Justine Cassell,et al.  Embodied conversational interface agents , 2000, CACM.

[3]  F. Thomas,et al.  The illusion of life : Disney animation , 1981 .

[4]  John Lasseter,et al.  Principles of traditional animation applied to 3D computer animation , 1987, SIGGRAPH.

[5]  I. Bartenieff,et al.  Body Movement: Coping with the Environment , 1980 .

[6]  Justine Cassell,et al.  BodyChat: autonomous communicative behaviors in avatars , 1998, AGENTS '98.

[7]  D. McNeill.  Hand and Mind: What Gestures Reveal about Thought , 1992 .

[8]  Norman I. Badler,et al.  A motion control scheme for animating expressive arm movements , 1999 .

[9]  Norman I. Badler,et al.  Digital Representations of Human Movement , 1979, CSUR.

[10]  Norman I. Badler,et al.  Virtual human animation based on movement observation and cognitive behavior models , 1999, Proceedings Computer Animation 1999.

[11]  C. Creider.  Hand and Mind: What Gestures Reveal about Thought , 1994 .

[12]  D. Thalmann,et al.  A behavioral animation system for autonomous actors personified by emotions , 1998 .

[13]  A. Kendon.  Gesticulation and Speech: Two Aspects of the Process of Utterance , 1981 .

[14]  Tolga Capin,et al.  Avatars in Networked Virtual Environments , 1999 .

[15]  Mark Steedman,et al.  Animated conversation: rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents , 1994, SIGGRAPH.

[16]  J. Cassell,et al.  More Than Just Another Pretty Face: Embodied Conversational Interface Agents , 1999 .