Representing and parameterizing agent behaviors

The last few years have seen great maturation in understanding how to use computer graphics technology to portray 3D embodied characters or virtual humans. Unlike the off-line, animator-intensive methods used in the special effects industry, real-time embodied agents are expected to exist and interact with us "live." They can be represent other people or function as autonomous helpers, teammates, or tutors enabling novel interactive educational and training applications. We should be able to interact and communicate with them through modalities we already use, such as language, facial expressions, and gesture. Various aspects and issues in real-time virtual humans will be discussed, including consistent parameterizations for gesture and facial actions using movement observation principles, and the representational basis for character believability, personality, and affect. We also describe a Parameterized Action Representation (PAR) that allows an agent to act, plan, and reason about its actions or actions of others. Besides embodying the semantics of human action, the PAR is designed for building future behaviors into autonomous agents and controlling the animation parameters that portray personality, mood, and affect in an embodied agent.

[1]  Erik T. Ray,et al.  Learning XML , 2001 .

[2]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[3]  Daniel Thalmann,et al.  Navigation for digital actors based on synthetic vision, memory, and learning , 1995, Comput. Graph..

[4]  Norman I. Badler,et al.  Animation control for real-time virtual humans , 1999, CACM.

[5]  Nadia Magnenat-Thalmann,et al.  Modelling and Motion Capture Techniques for Virtual Environments , 1998, Lecture Notes in Computer Science.

[6]  Barry D. Reich,et al.  An architecture for behavioral locomotion , 1997 .

[7]  Norman I. Badler,et al.  Pedestrians: creating agent behaviors through statistical analysis of observation data , 2001, Proceedings Computer Animation 2001. Fourteenth Conference on Computer Animation (Cat. No.01TH8596).

[8]  Justine Cassell,et al.  BEAT: the Behavior Expression Animation Toolkit , 2001, Life-like characters.

[9]  Norman I. Badler,et al.  Dynamically altering agent behaviors using natural language instructions , 2000, AGENTS '00.

[10]  Norman I. Badler,et al.  Building parameterized action representations from observation , 2000 .

[11]  Catherine Pelachaud,et al.  Performative facial expressions in animated faces , 2001 .

[12]  John Yen,et al.  FLAME—Fuzzy Logic Adaptive Model of Emotions , 2000, Autonomous Agents and Multi-Agent Systems.

[13]  Norman I. Badler,et al.  Synthesis and acquisition of laban movement analysis qualitative parameters for communicative gestures , 2001 .

[14]  Joseph E LeDoux.  The emotional brain , 1996 .

[15]  J. Newlove,et al.  Laban for actors and dancers : putting Laban's movement theory into practice : a step-by-step guide , 1993 .

[16]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[17]  Martha Palmer,et al.  Representation of actions as an interlingua , 2000 .

[18]  J. Burgoon,et al.  Nonverbal Communication: The Unspoken Dialogue , 1988 .

[19]  A. Damasio.  Descartes’ Error. Emotion, Reason and the Human Brain. New York (Grosset/Putnam) 1994. , 1994 .

[20]  Norman I. Badler,et al.  Real-Time Inverse Kinematics of the Human Arm , 1996, Presence: Teleoperators & Virtual Environments.

[21]  Norman I. Badler,et al.  Animating human locomotion with inverse dynamics , 1996, IEEE Computer Graphics and Applications.

[22]  Robert Trappl,et al.  Creating Personalities for Synthetic Actors , 1997, Lecture Notes in Computer Science.

[23]  Norman I. Badler,et al.  Motion Abstraction and Mapping with Spatial Constraints , 1998, CAPTECH.

[24]  Norman I. Badler,et al.  The EMOTE model for effort and shape , 2000, SIGGRAPH.

[25]  J. Breese,et al.  Emotion and personality in a conversational agent , 2001 .

[26]  Ken Perlin,et al.  Real Time Responsive Animation with Personality , 1995, IEEE Trans. Vis. Comput. Graph..

[27]  John Funge,et al.  Cognitive modeling: knowledge, reasoning and planning for intelligent characters , 1999, SIGGRAPH.

[28]  Ken Perlin,et al.  Improv: a system for scripting interactive actors in virtual worlds , 1996, SIGGRAPH.

[29]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[30]  Daniel Thalmann,et al.  Virtual Human Representation and Communication in VLNet , 1997, IEEE Computer Graphics and Applications.

[31]  Michael B. Dillencourt,et al.  Interest Management in Large-Scale Virtual Environments , 2000, Presence: Teleoperators & Virtual Environments.

[32]  Martin R. Stytz,et al.  Distributed virtual environments , 1996, IEEE Computer Graphics and Applications.

[33]  Sandeep Singhal,et al.  Networked virtual environments , 1999 .

[34]  Joseph Bates,et al.  The role of emotion in believable agents , 1994, CACM.

[35]  I. Bartenieff,et al.  Body Movement: Coping with the Environment , 1980 .

[36]  John Hodgson.  Mastering Movement: The Life and Work of Rudolf Laban , 2001 .

[37]  Michael Zyda,et al.  Networked virtual environments - desgin and implementation , 1999 .

[38]  J. Cassell,et al.  Nudge nudge wink wink: elements of face-to-face conversation for embodied conversational agents , 2001 .

[39]  A. Damasio.  Descartes' error: emotion, reason, and the human brain. avon books , 1994 .

[40]  J. S. Wiggins,et al.  The five-factor model of personality : theoretical perspectives , 1996 .

[41]  Norman I. Badler,et al.  Real-time reach planning for animated characters using hardware acceleration , 2003, Proceedings 11th IEEE International Workshop on Program Comprehension.

[42]  Norman I. Badler,et al.  To gesture or not to gesture: what is the question? , 2000, Proceedings Computer Graphics International 2000.

[43]  Stacy Marsella,et al.  Tears and fears: modeling emotions and emotional behaviors in synthetic agents , 2001, AGENTS '01.

[44]  Norman I. Badler,et al.  ACUMEN: amplifying control and understanding of multiple entities , 2002, AAMAS '02.

[45]  Norman I. Badler,et al.  A Parameterized Action Representation for Virtual Human Agents , 1998 .

[46]  P. Petta,et al.  Creating Personalities for Synthetic Actors: Towards Autonomous Personality Agents , 1997 .

[47]  Norman I. Badler,et al.  Interpreting movement manner , 2000, Proceedings Computer Animation 2000.

[48]  P. Ekman,et al.  Constants across cultures in the face and emotion. , 1971, Journal of personality and social psychology.