Representing and parameterizing agent behaviors

The last few years have seen great maturation in understanding how to use computer graphics technology to portray 3D embodied characters or virtual humans. Unlike the off-line, animator-intensive methods used in the special effects industry, real-time embodied agents are expected to exist and interact with us "live." They can be represent other people or function as autonomous helpers, teammates, or tutors enabling novel interactive educational and training applications. We should be able to interact and communicate with them through modalities we already use, such as language, facial expressions, and gesture. Various aspects and issues in real-time virtual humans will be discussed, including consistent parameterizations for gesture and facial actions using movement observation principles, and the representational basis for character believability, personality, and affect. We also describe a Parameterized Action Representation (PAR) that allows an agent to act, plan, and reason about its actions or actions of others. Besides embodying the semantics of human action, the PAR is designed for building future behaviors into autonomous agents and controlling the animation parameters that portray personality, mood, and affect in an embodied agent.

[1]  Norman I. Badler,et al.  Pedestrians: creating agent behaviors through statistical analysis of observation data , 2001, Proceedings Computer Animation 2001. Fourteenth Conference on Computer Animation (Cat. No.01TH8596).

[2]  Justine Cassell,et al.  BEAT: the Behavior Expression Animation Toolkit , 2001, Life-like characters.

[3]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[4]  J. Breese,et al.  Emotion and personality in a conversational agent , 2001 .

[5]  Ken Perlin,et al.  Real Time Responsive Animation with Personality , 1995, IEEE Trans. Vis. Comput. Graph..

[6]  J. Eccles.  The emotional brain. , 1980, Bulletin et memoires de l'Academie royale de medecine de Belgique.

[7]  F. Huddle.  Coordination , 1966, Open Knowledge Institutions.

[8]  J. Burgoon,et al.  Nonverbal Communication , 2018, Encyclopedia of Evolutionary Psychological Science.

[9]  I. Bartenieff,et al.  Body Movement: Coping with the Environment , 1980 .

[10]  John Hodgson.  Mastering Movement: The Life and Work of Rudolf Laban , 2001 .

[11]  J. Burgoon,et al.  Nonverbal Communication: The Unspoken Dialogue , 1988 .

[12]  Norman I. Badler,et al.  Dynamically altering agent behaviors using natural language instructions , 2000, AGENTS '00.

[13]  J. Newlove,et al.  Laban for actors and dancers : putting Laban's movement theory into practice : a step-by-step guide , 1993 .

[14]  Norman I. Badler,et al.  Synthesis and acquisition of laban movement analysis qualitative parameters for communicative gestures , 2001 .

[15]  Sean A. Spence,et al.  Descartes' Error: Emotion, Reason and the Human Brain , 1995 .

[16]  Joseph Bates,et al.  The role of emotion in believable agents , 1994, CACM.

[17]  P. Petta,et al.  Creating Personalities for Synthetic Actors: Towards Autonomous Personality Agents , 1997 .

[18]  Norman I. Badler,et al.  Interpreting movement manner , 2000, Proceedings Computer Animation 2000.

[19]  Martha Palmer,et al.  Representation of actions as an interlingua , 2000 .

[20]  P. Ekman,et al.  Constants across cultures in the face and emotion. , 1971, Journal of personality and social psychology.

[21]  J. Cassell,et al.  Nudge nudge wink wink: elements of face-to-face conversation for embodied conversational agents , 2001 .

[22]  J. S. Wiggins,et al.  The five-factor model of personality : theoretical perspectives , 1996 .

[23]  Norman I. Badler,et al.  To gesture or not to gesture: what is the question? , 2000, Proceedings Computer Graphics International 2000.

[24]  Stacy Marsella,et al.  Tears and fears: modeling emotions and emotional behaviors in synthetic agents , 2001, AGENTS '01.

[25]  S. Narayanan.  Talking the Talk is Like Walking the Walk : A Computational Model of Verbal Aspect , 1997 .

[26]  Norman I. Badler,et al.  The EMOTE model for effort and shape , 2000, SIGGRAPH.

[27]  Norman I. Badler,et al.  Animation control for real-time virtual humans , 1999, CACM.

[28]  Bill Bruehl.  The Technique of Inner Action: The Soul of a Performer's Work , 1995 .

[29]  Catherine Pelachaud,et al.  Performative facial expressions in animated faces , 2001 .

[30]  John Yen,et al.  FLAME—Fuzzy Logic Adaptive Model of Emotions , 2000, Autonomous Agents and Multi-Agent Systems.