The Effect of Affect: Modeling the Impact of Emotional State on the Behavior of Interactive Virtual Humans

Abstract : A person s behavior provides significant information about their emotional state, attitudes, and attention. Our goal is to create virtual humans that convey such information to people while interacting with them in virtual worlds. The virtual humans must respond dynamically to the events surrounding them, which are fundamentally influenced by users actions, while providing an illusion of human-like behavior. A user must be able to interpret the dynamic cognitive and emotional state of the virtual humans using the same nonverbal cues that people use to understand one another. Towards these goals, we are integrating and extending components from three prior systems: a virtual human architecture with a range of cognitive and motor capabilities, a model of emotional appraisal, and a model of the impact of emotional state on physical behavior. We describe the key research issues, our approach, and an initial implementation in an Army peacekeeping scenario.

[1]  P. Ekman,et al.  The Repertoire of Nonverbal Behavior: Categories, Origins, Usage, and Coding , 1969 .

[2]  P. Ekman,et al.  Constants across cultures in the face and emotion. , 1971, Journal of personality and social psychology.

[3]  N. Freedman,et al.  Chapter 8 – The Analysis of Movement Behavior During the Clinical Interview1 , 1972 .

[4]  F. Thomas,et al.  The illusion of life : Disney animation , 1981 .

[5]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[6]  D. Cicchetti Emotion and Adaptation , 1993 .

[7]  M. Argyle,et al.  Gaze and Mutual Gaze , 1994, British Journal of Psychiatry.

[8]  Luc Beaudoin Goal Processing in Autonomous Agents , 1994 .

[9]  M. Studdert-Kennedy Hand and Mind: What Gestures Reveal About Thought. , 1994 .

[10]  D. McNeill Hand and Mind , 1995 .

[11]  W. S. Reilly,et al.  Believable Social and Emotional Agents. , 1996 .

[12]  Massimo Poesio,et al.  Towards an Axiomatization of Dialogue Acts , 1998 .

[13]  C. Pelachaud,et al.  Emotional meaning and expres-sion in performative faces , 1999 .

[14]  Jeff Rickel,et al.  Virtual Humans for Team Training in Virtual Reality , 1999 .

[15]  W. Lewis Johnson,et al.  Animated Agents for Procedural Training in Virtual Reality: Perception, Cognition, and Motor Control , 1999, Appl. Artif. Intell..

[16]  James C. Lester,et al.  Deictic Believability: Coordinated Gesture, Locomotion, and Speech in Lifelike Pedagogical Agents , 1999, Appl. Artif. Intell..

[17]  Leonard Berkowitz,et al.  Causes and consequences of feelings , 2000 .

[18]  Jonathan Gratch,et al.  Émile: Marshalling passions in training and education , 2000, AGENTS '00.

[19]  Stacy Marsella,et al.  Interactive pedagogical drama , 2000, AGENTS '00.

[20]  J. Cassell,et al.  Embodied conversational agents , 2000 .

[21]  Randall W. Hill,et al.  Toward the holodeck: integrating graphics, sound, character and story , 2001, AGENTS '01.

[22]  Randall W. Hill,et al.  Steve Goes to Bosnia: Towards a New Generation of Virtual Humans for Interactive Experiences , 2001 .

[23]  J. Breese,et al.  Emotion and personality in a conversational agent , 2001 .

[24]  W. Johnson,et al.  Task-oriented collaboration with embodied agents in virtual worlds , 2001 .