Evaluating a Computational Model of Emotion

Spurred by a range of potential applications, there has been a growing body of research in computational models of human emotion. To advance the development of these models, it is critical that we evaluate them against the phenomena they purport to model. In this paper, we present one method to evaluate an emotion model that compares the behavior of the model against human behavior using a standard clinical instrument for assessing human emotion and coping. We use this method to evaluate the Emotion and Adaptation (EMA) model of emotion Gratch and Marsella. The evaluation highlights strengths of the approach and identifies where the model needs further development.

[1]  M. Sterling.  The Cognitive Theory of Emotions , 1979 .

[2]  R. Arkin.  Moving Up the Food Chain: Motivation and Emotion in Behavior-Based Robots , 2003 .

[3]  Justine Cassell,et al.  Virtual peers as partners in storytelling and literacy learning , 2003, J. Comput. Assist. Learn..

[4]  S. Marsella,et al.  Fight the Way You Train:The Role and Limits of Emotions in Training for Combat , 2003 .

[5]  Dolores Cañamero,et al.  Modeling motivations and emotions as a basis for intelligent behavior , 1997, AGENTS '97.

[6]  Elisabeth André,et al.  The Persona Effect: How Substantial Is It? , 1998, BCS HCI.

[7]  R. Frank.  Passions Within Reason: The Strategic Role of the Emotions , 1990 .

[8]  Wenji Mao,et al.  Social judgment in multiagent interactions , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[9]  David V. Pynadath,et al.  PsychSim: Agent-based Modeling of Social Interactions and Influence , 2004, ICCM.

[10]  Barry G. Silverman,et al.  Constructing Virtual Asymmetric Opponents from Data and Models in the Literature: Case of Crowd Rioting , 2002 .

[11]  Stacy Marsella,et al.  Modeling coping behavior in virtual humans: don't worry, be happy , 2003, AAMAS '03.

[12]  Matthias Scheutz,et al.  AFFECT AND AGENT CONTROL: EXPERIMENTS WITH SIMPLE AFFECTIVE STATES , 2001 .

[13]  H. Simon,et al.  Motivational and emotional controls of cognition. , 1967, Psychological review.

[14]  Catherine Pelachaud,et al.  Embodied contextual agent in information delivering application , 2002, AAMAS '02.

[15]  Sarit Kraus,et al.  Collaborative Plans for Complex Group Action , 1996, Artif. Intell..

[16]  Randall W. Hill,et al.  Toward a New Generation of Virtual Humans for Interactive Experiences , 2002, IEEE Intell. Syst..

[17]  James C. Lester,et al.  Lifelike Pedagogical Agents for Mixed-initiative Problem Solving in Constructivist Learning Environments , 2004, User Modeling and User-Adapted Interaction.

[18]  Kelly G. Shaver,et al.  The attribution of blame : causality, responsibility, and blameworthiness , 1985 .

[19]  Sean A. Spence,et al.  Descartes' Error: Emotion, Reason and the Human Brain , 1995 .

[20]  Stacy Marsella,et al.  A domain-independent framework for modeling emotion , 2004, Cognitive Systems Research.

[21]  Martin Klesen.  USING THEATRICAL CONCEPTS FOR ROLE-PLAYS WITH EDUCATIONAL AGENTS , 2005, Appl. Artif. Intell..

[22]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[23]  Mitsuru Ishizuka,et al.  Persona Effect Revisited , 2003, IVA.

[24]  D. Cicchetti.  Emotion and Adaptation , 1993 .

[25]  Christine L. Lisetti,et al.  Automatic facial expression interpretation: Where human-computer interaction, artificial intelligence and cognitive science intersect , 2000 .

[26]  Nicole C. Krämer,et al.  Effects of Embodied Interface Agents and Their Gestural Activity , 2003, IVA.

[27]  Jim Blythe,et al.  Decision-Theoretic Planning , 1999, AI Mag..

[28]  B. Rothbaum,et al.  Virtual Reality Exposure Therapy for PTSD Vietnam Veterans: A Case Study , 1999, Journal of traumatic stress.

[29]  Marc Cavazza,et al.  Agents' Interaction in Virtual Storytelling , 2001, IVA.

[30]  Christine L. Lisetti,et al.  Can a rational agent afford to be affectless? a formal approach , 2002, Appl. Artif. Intell..

[31]  Stacy Marsella,et al.  Tears and fears: modeling emotions and emotional behaviors in synthetic agents , 2001, AGENTS '01.

[32]  Thomas Rist,et al.  The automated design of believable dialogues for animated presentation teams , 2001 .

[33]  Juan David Velásquez,et al.  When Robots Weep: Emotional Memories and Decision-Making , 1998, AAAI/IAAI.

[34]  David Moffat,et al.  Where There's a Will There's an Agent , 1995, ECAI Workshop on Agent Theories, Architectures, and Languages.

[35]  C. Elliott.  The affective reasoner: a process model of emotions in a multi-agent system , 1992 .

[36]  W. L. Johnson,et al.  Proceedings of the First International Joint Conference on Autonomous Agents and Multiagent Systems , 2002 .

[37]  W. Lewis Johnson,et al.  Pedagogical agents on the Web , 1999, AGENTS '99.

[38]  James C. Lester,et al.  Deictic and emotive communication in animated pedagogical agents , 2001 .

[39]  John Yen,et al.  FLAME—Fuzzy Logic Adaptive Model of Emotions , 2000, Autonomous Agents and Multi-Agent Systems.

[40]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[41]  G. Reeke.  Marvin Minsky, The Society of Mind , 1991, Artif. Intell..

[42]  P. Johnson-Laird,et al.  Towards a Cognitive Theory of Emotions , 1987 .

[43]  Gautam Biswas,et al.  LEARNING BY TEACHING: A NEW AGENT PARADIGM FOR EDUCATIONAL SOFTWARE , 2005, Appl. Artif. Intell..

[44]  S. Marsella,et al.  Interactive Pedagogical Drama for Health Interventions , 2003 .

[45]  A. Mele.  Self-Deception Unmasked , 2001 .

[46]  James T. Townsend,et al.  9. Motivational underpinnings of utility in decision making: Decision field theory analysis of deprivation and satiation , 2002 .

[47]  Katherine Isbister,et al.  SENSITIZING SOCIAL AGENTS FOR VIRTUAL TRAINING , 2005, Appl. Artif. Intell..

[48]  Christine L. Lisetti,et al.  Using decision theory to formalize emotions in multi-agent systems , 2000, Proceedings Fourth International Conference on MultiAgent Systems.

[49]  Justine Cassell,et al.  Human conversation as a system framework: designing embodied conversational agents , 2001 .

[50]  Cristina Conati,et al.  Evaluating a Probabilistic Model of Student Affect , 2004, Intelligent Tutoring Systems.

[51]  Cristina Conati,et al.  Probabilistic assessment of user's emotions in educational games , 2002, Appl. Artif. Intell..

[52]  B. Silverman,et al.  Human Behavior Models for Game-Theoretic Agents: Case of Crowd Tipping , 2002 .

[53]  E. Peacock,et al.  The stress appraisal measure (SAM): A multidimensional approach to cognitive appraisal , 1990 .

[54]  Norman I. Badler,et al.  Creating Interactive Virtual Humans: Some Assembly Required , 2002, IEEE Intell. Syst..

[55]  Randall W. Hill,et al.  Toward the holodeck: integrating graphics, sound, character and story , 2001, AGENTS '01.

[56]  Stacy Marsella,et al.  Interactive pedagogical drama , 2000, AGENTS '00.

[57]  Jonathan D. Cohen,et al.  Computational modeling of emotion: explorations through the anatomy and physiology of fear conditioning , 1997, Trends in Cognitive Sciences.

[58]  Andrew J. Cowell,et al.  Embodiment and Interaction Guidelines for Designing Credible, Trustworthy Embodied Conversational Agents , 2003, IVA.

[59]  Aaron Sloman,et al.  Why Robots Will Have Emotions , 1981, IJCAI.

[60]  Stacy Marsella,et al.  LESSONS FROM EMOTION PSYCHOLOGY FOR THE DESIGN OF LIFELIKE CHARACTERS , 2005, Appl. Artif. Intell..