The Architectural Role of Emotion in Cognitive Systems

In this chapter, we will revive an old argument that theories of human emotion can give insight into the design and control of complex cognitive systems. In particular, we claim that appraisal theories of emotion provide essential insight into the influences of emotion over cognition and can help translate such findings into concrete guidance for the design of cognitive systems. Appraisal theory claims that emotion plays a central and functional role in sensing external events, characterizing them as opportunity or threats and recruiting the cognitive, physical and social resources needed to adaptively respond. Further, because it argues for a close association between emotion and cognition, the theoretical claims of appraisal theory can be recast as a requirement specification for how to build a cognitive system. This specification asserts a set of judgments that must be supported in order to correctly interpret and respond to stimuli and provides a unifying framework for integrating these judgments into a coherent physical or social response. This chapter elaborates argument in some detail based on our joint experience in building complex cognitive systems and computational models of emotion.

[1]  Philip R. Cohen,et al.  Plans as Complex Mental Attitudes , 2003 .

[2]  David R. Traum,et al.  Negotiation over tasks in hybrid human-agent teams for simulation-based training , 2003, AAMAS '03.

[3]  David R. Traum,et al.  Modelling Grounding and Discourse Obligations Using Update Rules , 2000, ANLP.

[4]  Sarit Kraus,et al.  Collaborative Plans for Complex Group Action , 1996, Artif. Intell..

[5]  Daniel Thalmann,et al.  Human Modeling and Animation , 1990 .

[6]  Eduard Hovy,et al.  Emotional Variation in Speech-Based Natural Language Generation , 2002 .

[7]  Stacy Marsella,et al.  Tears and fears: modeling emotions and emotional behaviors in synthetic agents , 2001, AGENTS '01.

[8]  Stacy Marsella,et al.  Evaluating a Computational Model of Emotion , 2005, Autonomous Agents and Multi-Agent Systems.

[9]  P. Young,et al.  Emotion and personality , 1963 .

[10]  Justine Cassell,et al.  BEAT: the Behavior Expression Animation Toolkit , 2001, Life-like characters.

[11]  Shrikanth Narayanan,et al.  Limited domain synthesis of expressive military speech for animated characters , 2002, Proceedings of 2002 IEEE Workshop on Speech Synthesis, 2002..

[12]  A. Mele.  Self-Deception Unmasked , 2001 .

[13]  N. Schwarz,et al.  Mood and Stereotyping: Affective States and the Use of General Knowledge Structures , 1996 .

[14]  D. Cicchetti.  Emotion and Adaptation , 1993 .

[15]  Carles Sierra.  The Fourth International Conference on Autonomous Agents , 2001, AI Mag..

[16]  N. Frijda.  Emotion, cognitive structure and action tendency , 1987 .

[17]  R. Frank.  Passions Within Reason: The Strategic Role of the Emotions , 1990 .

[18]  W. Scott Neal Reilly,et al.  Broad agents , 1991, SGAR.

[19]  H. Simon,et al.  Motivational and emotional controls of cognition. , 1967, Psychological review.

[20]  C. Pelachaud,et al.  Emotional meaning and expres-sion in performative faces , 1999 .

[21]  Mark Steedman,et al.  Generating Facial Expressions for Speech , 1996, Cogn. Sci..

[22]  John R. Anderson,et al.  Rules of the Mind , 1993 .

[23]  Wenji Mao,et al.  Social Causality and Responsibility: Modeling and Evaluation , 2005, IVA.

[24]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[25]  Wenji Mao,et al.  Social judgment in multiagent interactions , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[26]  Stacy Marsella,et al.  Modeling coping behavior in virtual humans: don't worry, be happy , 2003, AAMAS '03.

[27]  R. Hill,et al.  A computational model of dynamic perceptual attention for virtual humans , 2006 .

[28]  P. Hertel,et al.  Emotion, mood and memory , 1992 .

[29]  R. Walton,et al.  A Behavioral Theory of Labor Negotiations: an Analysis of a Social Interaction System , 1965 .

[30]  J. Allman,et al.  The Anterior Cingulate Cortex , 2001, Annals of the New York Academy of Sciences.

[31]  P. Ekman.  An argument for basic emotions , 1992 .

[32]  Alan L. Sillars,et al.  CODING VERBAL CONFLICT TACTICS: NONVERBAL AND PERCEPTUAL CORRELATES OF THE “AVOIDANCE‐DISTRIBUTIVE‐INTEGRATIVE” DISTINCTION , 1982 .

[33]  E. Peacock,et al.  The stress appraisal measure (SAM): A multidimensional approach to cognitive appraisal , 1990 .

[34]  W. Johnson,et al.  Task-oriented collaboration with embodied agents in virtual worlds , 2001 .

[35]  James C. Lester,et al.  Animated Pedagogical Agents: Face-to-Face Interaction in Interactive Learning Environments , 2000 .

[36]  Howard R. Moskowitz,et al.  Emotion in Concepts , 2008 .

[37]  Kelly G. Shaver,et al.  The attribution of blame : causality, responsibility, and blameworthiness , 1985 .

[38]  Stacy Marsella,et al.  A domain-independent framework for modeling emotion , 2004, Cognitive Systems Research.

[39]  Jim Blythe,et al.  Decision-Theoretic Planning , 1999, AI Mag..

[40]  Gregory P. Lee,et al.  Different Contributions of the Human Amygdala and Ventromedial Prefrontal Cortex to Decision-Making , 1999, The Journal of Neuroscience.

[41]  Justine Cassell,et al.  Human conversation as a system framework: designing embodied conversational agents , 2001 .

[42]  David R. Traum,et al.  Fight, Flight, or Negotiate: Believable Strategies for Conversing Under Crisis , 2005, IVA.

[43]  K. Scherer,et al.  Appraisal processes in emotion. , 2003 .

[44]  Stacy Marsella,et al.  Expressive Behaviors for Virtual Worlds , 2004, Life-like characters.

[45]  James C. Lester,et al.  Deictic and emotive communication in animated pedagogical agents , 2001 .

[46]  Randall W. Hill,et al.  Toward the holodeck: integrating graphics, sound, character and story , 2001, AGENTS '01.

[47]  Stacy Marsella,et al.  Interactive pedagogical drama , 2000, AGENTS '00.

[48]  N. Schwarz,et al.  Mood and Persuasion: Affective States Influence the Processing of Persuasive Communications , 1991 .

[49]  Randall W. Hill,et al.  Toward a New Generation of Virtual Humans for Interactive Experiences , 2002, IEEE Intell. Syst..

[50]  Eduard H. Hovy,et al.  MRE: A Study on Evolutionary Language Understanding , 2016, NLUCS.

[51]  David R. Traum,et al.  Embodied agents for multi-party dialogue in immersive virtual worlds , 2002, AAMAS '02.