Coloring Multi-character Conversations through the Expression of Emotions

In this paper we describe how to generate affective dialogs for multiple virtual characters based on a combination of both automatically generated and pre-scripted scenes. This is done by using the same technique for emotion elicitation and computation that takes either input from the human author in the form of appraisal and dialog act tags or from a dialog planner in the form inferred emotion eliciting conditions. In either case, the system computes the resulting emotions and their intensities. Emotions are used to inform the selection of pre-scripted scenes and dialog strategies, and their surface realization. The approach has been integrated in two fully operable systems, the CrossTalk II installation and the NECA eShowroom.

[1]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[2]  Thomas Rist,et al.  Staging exhibitions: methods and tools for modelling narrative structure to produce interactive performances with virtual actors , 2003, Virtual Reality.

[3]  Jeff Rickel,et al.  Virtual Humans for Team Training in Virtual Reality , 1999 .

[4]  Mervyn A. Jack,et al.  Evaluating humanoid synthetic agents in e-retail applications , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[5]  Thomas Rist,et al.  The automated design of believable dialogues for animated presentation teams , 2001 .

[6]  A. Kendon,et al.  Nonverbal Communication, Interaction, and Gesture , 1981 .

[7]  Daniel Thalmann,et al.  A high-level architecture for believable social agents , 2000, Virtual Reality.

[8]  James A. Russell,et al.  How shall an emotion be called , 1997 .

[9]  J. Murray.  Hamlet on the Holodeck , 1997 .

[10]  R. McCrae,et al.  An introduction to the five-factor model and its applications. , 1992, Journal of personality.

[11]  Munindar P. Singh,et al.  Conversational Agents , 1997 .

[12]  Thomas Rist,et al.  A flexible platform for building applications with life-like characters , 2003, IUI '03.

[13]  J. Cassell,et al.  Embodied conversational agents , 2000 .

[14]  J. Breese,et al.  Emotion and personality in a conversational agent , 2001 .

[15]  Mark Steedman,et al.  Animated conversation: rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents , 1994, SIGGRAPH.

[16]  Thomas Rist,et al.  Authoring scenes for adaptive, interactive performances , 2003, AAMAS '03.

[17]  Elmo M. A. Diederiks.  Buddies in a box: animated characters in consumer electronics , 2003, IUI '03.

[18]  Brenda Laurel,et al.  Computers as theatre , 1991 .

[19]  Mark Steedman,et al.  APML, a Markup Language for Believable Behavior Generation , 2004, Life-like characters.

[20]  Randall W. Hill,et al.  Toward the holodeck: integrating graphics, sound, character and story , 2001, AGENTS '01.

[21]  Mitsuru Ishizuka,et al.  MPML and SCREAM: Scripting the Bodies and Minds of Life-Like Characters , 2004 .

[22]  Kiyoo Itoh,et al.  An Experimental Multimodal Disputation System , 1997 .

[23]  Justine Cassell,et al.  Virtual peers as partners in storytelling and literacy learning , 2003, J. Comput. Assist. Learn..

[24]  Jonathan Gratch,et al.  Émile: Marshalling passions in training and education , 2000, AGENTS '00.

[25]  Antonio Krüger,et al.  The museum visit: generating seamless personalized presentations on multiple devices , 2004, IUI '04.

[26]  James C. Lester Jennifer L. Voerman Stuart G. Towns Char Callaway.  Cosmo: A Life-like Animated Pedagogical Agent with Deictic Believability , 2001 .

[27]  David R. Traum,et al.  Embodied agents for multi-party dialogue in immersive virtual worlds , 2002, AAMAS '02.

[28]  Mitsuru Ishizuka,et al.  Life-like characters - tools, affective functions, and applications , 2004, Life-like characters.

[29]  Thomas Rist,et al.  Adding the Emotional Dimension to Scripting Character Dialogues , 2003, IVA.

[30]  Marilyn A. Walker,et al.  Improvising linguistic style: social and affective bases for agent personality , 1997, AGENTS '97.

[31]  Janet E. Cahn,et al.  Improvising Linguistic Style: Social and Affective Bases for Agents. , 1997 .

[32]  Brigitte Krenn,et al.  Generation of multimodal dialogue for net environments , 2002 .

[33]  H. Conte,et al.  Circumplex models of personality and emotions , 1997 .