Affect Bartender — Affective cues and their application in a conversational agent

This paper presents methods for the detection of textual expressions of users' affective states and explores an application of these affective cues in a conversational system — Affect Bartender. We also describe the architecture of the system, core system components and a range of developed communication interfaces. The application of the described methods is illustrated with examples of dialogs conducted with experiment participants in a Virtual Reality setting.

[1]  Cindy K. Chung,et al.  Revealing Dimensions of Thinking in Open-Ended Self-Descriptions: An Automated Meaning Extraction Method for Natural Language. , 2008, Journal of research in personality.

[2]  Nicu Sebe,et al.  Authentic Facial Expression Analysis , 2004, FGR.

[3]  Marc Schröder,et al.  IDEAS4Games: Building Expressive Virtual Characters for Computer Games , 2008, IVA.

[4]  Elisabeth André,et al.  Affective dialogue systems : Tutorial and Research Workshop, ADS 2004, Kloster Irsee, Germany, June 14-16, 2004 : proceedings , 2004 .

[5]  Craig H. Martell,et al.  Lexical and Discourse Analysis of Online Chat Dialog , 2007, International Conference on Semantic Computing (ICSC 2007).

[6]  J. Pennebaker,et al.  Psychological aspects of natural language. use: our words, our selves. , 2003, Annual review of psychology.

[7]  Zhihong Zeng,et al.  Audio-Visual Affect Recognition , 2007, IEEE Transactions on Multimedia.

[8]  E. Jaynes.  Information Theory and Statistical Mechanics , 1957 .

[9]  Michael,et al.  Affective Computing and Intelligent Interaction , 2011, Lecture Notes in Computer Science.

[10]  Arthur C. Graesser,et al.  Toward an Affect-Sensitive AutoTutor , 2007, IEEE Intelligent Systems.

[11]  Norbert Reithinger,et al.  VirtualHuman: dialogic and affective interaction with virtual characters , 2006, ICMI '06.

[12]  Kostas Karpouzis,et al.  Virtual agent multimodal mimicry of humans , 2007, Lang. Resour. Evaluation.

[13]  D. Thalmann,et al.  Sentiment analysis of informal textual communication in cyberspace , 2010 .

[14]  Roddy Cowie,et al.  Recognition of Emotional States in Natural Human-Computer Interaction , 2008 .

[15]  Marcin Skowron,et al.  Affect Listeners: Acquisition of Affective States by Means of Conversational Systems , 2009, COST 2102 Training School.

[16]  W. Minker,et al.  Handling Emotions in Human-Computer Dialogues , 2009 .

[17]  Mitsuru Ishizuka,et al.  User study on AffectIM, an avatar-based Instant Messaging system employing rule-based affect sensing from text , 2008, Int. J. Hum. Comput. Stud..

[18]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[19]  Marc Schröder,et al.  Developing a Consistent View on Emotion-Oriented Computing , 2005, MLMI.

[20]  G. Mishne.  Experiments with Mood Classification in , 2005 .

[21]  John Blitzer,et al.  Biographies, Bollywood, Boom-boxes and Blenders: Domain Adaptation for Sentiment Classification , 2007, ACL.

[22]  Matt Thomas,et al.  Get out the vote: Determining support or opposition from Congressional floor-debate transcripts , 2006, EMNLP.

[23]  Mike Thelwall,et al.  Sentiment in short strength detection informal text , 2010 .

[24]  Thomas S. Huang,et al.  Emotion recognition from speech VIA boosted Gaussian mixture models , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[25]  S. Argamon,et al.  Hedged Responses and Expressions of Affect in Human/Human and Human/Computer Tutorial Interactions , 2004 .

[26]  Bo Pang,et al.  Thumbs up? Sentiment Classification using Machine Learning Techniques , 2002, EMNLP.

[27]  Khurshid Ahmad,et al.  Sentiment Polarity Identification in Financial News: A Cohesion-based Approach , 2007, ACL.

[28]  Brigitte Krenn,et al.  Computational Framework for and the Realization of Cognitive Agents Providing Intelligent Assistance Capabilities , 2008 .

[29]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[30]  Steven J. Simske,et al.  Recognition of emotions in interactive voice response systems , 2003, INTERSPEECH.