Affect and Social Processes in Online Communication--Experiments with an Affective Dialog System

This paper presents an integrated view on a series of experiments conducted with an affective dialog system, applied as a tool in studies of emotions and social processes in online communication. The different realizations of the system are evaluated in three experimental setups to verify effects of affective profiles, as well as of fine-grained communication scenarios on users' expressions of affective states, experienced emotional changes, and interaction patterns. Results demonstrate that the system applied in virtual reality settings matches a Wizard-of-Oz in terms of chatting enjoyment, dialog coherence, and realism. Variants of the system's affective profile significantly influence the rating of chatting enjoyment and an emotional connection. Self-reported emotional changes experienced by participants during an interaction with the system are in line with the type of applied profile. Analysis of interaction patterns, i.e., usage of particular dialog act classes, word categories, and textual expressions of affective states for different scenarios, demonstrates that a communication scenario for social sharing of emotions was successfully established. The experimental evidence provides valuable input for applications of affective dialog systems and strengthens them as valid tools for studying affect and social aspects in online communication.

[1]  Robert H. Frank,et al.  Feelings and Emotions: Introducing Moral Emotions into Models of Rational Choice , 2004 .

[2]  Matthias Trier,et al.  Sentiment Polarization and Balance among Users in Online Social Networks , 2012, AMCIS.

[3]  J. Pennebaker,et al.  Psychological aspects of natural language. use: our words, our selves. , 2003, Annual review of psychology.

[4]  Marilyn A. Walker,et al.  Using Linguistic Cues for the Automatic Recognition of Personality in Conversation and Text , 2007, J. Artif. Intell. Res..

[5]  B. Rimé.  Emotion Elicits the Social Sharing of Emotion: Theory and Empirical Review , 2009 .

[6]  D. Thalmann,et al.  Sentiment analysis of informal textual communication in cyberspace , 2010 .

[7]  Mike Thelwall,et al.  An Interdisciplinary VR-architecture for 3D Chatting with Non-verbal Communication , 2011, EGVE/EuroVR.

[8]  Ryuichiro Higashinaka,et al.  Effects of Conversational Agents on Human Communication in Thought-Evoking Multi-Party Dialogues , 2009, SIGDIAL Conference.

[9]  Etienne B. Roesch,et al.  A Blueprint for Affective Computing: A Sourcebook and Manual , 2010 .

[10]  Rafael A. Calvo,et al.  Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications , 2010, IEEE Transactions on Affective Computing.

[11]  Mathias Theunis,et al.  The Good, the Bad and the Neutral: Affective Profile in Dialog System-User Communication , 2011, ACII.

[12]  Georgios Paltoglou,et al.  Affect Bartender — Affective cues and their application in a conversational agent , 2011, 2011 IEEE Workshop on Affective Computational Intelligence (WACI).

[13]  Douglas M. Wood,et al.  Alone Together, Why We Expect More from Technology and Less from Each Other , 2012 .

[14]  Arvid Kappas,et al.  Predicting Emotional Responses to Long Informal Text , 2013, IEEE Transactions on Affective Computing.

[15]  Melanie Nguyen,et al.  Comparing Online and Offline Self-Disclosure: A Systematic Review , 2012, Cyberpsychology Behav. Soc. Netw..

[16]  Agneta H. Fischer,et al.  Feelings and Emotions: The Amsterdam Symposium , 2004 .

[17]  Thomas Rist,et al.  Coloring Multi-character Conversations through the Expression of Emotions , 2004, ADS.

[18]  P. Petta,et al.  Computational models of emotion , 2010 .

[19]  Craig H. Martell,et al.  Lexical and Discourse Analysis of Online Chat Dialog , 2007, International Conference on Semantic Computing (ICSC 2007).

[20]  Arthur C. Graesser,et al.  The Relationship between Affective States and Dialog Patterns during Interactions with AutoTutor , 2005 .

[21]  Georgios Paltoglou,et al.  No Peanuts! Affective Cues for the Virtual Bartender , 2011, FLAIRS.

[22]  Mathias Theunis,et al.  Effect of Affective Profile on Communication Patterns and Affective Expressions in Interactions with a Dialog System , 2011, ACII.

[23]  Yousri Marzouki,et al.  The Contribution of Facebook to the 2011 Tunisian Revolution: A Cyberpsychological Insight , 2012, Cyberpsychology Behav. Soc. Netw..

[24]  ThelwallMike,et al.  Sentiment strength detection in short informal text , 2010 .

[25]  Arvid Kappas,et al.  Collective Emotions Online and Their Influence on Community Life , 2011, PloS one.

[26]  Mike Thelwall,et al.  Sentiment strength detection for the social web , 2012, J. Assoc. Inf. Sci. Technol..

[27]  Arvid Kappas,et al.  Damping Sentiment Analysis in Online Communication: Discussions, Monologs and Dialogs , 2013, CICLing.

[28]  W. Hamilton.  The genetical evolution of social behaviour. I. , 1964, Journal of theoretical biology.

[29]  Tal Yarkoni.  Personality in 100,000 Words: A large-scale analysis of personality and word use among bloggers. , 2010, Journal of research in personality.

[30]  J. Pennebaker,et al.  Linguistic styles: language use as an individual difference. , 1999, Journal of personality and social psychology.

[31]  Arvid Kappas,et al.  Face-to-face communication over the Internet: emotions in a web of culture, language, and technology , 2011 .

[32]  David R. Traum,et al.  Negotiation over tasks in hybrid human-agent teams for simulation-based training , 2003, AAMAS '03.

[33]  Scotty D. Craig,et al.  Integrating Affect Sensors in an Intelligent Tutoring System , 2004 .

[34]  Stefan Rank,et al.  Affect Listeners-From dyads to group interactions with affective dialog systems , 2012 .

[35]  Joseph Bates,et al.  The role of emotion in believable agents , 1994, CACM.

[36]  F. Schweitzer,et al.  Emotional persistence in online chatting communities , 2012, Scientific Reports.

[37]  F. Tuerlinckx,et al.  Journal of Personality and Social Psychology Feelings Change : Accounting for Individual Differences in the Temporal Dynamics of Affect , 2010 .

[38]  Arvid Kappas,et al.  Measuring Emotions in Individuals and Internet Communities , 2013 .

[39]  Bosiljka Tadic,et al.  Patterns of Emotional Blogging and Emergence of Communities: Agent-Based Model on Bipartite Networks , 2011, ArXiv.

[40]  Robert E. Pinsker,et al.  Alone Together: Why We Expect More from Technology and Less from Each Other. , 2012 .

[41]  Marcin Skowron,et al.  Affect Listeners: Acquisition of Affective States by Means of Conversational Systems , 2009, COST 2102 Training School.

[42]  James C. Lester,et al.  The persona effect: affective impact of animated pedagogical agents , 1997, CHI.

[43]  Clifford Nass,et al.  Computers that care: investigating the effects of orientation of emotion exhibited by an embodied computer agent , 2005, Int. J. Hum. Comput. Stud..

[44]  Steffen Staab,et al.  Management of Meta Knowledge for RDF Repositories , 2007 .

[45]  Dirk Heylen,et al.  How Agents' Turn-Taking Strategies Influence Impressions and Response Behaviors , 2011, Presence Teleoperators Virtual Environ..

[46]  Mike Thelwall,et al.  Sentiment in short strength detection informal text , 2010 .

[47]  Suzanne K. Damarin,et al.  The second self: Computers and the human spirit , 1985 .

[48]  J. Forgas.  Affective influences on self-disclosure: mood effects on the intimacy and reciprocity of disclosing personal information. , 2011, Journal of personality and social psychology.

[49]  D. Keltner,et al.  Social Functions of Emotions at Four Levels of Analysis , 1999 .

[50]  B. Mesquita,et al.  The social roles and functions of emotions , 1994 .

[51]  Brigitte Krenn,et al.  Computational Framework for and the Realization of Cognitive Agents Providing Intelligent Assistance Capabilities , 2008 .

[52]  C. Pelachaud,et al.  Emotion-Oriented Systems: The Humaine Handbook , 2011 .

[53]  D. Watson,et al.  Toward a consensual structure of mood. , 1985, Psychological bulletin.

[54]  M. Bradley,et al.  Affective Norms for English Words (ANEW): Instruction Manual and Affective Ratings , 1999 .

[55]  Mike Thelwall,et al.  Sentiment in Twitter events , 2011, J. Assoc. Inf. Sci. Technol..

[56]  Constantine Sedikides,et al.  The Relationship Closeness Induction Task. , 1999 .

[57]  Ryuichiro Higashinaka,et al.  Effects of self-disclosure and empathy in human-computer dialogue , 2008, 2008 IEEE Spoken Language Technology Workshop.

[58]  Sunghwan Mac Kim,et al.  EMOTIONS IN TEXT: DIMENSIONAL AND CATEGORICAL MODELS , 2013, Comput. Intell..

[59]  Nicolas Sabouret,et al.  A socio-emotional model of impoliteness for non-player characters , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[60]  I. Altman,et al.  Social penetration: The development of interpersonal relationships , 1973 .

[61]  D. Funder,et al.  Personality as manifest in word use: correlations with self-report, acquaintance report, and behavior. , 2008, Journal of personality and social psychology.

[62]  Laila Dybkjær,et al.  Affective Dialogue Systems , 2004, Lecture Notes in Computer Science.

[63]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .