Applying a Text-Based Affective Dialogue System in Psychological Research: Case Studies on the Effects of System Behaviour, Interaction Context and Social Exclusion

This article presents two studies conducted with an affective dialogue system in which text-based system–user communication was used to model, generate and present different affective and social interaction scenarios. We specifically investigated the influence of interaction context and roles assigned to the system and the participants, as well as the impact of pre-structured social interaction patterns that were modelled to mimic aspects of “social exclusion” scenarios. The results of the first study demonstrate that both the social context of the interaction and the roles assigned to the system influence the system evaluation, interaction patterns, textual expressions of affective states, as well as emotional self-reports. The results observed for the second study show the system’s ability to partially exclude a participant from a triadic conversation without triggering significantly different affective reactions or a more negative system evaluation. The experimental evidence provides insights on the perception, modelling and generation of affective and social cues in artificial systems that can be realized in different modalities, including the text modality, thus delivering valuable input for applying affective dialogue systems as tools for studying affect and social aspects in online communication.

[1]  Jacob Cohen,et al.  Quantitative Methods in Psychology , 1938, Nature.

[2]  Georgios Paltoglou,et al.  No Peanuts! Affective Cues for the Virtual Bartender , 2011, FLAIRS.

[3]  Загоровская Ольга Владимировна,et al.  Исследование влияния пола и психологических характеристик автора на количественные параметры его текста с использованием программы Linguistic Inquiry and Word Count , 2015 .

[4]  Mathias Theunis,et al.  The Good, the Bad and the Neutral: Affective Profile in Dialog System-User Communication , 2011, ACII.

[5]  David DeVault,et al.  Incremental Dialogue Understanding and Feedback for Multiparty, Multimodal Conversation , 2012, IVA.

[6]  Mathias Theunis,et al.  Effect of Affective Profile on Communication Patterns and Affective Expressions in Interactions with a Dialog System , 2011, ACII.

[7]  ThelwallMike,et al.  Sentiment strength detection in short informal text , 2010 .

[8]  N. Epley,et al.  Social connection enables dehumanization , 2012 .

[9]  Philip J. Stone,et al.  Extracting Information. (Book Reviews: The General Inquirer. A Computer Approach to Content Analysis) , 1967 .

[10]  Arvid Kappas,et al.  Predicting Emotional Responses to Long Informal Text , 2013, IEEE Transactions on Affective Computing.

[11]  Oskar Dressler,et al.  Künstliche Intelligenz? , 1986, FIFF Jahrestagung.

[12]  Kipling D. Williams,et al.  Virtually Ostracized: Studying Ostracism in Immersive Virtual Environments , 2012, Cyberpsychology Behav. Soc. Netw..

[13]  D. Thalmann,et al.  Sentiment analysis of informal textual communication in cyberspace , 2010 .

[14]  C. Nass,et al.  Machines and Mindlessness , 2000 .

[15]  Ana Paiva,et al.  LEARNING BY FEELING: EVOKING EMPATHY WITH SYNTHETIC CHARACTERS , 2005, Appl. Artif. Intell..

[16]  Rafael A. Calvo,et al.  Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications , 2010, IEEE Transactions on Affective Computing.

[17]  Adrian F. Ward,et al.  The Harm-Made Mind , 2013, Psychological science.

[18]  Alan G. Sanfey,et al.  Affective state and decision-making in the Ultimatum Game , 2006, Experimental Brain Research.

[19]  Dirk Heylen,et al.  Bridging the Gap between Social Animal and Unsocial Machine: A Survey of Social Signal Processing , 2012, IEEE Transactions on Affective Computing.

[20]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[21]  Elisabeth André,et al.  Affective dialogue systems : Tutorial and Research Workshop, ADS 2004, Kloster Irsee, Germany, June 14-16, 2004 : proceedings , 2004 .

[22]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[23]  Cassandra L. Govan,et al.  Investigations into differences between social- and cyberostracism. , 2002 .

[24]  Arvid Kappas,et al.  Affect and Social Processes in Online Communication--Experiments with an Affective Dialog System , 2013, IEEE Transactions on Affective Computing.

[25]  Jim Blascovich,et al.  A theoretical model of social influence for increasing the utility of collaborative virtual environments , 2002, CVE '02.

[26]  Craig H. Martell,et al.  Lexical and Discourse Analysis of Online Chat Dialog , 2007, International Conference on Semantic Computing (ICSC 2007).

[27]  J. Cacioppo,et al.  Creating Social Connection Through Inferential Reproduction , 2008, Psychological science.

[28]  Donald R. Brown,et al.  Reciprocal Interaction and Similarity of Personality Attributes , 1984 .

[29]  C. Nass,et al.  Truth is beauty: researching embodied conversational agents , 2001 .

[30]  Sunghwan Mac Kim,et al.  EMOTIONS IN TEXT: DIMENSIONAL AND CATEGORICAL MODELS , 2013, Comput. Intell..

[31]  B. J. Fogg,et al.  Can computer personalities be human personalities? , 1995, Int. J. Hum. Comput. Stud..

[32]  D. Funder,et al.  Personality as manifest in word use: correlations with self-report, acquaintance report, and behavior. , 2008, Journal of personality and social psychology.

[33]  Laila Dybkjær,et al.  Affective Dialogue Systems , 2004, Lecture Notes in Computer Science.

[34]  Wolfgang Minker,et al.  Endowing Spoken Language Dialogue Systems with Emotional Intelligence , 2004, ADS.

[35]  Madan M. Pillutla,et al.  Unfairness, Anger, and Spite: Emotional Rejections of Ultimatum Offers , 1996 .

[36]  Nicole C. Krämer,et al.  "It doesn't matter what you are!" Explaining social effects of agents and avatars , 2010, Comput. Hum. Behav..

[37]  Bosiljka Tadic,et al.  Structure and stability of online chat networks built on emotion-carrying links , 2012, ArXiv.

[38]  D. Lewis,et al.  Quantitative methods in psychology , 1950 .

[39]  Mike Thelwall,et al.  Sentiment in short strength detection informal text , 2010 .

[40]  Adam Waytz,et al.  Social Cognition Unbound , 2010, Current directions in psychological science.

[41]  Stefan Kopp,et al.  Co-constructing Grounded Symbols—Feedback and Incremental Adaptation in Human–Agent Dialogue , 2013, KI - Künstliche Intelligenz.

[42]  J. Pennebaker,et al.  Psychological aspects of natural language. use: our words, our selves. , 2003, Annual review of psychology.

[43]  Björn W. Schuller,et al.  Cognitive and Emotional Information Processing for Human–Machine Interaction , 2012, Cognitive Computation.

[44]  Borae Jin,et al.  How lonely people use and perceive Facebook , 2013, Comput. Hum. Behav..

[45]  C. Scheve,et al.  Collective Emotions: Perspectives from Psychology, Philosophy, and Sociology , 2014 .

[46]  C. Nass,et al.  How “Real” Are Computer Personalities? , 1996 .

[47]  Tal Yarkoni Personality in 100,000 Words: A large-scale analysis of personality and word use among bloggers. , 2010, Journal of research in personality.

[48]  Etienne de Sevin,et al.  A listener model: introducing personality traits , 2012, Journal on Multimodal User Interfaces.

[49]  Alexander Gelbukh,et al.  Computational Linguistics and Intelligent Text Processing , 2015, Lecture Notes in Computer Science.

[50]  A. Nijholt Conversational Agents and the Construction of Humorous Acts , 2007 .

[51]  Mike Thelwall,et al.  An Interdisciplinary VR-architecture for 3D Chatting with Non-verbal Communication , 2011, EGVE/EuroVR.

[52]  Tom Ziemke,et al.  On the Role of Emotion in Embodied Cognitive Architectures: From Organisms to Robots , 2009, Cognitive Computation.

[53]  C. Nass,et al.  Are Machines Gender Neutral? Gender‐Stereotypic Responses to Computers With Voices , 1997 .

[54]  C. Nass,et al.  Are People Polite to Computers? Responses to Computer-Based Interviewing Systems1 , 1999 .

[55]  S. Argamon,et al.  Hedged Responses and Expressions of Affect in Human/Human and Human/Computer Tutorial Interactions , 2004 .

[56]  Denise C. Park,et al.  A lifespan database of adult facial stimuli , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[57]  Bosiljka Tadic,et al.  The Dynamics of Emotional Chats with Bots: Experiment and Agent-Based Simulations , 2014, ArXiv.

[58]  Clifford Nass,et al.  Consistency of personality in interactive characters: verbal cues, non-verbal cues, and user characteristics , 2000, Int. J. Hum. Comput. Stud..

[59]  Stefan Rank,et al.  Interacting with collective emotions in e-communities , 2014 .

[60]  Claudius Gros,et al.  Cognition and Emotion: Perspectives of a Closing Gap , 2010, Cognitive Computation.

[61]  Björn W. Schuller,et al.  Building Autonomous Sensitive Artificial Listeners , 2012, IEEE Transactions on Affective Computing.

[62]  J. Pennebaker,et al.  Linguistic styles: language use as an individual difference. , 1999, Journal of personality and social psychology.

[63]  W. Minker,et al.  Handling Emotions in Human-Computer Dialogues , 2009 .

[64]  Jonathan D. Cohen,et al.  The Neural Basis of Economic Decision-Making in the Ultimatum Game , 2003, Science.

[65]  Jacob Cohen,et al.  A power primer. , 1992, Psychological bulletin.

[66]  Stacy Marsella,et al.  Towards More Comprehensive Listening Behavior: Beyond the Bobble Head , 2011, IVA.

[67]  K. Williams,et al.  Cyberostracism: effects of being ignored over the Internet. , 2000, Journal of personality and social psychology.

[68]  Marcin Skowron,et al.  Affect Listeners: Acquisition of Affective States by Means of Conversational Systems , 2009, COST 2102 Training School.

[69]  James W. Pennebaker,et al.  Linguistic Inquiry and Word Count (LIWC2007) , 2007 .

[70]  Crystal L. Hoyt,et al.  Immersive Virtual Environment Technology as a Methodological Tool for Social Psychology , 2002 .

[71]  Gábor Tatai,et al.  Extraction of Affective Components from Texts and Their Use in Natural Language Dialogue Systems , 2004, Acta Cybern..

[72]  Youngme Moon Intimate Exchanges: Using Computers to Elicit Self-Disclosure from Consumers , 2000 .

[73]  M. Bradley,et al.  Affective Norms for English Words (ANEW): Instruction Manual and Affective Ratings , 1999 .

[74]  Georgios Paltoglou,et al.  Affect Bartender — Affective cues and their application in a conversational agent , 2011, 2011 IEEE Workshop on Affective Computational Intelligence (WACI).

[75]  Georgios Paltoglou,et al.  Entropy growth in emotional online dialogues , 2013 .

[76]  Marshall S. Smith,et al.  The general inquirer: A computer approach to content analysis. , 1967 .

[77]  J. Green,et al.  Affect In Language Learning , 2002 .

[78]  Mark H. Davis,et al.  A Multidimensional Approach to Individual Differences in Empathy , 1980 .

[79]  Arvid Kappas,et al.  Damping Sentiment Analysis in Online Communication: Discussions, Monologs and Dialogs , 2013, CICLing.

[80]  J. Marks Affect in Language Learning , 2001 .

[81]  F. Schweitzer,et al.  Emotional persistence in online chatting communities , 2012, Scientific Reports.

[82]  A. Kappas,et al.  Appraisals are direct, immediate, intuitive, and unwitting…and some are reflective… , 2006 .

[83]  Brigitte Krenn,et al.  Computational Framework for and the Realization of Cognitive Agents Providing Intelligent Assistance Capabilities , 2008 .

[84]  David DeSteno,et al.  Moral Hypocrisy , 2007, Psychological science.

[85]  Eric N. Forsyth Improving automated lexical and discourse analysis of online chat dialog , 2007 .

[86]  Cassandra L. Govan,et al.  Investigations into differences between social- and cyberostracism. , 2002 .

[87]  Yorick Wilks,et al.  Is There Progress on Talking Sensibly to Machines? , 2007, Science.

[88]  Dirk Heylen,et al.  How Agents' Turn-Taking Strategies Influence Impressions and Response Behaviors , 2011, Presence Teleoperators Virtual Environ..