Using Emotion Simulation to Influence User Attitudes and Behaviour

Humans have a natural tendency to unconsciously treat computers as though they are social actors. Many of the human-human social rules that have been well researched and defined in social psychology also seem to apply in human-computer interaction (HCI). This presents an opportunity for computers to use many of the principles and rules from human-human interaction and utilise them for enhancing HCI. One such set of principles that have been extensively investigated and examined in social psychology are influence strategies. A number of different approaches and techniques can be used to influence another’s attitudes and behaviour. These persuasive techniques could potentially be used by computers to influence or change user attitudes and behaviour for beneficial purposes (e.g. smoking cessation or improving exercise behaviour). In this project I will investigate how we respond to interface agents which make use of influence strategies when attempting to change our attitudes and behaviour toward eating. The manipulation of emotions is an essential aspect of attitude and behaviour change and it is proposed that the role of emotion in HCI will also be investigated. Interface designers often incorporate emotional expressions and statements into interface agents, through the use of textual content, synthetic or recorded speech, embodied characters, or multimedia video, without an understanding of the psychological impact on users. Moreover, it is largely unknown how strong user responses are to the synthetic emotional expressions made by computers. I will attempt to address these issues through three different investigations. Firstly, an examination of how users respond to the emotional expressions of different types of interface agents will be undertaken. Secondly, an investigation will be conducted to help understand whether agents that make use of influence strategies are able to influence or change user attitudes and behaviour more effectively than agents which do not. Finally, I will test whether emotional interface agents (which employ influence tactics) are able to influence or change user attitudes and behaviour more effectively than unemotional agents.

[1]  P. Ekman Universals and cultural differences in facial expressions of emotion. , 1972 .

[2]  Pattie Maes,et al.  Agents that reduce work and information overload , 1994, CACM.

[3]  J. Bryant,et al.  Responding to the screen : reception and reaction processes , 1991 .

[4]  Winslow Burleson,et al.  Affective agents: Sustaining motivation to learn through failure and state of "stuck" , 2004 .

[5]  Aaron Sloman,et al.  7. Architectural Requirements for Human-Like Agents Both Natural and Artificial: What sorts of machines can love? , 2000 .

[6]  Timothy W. Bickmore,et al.  Establishing and maintaining long-term human-computer relationships , 2005, TCHI.

[7]  J. Eccles The emotional brain. , 1980, Bulletin et memoires de l'Academie royale de medecine de Belgique.

[8]  B. J. Fogg,et al.  Silicon sycophants: the effects of computers that flatter , 1997, Int. J. Hum. Comput. Stud..

[9]  Mervyn A. Jack,et al.  Evaluating humanoid synthetic agents in e-retail applications , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[10]  Justine Cassell,et al.  Relational agents: a model and implementation of building user trust , 2001, CHI.

[11]  Christoph Bartneck,et al.  eMuu : an embodied emotional character for the ambient intelligent home , 2002 .

[12]  Mikko Sams,et al.  Identification of synthetic and natural emotional facial expressions , 2003, AVSP.

[13]  Sean A. Spence,et al.  Descartes' Error: Emotion, Reason and the Human Brain , 1995 .

[14]  B. J. Fogg,et al.  Can computer personalities be human personalities? , 1995, Int. J. Hum. Comput. Stud..

[15]  Akikazu Takeuchi,et al.  Communicative facial displays as a new conversational modality , 1993, INTERCHI.

[16]  Kristinn R. Thórisson,et al.  The Power of a Nod and a Glance: Envelope Vs. Emotional Feedback in Animated Conversational Agents , 1999, Appl. Artif. Intell..

[17]  Ass,et al.  Can computers be teammates? , 1996 .

[18]  Youngme Moon Intimate Exchanges: Using Computers to Elicit Self-Disclosure from Consumers , 2000 .

[19]  M. Fabri,et al.  Emotive Signals for Virtual Worlds , 2002 .

[20]  J. Ventura,et al.  Animated Agents: Motivational Consequences , 2004, IEEE SoutheastCon, 2004. Proceedings..

[21]  Timothy W. Bickmore,et al.  Towards caring machines , 2004, CHI EA '04.

[22]  Hao Yan,et al.  More than just a pretty face: affordances of embodiment , 2000, IUI '00.

[23]  T. Koda,et al.  Agents with faces: the effect of personification , 1996, Proceedings 5th IEEE International Workshop on Robot and Human Communication. RO-MAN'96 TSUKUBA.

[24]  Mitsuru Ishizuka,et al.  Persona Effect Revisited --- Using Bio-signals to Measure and Reflect the Impact of Character-bas , 2003 .

[25]  Dylan Evans Emotion: A Very Short Introduction , 2019 .

[26]  E. Hatfield,et al.  Emotional Contagion , 1995 .

[27]  C. Nass,et al.  Does computer-synthesized speech manifest personality? Experimental tests of recognition, similarity-attraction, and consistency-attraction. , 2001, Journal of experimental psychology. Applied.

[28]  Jonathan Klein,et al.  Computers that recognise and respond to user emotion: theoretical and practical implications , 2002, Interact. Comput..

[29]  Clifford Nass,et al.  Humor in task-oriented computer-mediated communication and human-computer interaction , 1998, CHI Conference Summary.

[30]  Christoph Bartneck,et al.  Interacting with an embodied emotional character , 2003, DPPI '03.

[31]  T. Bickmore Relational agents : effecting change through human-computer relationships , 2003 .

[32]  Clifford Nass,et al.  Computers that care: investigating the effects of orientation of emotion exhibited by an embodied computer agent , 2005, Int. J. Hum. Comput. Stud..

[33]  Kristina Höök,et al.  Evaluating Users' Experience of a Character-enhanced Information Space , 2000, AI Commun..

[34]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[35]  James C. Lester,et al.  The persona effect: affective impact of animated pedagogical agents , 1997, CHI.

[36]  Susanne van Mulken,et al.  The impact of animated interface agents: a review of empirical research , 2000, Int. J. Hum. Comput. Stud..

[37]  Jun Ohya,et al.  The representation of agents: anthropomorphism, agency, and intelligence , 1996, CHI Conference Companion.

[38]  Jonathan Klein,et al.  This computer responds to user frustration: Theory, design, and results , 2002, Interact. Comput..

[39]  A. Isen,et al.  Positive affect and decision making. , 1993 .

[40]  Christoph Bartneck,et al.  How Convincing is Mr. Data's Smile: Affective Expressions of Machines , 2001, User Modeling and User-Adapted Interaction.

[41]  B. J. Fogg,et al.  Persuasive technology: using computers to change what we think and do , 2002, UBIQ.

[42]  Michael Lewis,et al.  The effects of animated character in multimedia presentation: attention and comprehension , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[43]  Rosalind W. Picard,et al.  Embedded Empathy in Continuous, Interactive Health Assessment , 2005 .

[44]  M. F.,et al.  Bibliography , 1985, Experimental Gerontology.

[45]  Lee Sproull,et al.  When the Interface Is a Face , 1996, Hum. Comput. Interact..

[46]  Fabio Pianesi,et al.  Preliminary Cross-Cultural Evaluation of Expressiveness in Synthetic Faces , 2004, ADS.

[47]  Akikazu Takeuchi,et al.  Situated facial displays: towards social interaction , 1995, CHI '95.

[48]  Aude Dufresne,et al.  Modeling the Learner Preferences for Embodied Agents: Experimenting with the Control of Humor , 2002 .

[49]  Elisabeth André,et al.  The Persona Effect: How Substantial Is It? , 1998, BCS HCI.

[50]  R. Cialdini Influence: Science and Practice , 1984 .

[51]  Iain R. Murray,et al.  Toward the simulation of emotion in synthetic speech: a review of the literature on human vocal emotion. , 1993, The Journal of the Acoustical Society of America.

[52]  Julita Vassileva,et al.  Affective pedagogical agents and user persuasion , 2001, HCI.

[53]  A. Isen,et al.  Positive affect facilitates creative problem solving. , 1987, Journal of personality and social psychology.