RSMG Progress Report 2 Social-Emotional Relationships With Embodied Interface Agents

Human-computer relationships are social and emotional in nature. We willingly (often unconsciously) interact with computers as though they are social entities and as such, our interaction with computers can have a strong impact upon our emotional states. This socialemotional interaction with computers forms the basis of my research interests and the work which I have investigated to date. Abstract questions, such as which relational strategies can be used to enhance human-computer relationships and what effect does the “expression” of emotion by a computer have on our performance and perceptions of that computer, are questions of particular interest to me. Furthermore, this interest extends to that of interface agents of varying types. Which type of interface agent (e.g. embodied, textual or speechbased), used in which domain (e.g. entertainment, business, education), affects which aspects of our behaviour, responses and perceptions? How can relational strategies be incorporated into interface agents of different types? What influence do these relational strategies, or illusions of human emotion, have over our perceptions of interface agents? These are the types of questions that I am particularly interested in investigating further.

[1]  P. Ekman.  Universals and cultural differences in facial expressions of emotion. , 1972 .

[2]  J. Eccles.  The emotional brain. , 1980, Bulletin et memoires de l'Academie royale de medecine de Belgique.

[3]  J. Russell,et al.  Concept of Emotion Viewed From a Prototype Perspective , 1984 .

[4]  A. Isen,et al.  Positive affect facilitates creative problem solving. , 1987, Journal of personality and social psychology.

[5]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[6]  R. Thayer.  The biopsychology of mood and arousal , 1989 .

[7]  J. Bryant,et al.  Responding to the screen : reception and reaction processes , 1991 .

[8]  John J. Magee,et al.  Categorical perception of facial expressions , 1992, Cognition.

[9]  A. Isen,et al.  Positive affect and decision making. , 1993 .

[10]  Iain R. Murray,et al.  Toward the simulation of emotion in synthetic speech: a review of the literature on human vocal emotion. , 1993, The Journal of the Acoustical Society of America.

[11]  Joseph Bates,et al.  The role of emotion in believable agents , 1994, CACM.

[12]  B. J. Fogg,et al.  Can computer personalities be human personalities? , 1995, Int. J. Hum. Comput. Stud..

[13]  E. Hatfield,et al.  Emotional Contagion , 1995 .

[14]  Tomoko Koda,et al.  Agents with faces : a study on the effects of personification of software agents , 1996 .

[15]  Lee Sproull,et al.  When the Interface Is a Face , 1996, Hum. Comput. Interact..

[16]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[17]  David Salesin,et al.  Comic Chat , 1996, SIGGRAPH.

[18]  B. J. Fogg,et al.  Silicon sycophants: the effects of computers that flatter , 1997, Int. J. Hum. Comput. Stud..

[19]  H. Reis,et al.  Attraction and close relationships. , 1998 .

[20]  B. Kushner.  Descartes' error. , 1998, Journal of AAPOS : the official publication of the American Association for Pediatric Ophthalmology and Strabismus.

[21]  Elisabeth André,et al.  The Persona Effect: How Substantial Is It? , 1998, BCS HCI.

[22]  Aaron Sloman,et al.  Architectural requirements for human-like agents both natural and artificial , 1998 .

[23]  K. Chang,et al.  Embodiment in conversational interfaces: Rea , 1999, CHI '99.

[24]  Kristinn R. Thórisson,et al.  Mind Model for Multimodal Communicative Creatures and Humanoids , 1999, Appl. Artif. Intell..

[25]  W. Lewis Johnson,et al.  Animated Agents for Procedural Training in Virtual Reality: Perception, Cognition, and Motor Control , 1999, Appl. Artif. Intell..

[26]  Aaron Sloman,et al.  7. Architectural Requirements for Human-Like Agents Both Natural and Artificial: What sorts of machines can love? , 2000 .

[27]  Youngme Moon.  Intimate Exchanges: Using Computers to Elicit Self-Disclosure from Consumers , 2000 .

[28]  Susanne van Mulken,et al.  The impact of animated interface agents: a review of empirical research , 2000, Int. J. Hum. Comput. Stud..

[29]  Hao Yan,et al.  More than just a pretty face: affordances of embodiment , 2000, IUI '00.

[30]  Thomas Rist,et al.  Three RoboCup Simulation League Commentator Systems , 2000, AI Mag..

[31]  Charles B. Callaway,et al.  Cosmo: A Life-like Animated Pedagogical Agent with Deictic Believability (cid:3) , 1997 .

[32]  Carson Reynolds.  Designing for Affective Interactions , 2001 .

[33]  Jonathan Klein,et al.  Computers that recognise and respond to user emotion: theoretical and practical implications , 2002, Interact. Comput..

[34]  Justine Cassell,et al.  Relational agents: a model and implementation of building user trust , 2001, CHI.

[35]  Rosalind W. Picard.  The Galvactivator: A glove that senses and communicates skin conductivity , 2001 .

[36]  C. Nass,et al.  Does computer-synthesized speech manifest personality? Experimental tests of recognition, similarity-attraction, and consistency-attraction. , 2001, Journal of experimental psychology. Applied.

[37]  Jonathan Klein,et al.  Frustrating the user on purpose: a step toward building an affective computer , 2002, Interact. Comput..

[38]  Jonathan Klein,et al.  This computer responds to user frustration: Theory, design, and results , 2002, Interact. Comput..

[39]  Rosalind W. Picard,et al.  Towards a Learning Companion that Recognizes Affect , 2001 .

[40]  Yukiko I. Nakano,et al.  MACK: Media lab Autonomous Conversational Kiosk , 2002 .

[41]  Ashish Kapoor,et al.  Real-time, fully automatic upper facial feature tracking , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[42]  Clifford Nass,et al.  Emotion in human-computer interaction , 2002 .

[43]  Christoph Bartneck,et al.  eMuu : an embodied emotional character for the ambient intelligent home , 2002 .

[44]  D. Massaro,et al.  Development and Evaluation of a Computer-Animated Tutor for Vocabulary and Language Learning in Children with Autism , 2003, Journal of autism and developmental disorders.

[45]  T. Bickmore.  Relational agents : effecting change through human-computer relationships , 2003 .

[46]  Mitsuru Ishizuka,et al.  Evaluation of an Embodied Conversational Agent with Affective Behavior , 2003 .

[47]  James C. Lester,et al.  Lifelike Pedagogical Agents for Mixed-initiative Problem Solving in Constructivist Learning Environments , 2004, User Modeling and User-Adapted Interaction.

[48]  Stacy Marsella,et al.  A domain-independent framework for modeling emotion , 2004, Cognitive Systems Research.

[49]  Winslow Burleson,et al.  Affective agents: Sustaining motivation to learn through failure and state of "stuck" , 2004 .

[50]  Winslow Burleson,et al.  Affective learning companions , 2004 .

[51]  Mitsuru Ishizuka,et al.  Life-like characters - tools, affective functions, and applications , 2004, Life-like characters.

[52]  Clifford Nass,et al.  Computers that care: investigating the effects of orientation of emotion exhibited by an embodied computer agent , 2005, Int. J. Hum. Comput. Stud..

[53]  J. Cassell,et al.  SOCIAL DIALOGUE WITH EMBODIED CONVERSATIONAL AGENTS , 2005 .

[54]  Fiorella de Rosis,et al.  AISB ’ 05 Virtual Social Characters Symposium Can Embodied Conversational Agents Induce Empathy In Users ? , 2005 .

[55]  Scott McGlashan,et al.  Olga - a conversational agent with gestures , 2007 .