Embodied Conversational Agents on a Common Ground

One would like to rely on design guidelines for embodied conversational agents (ECAs), grounded on evaluation studies. How to define the physical and mental characteristics of an ECA, optimal for an envisioned application? What will be the added value of using an ECA? Although there have been studies addressing such issues, we are still far from getting a complete picture. This is not only due to the still relatively little experience with applications of ECAs, but also to the diversity in terms and experimental settings used. The lack of a common, established framework makes it difficult to compare ECAs, interpret evaluation results and judge their scope and relevance. In this chapter we propose a common taxonomy of the relevant design and evaluation aspects of ECAs. We refer to recent works to elicit evaluation concepts and discuss measurement issues.

[1]  Katherine Isbister,et al.  Social Implications of Using Synthetic Characters: An Examination of a Role-Specific Intelligent Agent , 1998 .

[2]  Justine Cassell,et al.  Fully Embodied Conversational Avatars: Making Communicative Behaviors Autonomous , 1999, Autonomous Agents and Multi-Agent Systems.

[3]  D. Christopher Dryer,et al.  Getting Personal with Computers: How to Design Personalities for Agents , 1999, Appl. Artif. Intell..

[4]  Jun Ohya,et al.  The representation of agents: anthropomorphism, agency, and intelligence , 1996, CHI Conference Companion.

[5]  Maria Virvou,et al.  Evaluating the persona effect of an interface agent in a tutoring system , 2002, J. Comput. Assist. Learn..

[6]  Thomas Rist,et al.  Presenting through performing: on the use of multiple lifelike characters in knowledge-based presentation systems , 2000, IUI '00.

[7]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[8]  Clifford Nass,et al.  Does computer-generated speech manifest personality? an experimental test of similarity-attraction , 2000, CHI.

[9]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[10]  J. Russell,et al.  Evidence for a three-factor theory of emotions , 1977 .

[11]  Amy L. Baylor,et al.  The impact of three pedagogical agent roles , 2003, AAMAS '03.

[12]  Lee Sproull,et al.  When the Interface Is a Face , 1996, Hum. Comput. Interact..

[13]  Mitsuru Ishizuka,et al.  Designing and Evaluating animated agents as social actors , 2003 .

[14]  Clifford Nass,et al.  Helper agent: designing an assistant for human-human interaction in a virtual meeting space , 2000, CHI.

[15]  C. Nass,et al.  Truth is beauty: researching embodied conversational agents , 2001 .

[16]  Richard Catrambone,et al.  Embodied Conversational Agents as a UI Paradigm: A Framework for Evaluation , 2002 .

[17]  Byron Reeves,et al.  The effects of animated characters on anxiety, task performance, and evaluations of user interfaces , 2000, CHI.

[18]  Izak Benbasat,et al.  An experimental study of the human/computer interface , 1981, CACM.

[19]  Mervyn A. Jack,et al.  Experimental assessment of the effectiveness of synthetic personae for multi-modal e-retail applications , 2000, AGENTS '00.

[20]  Susanne van Mulken,et al.  The impact of animated interface agents: a review of empirical research , 2000, Int. J. Hum. Comput. Stud..

[21]  D. Massaro,et al.  Perceiving Talking Faces , 1995 .

[22]  Kristina Höök,et al.  Evaluating Users' Experience of a Character-enhanced Information Space , 2000, AI Commun..

[23]  Gregory A. Sanders,et al.  Measurement and evaluation of embodied conversational agents , 2001 .

[24]  C. Pelachaud,et al.  Transcultural believability in embodied agents: a matter of consistent adaptation , 2004 .

[25]  Mark Witkowski,et al.  Evaluating User Reaction to Character Agent Mediated Displays using Eye-tracking Technology , 2004 .

[26]  Clifford Nass,et al.  Consistency of personality in interactive characters: verbal cues, non-verbal cues, and user characteristics , 2000, Int. J. Hum. Comput. Stud..

[27]  Bruce Blumberg,et al.  Object persistence for synthetic creatures , 2002, AAMAS '02.

[28]  Justine Cassell,et al.  External manifestations of trustworthiness in the interface , 2000, CACM.

[29]  Paul Resnik,et al.  The Influence of Self-Esteem on Cognitive Responses to Machine-Like versus Human-Like Computer Feedback , 1985 .

[30]  김종식 동아시아 문화와 경영, Geert Hofstede, Culture's Consequences: International Differences in Work-Related Values (Beverly Hills, CA:Sage Publications, 1980) ; and Cultures and Organizations : Software of the Mind (New York:McGraw-Hill, 1997) , 1999 .

[31]  Catherine Pelachaud,et al.  Subtleties of facial expressions in embodied agents , 2002, Comput. Animat. Virtual Worlds.

[32]  Katherine Isbister,et al.  Design and Evaluation of Embodied Conversational Agents: A Proposed Taxonomy , 2002 .

[33]  Aldo Paradiso,et al.  A Model for the Generation and Combination of Emotional Expressions , 2001 .

[34]  Kristinn R. Thórisson,et al.  The Power of a Nod and a Glance: Envelope Vs. Emotional Feedback in Animated Conversational Agents , 1999, Appl. Artif. Intell..

[35]  Justine Cassell,et al.  Relational agents: a model and implementation of building user trust , 2001, CHI.

[36]  James C. Lester,et al.  The persona effect: affective impact of animated pedagogical agents , 1997, CHI.

[37]  Helen McBreen,et al.  Evaluating 3D Embodied Conversational Agents In Contrasting VRML Retail Applications , 2000 .

[38]  Mitsuru Ishizuka,et al.  Social role awareness in animated agents , 2001, AGENTS '01.

[39]  Mitsuru Ishizuka,et al.  Evaluation of an Embodied Conversational Agent with Affective Behavior , 2003 .

[40]  R. McCrae,et al.  An introduction to the five-factor model and its applications. , 1992, Journal of personality.

[41]  Buisine Stéphanie,et al.  Evaluation of Individual Multimodal Behavior of 2D Embodied Agents in Presentation Tasks , 2003 .

[42]  Andrew J. Cowell,et al.  On Manipulating Nonverbal Interaction Style to Increase Anthropomorphic Computer Character Credibility , 2003 .

[43]  Jeremy N. Bailenson,et al.  Intelligent Agents Who Wear Your Face: Users' Reactions to the Virtual Self , 2001, IVA.

[44]  Elisabeth André,et al.  The Persona Effect: How Substantial Is It? , 1998, BCS HCI.

[45]  R. Larsen,et al.  Affect intensity as an individual difference characteristic: A review , 1987 .

[46]  Catherine Pelachaud,et al.  Embodied contextual agent in information delivering application , 2002, AAMAS '02.