A meta-analysis of the impact of the inclusion and realism of human-like faces on user experiences in interfaces

The use of embodied agents, defined as visual human-like representations accompanying a computer interface, is becoming prevalent in applications ranging from educational software to advertisements. In the current work, we assimilate previous empirical studies which compare interfaces with visually embodied agents to interfaces without agents, both using an informal, descriptive technique based on experimental results (46 studies) as well as a formal statistical meta-analysis (25 studies). Results revealed significantly larger effect sizes when analyzing subjective responses (i.e., questionnaire ratings, interviews) than when analyzing behavioral responses such as task performance and memory. Furthermore, the effects of adding an agent to an interface are larger than the effects of animating an agent to behave more realistically. However, the overall effect sizes were quite small (e.g., across studies, adding a face to an interface only explains approximately 2.5% of the variance in results). We discuss the implications for both designers building interfaces as well as social scientists designing experiments to evaluate those interfaces.

[1]  Fabri,et al.  Expressive Agents : Non-verbal Communication in Collaborative Virtual Environments , 2002 .

[2]  T. Koda,et al.  Agents with faces: the effect of personification , 1996, Proceedings 5th IEEE International Workshop on Robot and Human Communication. RO-MAN'96 TSUKUBA.

[3]  Dave J. Hobbs,et al.  Applied Artificial Intelligence: An International Journal , 2022 .

[4]  Suzanne P. Weisband,et al.  Self disclosure on computer forms: meta-analysis and implications , 1996, CHI.

[5]  Michael Lewis,et al.  Attentional Effect of Animated Character , 2003, INTERACT.

[6]  R. Rosenthal,et al.  Meta-analysis: recent developments in quantitative methods for literature reviews. , 2001, Annual review of psychology.

[7]  F Y Chan,et al.  Is talking to an automated teller machine natural and fun? , 2003, Ergonomics.

[8]  Bill Tomlinson,et al.  Embodied mobile agents , 2006, AAMAS '06.

[9]  Clifford Nass,et al.  Experimental Tests of Normative Group Influence and Representation Effects in Computer-Mediated Communication: When Interacting Via Computers Differs from Interacting With Computers. , 2002 .

[10]  S. Kiesler,et al.  A Prisoner's Dilemma Experiment on Cooperation With People and Human-Like Computers , 1996 .

[11]  Akikazu Takeuchi,et al.  Situated facial displays: towards social interaction , 1995, CHI '95.

[12]  Heike Schaumburg,et al.  Computers as Tools or as Social Actors? - The Users' Perspective on Anthropomorphic Agents , 2001, Int. J. Cooperative Inf. Syst..

[13]  Christoph Bartneck,et al.  How Convincing is Mr. Data's Smile: Affective Expressions of Machines , 2001, User Modeling and User-Adapted Interaction.

[14]  David W. Park,et al.  Interpersonal Effects in Computer-Mediated Interaction , 1994 .

[15]  J. Cassell,et al.  Nudge nudge wink wink: elements of face-to-face conversation for embodied conversational agents , 2001 .

[16]  Mark A. Fuller,et al.  Involvement and Decision-Making Performance with a Decision Aid: The Influence of Social Multimedia, Gender, and Playfulness , 2005, J. Manag. Inf. Syst..

[17]  Mel Slater,et al.  How Colorful Was Your Day? Why Questionnaires Cannot Assess Presence in Virtual Environments , 2004, Presence: Teleoperators & Virtual Environments.

[18]  Pietro Murano Effectiveness of mapping human-oriented information to feedback from a software interface , 2002, ITI 2002. Proceedings of the 24th International Conference on Information Technology Interfaces (IEEE Cat. No.02EX534).

[19]  J. Bailenson,et al.  Virtual Humans and Persuasion: The Effects of Agency and Behavioral Realism , 2007 .

[20]  Crystal L. Hoyt,et al.  Immersive Virtual Environment Technology as a Methodological Tool for Social Psychology , 2002 .

[21]  Andrew J. Cowell,et al.  Increasing the credibility of anthropomorphic computer characters: the effects of manipulating nonverbal interaction style and demographic embodiment , 2001 .

[22]  Susanne van Mulken,et al.  The impact of animated interface agents: a review of empirical research , 2000, Int. J. Hum. Comput. Stud..

[23]  Joseph B. Walther,et al.  Is a Picture Worth a Thousand Words? , 2001, Commun. Res..

[24]  Agneta Gulz,et al.  Social enrichment by virtual characters - differential benefits , 2005, J. Comput. Assist. Learn..

[25]  Byron Reeves,et al.  The effects of animated characters on anxiety, task performance, and evaluations of user interfaces , 2000, CHI.

[26]  Elisabeth André,et al.  An empirical study on the trustworthiness of life-like interface agents , 1999, HCI.

[27]  Norah E. Dunbar,et al.  Designing interfaces to maximize the quality of collaborative work , 1999, Proceedings of the 32nd Annual Hawaii International Conference on Systems Sciences. 1999. HICSS-32. Abstracts and CD-ROM of Full Papers.

[28]  Elisabeth André,et al.  The Persona Effect: How Substantial Is It? , 1998, BCS HCI.

[29]  Alan Wexelblat,et al.  Don't Make That Face: a report on anthropomorphizing an interface , 1998 .

[30]  J. Cassell,et al.  Towards a model of technology and literacy development: Story listening systems , 2004 .

[31]  Mervyn A. Jack,et al.  Evaluating humanoid synthetic agents in e-retail applications , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[32]  Richard Catrambone,et al.  Embodied Conversational Agents as a UI Paradigm: A Framework for Evaluation , 2002 .

[33]  Chris Schmandt,et al.  Physical embodiments for mobile communication agents , 2005, UIST '05.

[34]  James C. Lester,et al.  The Case for Social Agency in Computer-Based Teaching: Do Students Learn More Deeply When They Interact With Animated Pedagogical Agents? , 2001 .

[35]  Roel Vertegaal,et al.  Explaining effects of eye gaze on mediated group conversations:: amount or synchronization? , 2002, CSCW '02.

[36]  Maria Virvou,et al.  Evaluating the persona effect of an interface agent in a tutoring system , 2002, J. Comput. Assist. Learn..

[37]  Nicole C. Krämer,et al.  Computer Animated Movement and Person Perception: Methodological Advances in Nonverbal Behavior Research , 2001 .

[38]  Randall W. Hill,et al.  Toward Virtual Humans , 2006, AI Mag..

[39]  Mitsuru Ishizuka,et al.  Using human physiology to evaluate subtle expressivity of a virtual quizmaster in a mathematical game , 2005, Int. J. Hum. Comput. Stud..

[40]  Julita Vassileva,et al.  Affective pedagogical agents and user persuasion , 2001, HCI.

[41]  Lee Sproull,et al.  Using a human face in an interface , 1994, CHI '94.

[42]  Jeremy N. Bailenson,et al.  A Longitudinal Study of Task Performance, Head Movements, Subjective Report, Simulator Sickness, and Transformed Social Interaction in Collaborative Virtual Environments , 2006, PRESENCE: Teleoperators and Virtual Environments.

[43]  Kristina Höök,et al.  Evaluating Users' Experience of a Character-enhanced Information Space , 2000, AI Commun..

[44]  Gwenn W. Gröndal,et al.  Meta-analytic procedures for social research , 1993 .

[45]  Jeremy N. Bailenson,et al.  Equilibrium Theory Revisited: Mutual Gaze and Personal Space in Virtual Environments , 2001, Presence: Teleoperators & Virtual Environments.

[46]  Lee Sproull,et al.  When the Interface Is a Face , 1996, Hum. Comput. Interact..

[47]  Tomoko Koda,et al.  User reactions to antrhopomorphized interface , 2003 .

[48]  Christian Rauh,et al.  The Influence of the Avatar on Online Perceptions of Anthropomorphism, Androgyny, Credibility, Homophily, and Attraction , 2005, J. Comput. Mediat. Commun..

[49]  C. Nass,et al.  Are People Polite to Computers? Responses to Computer-Based Interviewing Systems1 , 1999 .

[50]  Mitsuru Ishizuka,et al.  Understanding the effect of life-like interface agents through users' eye movements , 2005, ICMI '05.

[51]  Heloir,et al.  The Uncanny Valley , 2019, The Animation Studies Reader.

[52]  Judee K. Burgoon,et al.  The role of expectations in human-computer interaction , 1999, GROUP.

[53]  Larry F. Hodges,et al.  Can a virtual cat persuade you?: the role of gender and realism in speaker persuasiveness , 2006, CHI.

[54]  J. Burgoon,et al.  Interactivity in human–computer interaction: a study of credibility, understanding, and influence , 2000 .

[55]  Robbert-Jan Beun,et al.  Embodied Conversational Agents: Effects on Memory Performance and Anthropomorphisation , 2003, IVA.

[56]  Johan F. Hoorn,et al.  Realism is not all! User engagement with task-related interface characters , 2007, Interact. Comput..

[57]  Nicole C. Krämer,et al.  Social Communicative Effects of a Virtual Program Guide , 2005, IVA.

[58]  Jeremy N. Bailenson,et al.  Gaze and task performance in shared virtual environments , 2002, Comput. Animat. Virtual Worlds.

[59]  Maria Virvou,et al.  Evaluating the Persona Effect of an Interface Agent in an Intelligent Tutoring System , 2002 .

[60]  Arne Jönsson,et al.  The role of spoken feedback in experiencing multimodal interfaces as human-like , 2003, ICMI '03.

[61]  Susan Persky,et al.  The Independent and Interactive Effects of Embodied-Agent Appearance and Behavior on Self-Report, Cognitive, and Behavioral Markers of Copresence in Immersive Virtual Environments , 2005, Presence: Teleoperators & Virtual Environments.

[62]  J. Loomis,et al.  Interpersonal Distance in Immersive Virtual Environments , 2003, Personality & social psychology bulletin.

[63]  Antti Oulasvirta,et al.  A cognitive meta-analysis of design approaches to interruptions in intelligent environments , 2004, CHI EA '04.