Mimicry and expressiveness of an ECA in human-agent interaction: familiarity breeds content!

Background Two experiments investigated the effect of features of human behaviour on the quality of interaction with an Embodied Conversational Agent (ECA). Methods In Experiment 1, visual prominence cues (head nod, eyebrow raise) of the ECA were manipulated to explore the hypothesis that likeability of an ECA increases as a function of interpersonal mimicry. In the context of an error detection task, the ECA either mimicked or did not mimic a head nod or brow raise that humans produced to give emphasis to a word when correcting the ECA’s vocabulary. In Experiment 2, presence versus absence of facial expressions on comprehension accuracy of two computer-driven ECA monologues was investigated. Results In Experiment 1, evidence for a positive relationship between ECA mimicry and lifelikeness was obtained. However, a mimicking agent did not elicit more human gestures. In Experiment 2, expressiveness was associated with greater comprehension and higher ratings of humour and engagement. Conclusion Influences from mimicry can be explained by visual and motor simulation, and bidirectional links between similarity and liking. Cue redundancy and minimizing cognitive load are potential explanations for expressiveness aiding comprehension. Electronic supplementary material The online version of this article (doi:10.1186/s40469-016-0008-2) contains supplementary material, which is available to authorized users.

[1]  IEEE Recommended Practice for Speech Quality Measurements , 1969, IEEE Transactions on Audio and Electroacoustics.

[2]  Stefan Kopp,et al.  Modeling a Social Brain for Interactive Agents: Integrating Mirroring and Mentalizing , 2015, IVA.

[3]  Peter Hagoort,et al.  In dialogue with an avatar, language behavior is identical to dialogue with a human partner , 2015, Behavior Research Methods.

[4]  Guillaume Gibert,et al.  Evaluating a synthetic talking head using a dual task: Modality effects on speech understanding and cognitive load , 2013, Int. J. Hum. Comput. Stud..

[5]  Sharon K Tindall-Ford,et al.  When two sensory modes are better than one , 1997 .

[6]  Graham I. Johnson,et al.  Gendering the Machine: Preferred Virtual Assistant Gender and Realism in Self-Service , 2013, IVA.

[7]  Claire Dormann,et al.  Embodied Conversational Agents on a Common Ground , 2004, From Brows to Trust.

[8]  Yoshihisa Kashima,et al.  The stereotyper and the chameleon: The effects of stereotype use on perceivers’ mimicry , 2009 .

[9]  Stefan Kopp,et al.  Socially Cooperative Behavior for Artificial Companions for Elderly and Cognitively Impaired People , 2015, ISCT.

[10]  Michael Neff,et al.  An Examination of Whether People Prefer Agents Whose Gestures Mimic Their Own , 2013, IVA.

[11]  Trent W. Lewis,et al.  Language teaching in a mixed reality games environment , 2008, PETRA '08.

[12]  Maurizio Mancini,et al.  Expressive Copying Behavior for Social Agents: A Perceptual Analysis , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[13]  Markus Lappe,et al.  When humanoid robots become human-like interaction partners: corepresentation of robotic actions. , 2012, Journal of experimental psychology. Human perception and performance.

[14]  Cynthia Breazeal,et al.  Detecting the Trustworthiness of Novel Partners in Economic Exchange , 2012, Psychological science.

[15]  T. Chartrand,et al.  The chameleon effect: the perception-behavior link and social interaction. , 1999, Journal of personality and social psychology.

[16]  Kristina Höök,et al.  User-Centred Design and Evaluation of Affective Interfaces , 2004, From Brows to Trust.

[17]  Björn Granström,et al.  Audiovisual representation of prosody in expressive speech communication , 2004, Speech Commun..

[18]  Stefan Kopp,et al.  Smile and the world will smile with you - The effects of a virtual agent's smile on users' evaluation and behavior , 2013, Int. J. Hum. Comput. Stud..

[19]  Sin-Hwa Kang,et al.  The impact of avatar realism and anonymity on effective communication via mobile devices , 2013, Comput. Hum. Behav..

[20]  N. Guéguen,et al.  Incidental Similarity Facilitates Behavioral Mimicry , 2009 .

[21]  Catherine Pelachaud,et al.  An ECA expressing appreciations , 2015, 2015 International Conference on Affective Computing and Intelligent Interaction (ACII).

[22]  Serengul Smith,et al.  An Empirical Study on the Effects of Embodied Conversational Agents on User Retention Performance and Perception in a Simulated Mobile Environment , 2013, Intelligent Environments.

[23]  Christine L. Lisetti,et al.  Why and How to Build Emotion-Based Agent Architectures , 2015 .

[24]  Jay F. Nunamaker,et al.  Embodied Conversational Agent-Based Kiosk for Automated Interviewing , 2011, J. Manag. Inf. Syst..

[25]  R. Zajonc Attitudinal effects of mere exposure. , 1968 .

[26]  Marc Swerts,et al.  More About Brows , 2004, From Brows to Trust.

[27]  U. Hess,et al.  The impact of social context on mimicry , 2008, Biological Psychology.

[28]  Kostas Karpouzis,et al.  Virtual agent multimodal mimicry of humans , 2007, Lang. Resour. Evaluation.

[29]  Cynthia Breazeal,et al.  Human social response toward humanoid robot's head and facial features , 2010, CHI Extended Abstracts.

[30]  Eric O. Postma,et al.  Mirror mirror on the wall: Is there mimicry in you all? , 2015, J. Ambient Intell. Smart Environ..

[31]  Jeesun Kim,et al.  Prosody off the top of the head: Prosodic contrasts can be discriminated by head motion , 2010, Speech Commun..

[32]  L. Miles,et al.  Implicit Behavioral Mimicry: Investigating the Impact of Group Membership , 2006 .

[33]  Frederick G. Conrad,et al.  Comprehension and engagement in survey interviews with virtual agents , 2015, Front. Psychol..

[34]  L. Riek,et al.  Real-Time Empathy : Facial Mimicry on a Robot , 2008 .

[35]  T. Chartrand,et al.  The Chameleon Effect as Social Glue: Evidence for the Evolutionary Significance of Nonconscious Mimicry , 2003 .

[36]  Douglas W. Cunningham,et al.  Multimodal Affect , 2015, ACM Trans. Appl. Percept..

[37]  Elisabetta Bevacqua,et al.  Multimodal Backchannels for Embodied Conversational Agents , 2010, IVA.

[38]  S. Heine,et al.  Do birds of a feather universally flock together? Cultural variation in the similarity-attraction effect , 2009 .

[39]  María L. Flecha-García,et al.  Eyebrow raises in dialogue and their relation to discourse structure, utterance function and pitch accents in English , 2010, Speech Commun..

[40]  C. Nass,et al.  Machines and Mindlessness , 2000 .

[41]  Takaaki Kuratate,et al.  From talking to thinking heads: report 2008 , 2008, AVSP.

[42]  Catherine J. Stevens,et al.  "C'Mon dude!": Users adapt their behaviour to a robotic agent with an attention model , 2015, Int. J. Hum. Comput. Stud..