Exploring Virtual Agents for Augmented Reality

Prior work has shown that embodiment can benefit virtual agents, such as increasing rapport and conveying non-verbal information. However, it is unclear if users prefer an embodied to a speech-only agent for augmented reality (AR) headsets that are designed to assist users in completing real-world tasks. We conducted a study to examine users' perceptions and behaviors when interacting with virtual agents in AR. We asked 24 adults to wear the Microsoft HoloLens and find objects in a hidden object game while interacting with an agent that would offer assistance. We presented participants with four different agents: voice-only, non-human, full-size embodied, and a miniature embodied agent. Overall, users preferred the miniature embodied agent due to the novelty of his size and reduced uncanniness as opposed to the larger agent. From our results, we draw conclusions about how agent representation matters and derive guidelines on designing agents for AR headsets.

[1]  Ning Wang,et al.  Don't just stare at me! , 2010, CHI.

[2]  R. Mayer,et al.  An embodiment effect in computer-based learning with animated pedagogical agents. , 2012, Journal of experimental psychology. Applied.

[3]  Yuichiro Yoshikawa,et al.  Responsive Robot Gaze to Interaction Partner , 2006, Robotics: Science and Systems.

[4]  Sean Andrist,et al.  Looking Coordinated: Bidirectional Gaze Mechanisms for Collaborative Interaction with Virtual Characters , 2017, CHI.

[5]  Akikazu Takeuchi,et al.  Situated facial displays: towards social interaction , 1995, CHI '95.

[6]  Brian Scassellati,et al.  The Benefits of Interactions with Physically Present Robots over Video-Displayed Agents , 2011, Int. J. Soc. Robotics.

[7]  Hung-Hsuan Huang,et al.  Embodied Conversational Agents , 2009 .

[8]  T. Koda,et al.  Agents with faces: the effect of personification , 1996, Proceedings 5th IEEE International Workshop on Robot and Human Communication. RO-MAN'96 TSUKUBA.

[9]  Frank Biocca,et al.  The Effect of the Agency and Anthropomorphism on Users' Sense of Telepresence, Copresence, and Social Presence in Virtual Environments , 2003, Presence: Teleoperators & Virtual Environments.

[10]  Dieter Schmalstieg,et al.  How real should virtual characters be? , 2006, ACE '06.

[11]  Angela Tinwell.  Uncanny as Usability Obstacle , 2009, HCI.

[12]  Pascal Fua,et al.  Interaction techniques with virtual humans in mixed environments , 2002, 5th IEEE EMBS International Summer School on Biomedical Imaging, 2002..

[13]  K. Chang,et al.  Embodiment in conversational interfaces: Rea , 1999, CHI '99.

[14]  Andrew J. Cowell,et al.  Embodiment and Interaction Guidelines for Designing Credible, Trustworthy Embodied Conversational Agents , 2003, IVA.

[15]  John Zimmerman,et al.  Putting a Face on Embodied Interface Agents , 2005 .

[16]  Stefan Kopp,et al.  Why emotions should be integrated into conversational agents , 2007 .

[17]  Karl F. MacDorman,et al.  Too real for comfort? Uncanny responses to computer generated faces , 2009, Comput. Hum. Behav..

[18]  Ning Wang,et al.  Creating Rapport with Virtual Agents , 2007, IVA.

[19]  M. Jack,et al.  Empirical Evaluation of Animated Agents in a Multi-Modal E-Retail Application , 2000 .

[20]  Hideyuki Tamura,et al.  Welbo: an embodied conversational agent living in mixed reality space , 2000, CHI Extended Abstracts.

[21]  I Spy a Book of Picture Riddles , 1992 .

[22]  Susan R. Fussell,et al.  Anthropomorphic Interactions with a Robot and Robot–like Agent , 2008 .

[23]  Anton Nijholt,et al.  How the agent's gender influence users' evaluation of a QA system , 2010, 2010 International Conference on User Science and Engineering (i-USEr).

[24]  C. Koch,et al.  Faces and text attract gaze independent of the task: Experimental data and computer model. , 2009, Journal of vision.

[25]  Dieter Schmalstieg,et al.  Ubiquitous animated agents for augmented reality , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[26]  Marc Fabri,et al.  Emotionally Expressive Avatars for Chatting, Learning and Therapeutic Intervention , 2007, HCI.

[27]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[28]  Kangsoo Kim,et al.  Maintaining and Enhancing Human-Surrogate Presence in Augmented Reality , 2015, 2015 IEEE International Symposium on Mixed and Augmented Reality Workshops.

[29]  Kristinn R. Thórisson,et al.  The Power of a Nod and a Glance: Envelope Vs. Emotional Feedback in Animated Conversational Agents , 1999, Appl. Artif. Intell..

[30]  Paul van Schaik,et al.  A Comparison of Multi-Item Likert and Visual Analogue Scales for the Assessment of Transactionally Defined Coping Function , 2004 .

[31]  Arthur Asa Berger,et al.  The Amazon Echo , 2018 .

[32]  Stefan Kopp,et al.  The Effects of an Embodied Conversational Agent's Nonverbal Behavior on User's Evaluation and Behavioral Mimicry , 2007, IVA.

[33]  Manfred Tscheligi,et al.  Interacting with embodied agents that can see: how vision-enabled agents can assist in spatial tasks , 2006, NordiCHI '06.

[34]  Heloir,et al.  The Uncanny Valley , 2019, The Animation Studies Reader.

[35]  Judy Kay,et al.  Interactive Realistic Digital Avatars - Revisiting the Uncanny Valley , 2017, HICSS.

[36]  M. Bindemann,et al.  Faces retain attention , 2005, Psychonomic bulletin & review.

[37]  Jonathan Gratch,et al.  The Influence of Emotion Expression on Perceptions of Trustworthiness in Negotiation , 2011, AAAI.

[38]  Akinori Ito,et al.  A spoken dialogue system using virtual conversational agent with augmented reality , 2012, Proceedings of The 2012 Asia Pacific Signal and Information Processing Association Annual Summit and Conference.

[39]  Kristinn R. Thórisson.  Gandalf: an embodied humanoid capable of real-time multimodal dialogue with people , 1997, AGENTS '97.

[40]  Maria Isabel Saludares,et al.  Interaction techniques using head gaze for virtual reality , 2016, 2016 IEEE Region 10 Symposium (TENSYMP).

[41]  Mervyn A. Jack,et al.  Evaluating humanoid synthetic agents in e-retail applications , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[42]  Maja J. Mataric,et al.  Embodiment and Human-Robot Interaction: A Task-Based Perspective , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[43]  Elisabetta Bevacqua,et al.  Believability and Co-presence in Human-Virtual Character Interaction , 2017, IEEE Computer Graphics and Applications.

[44]  Clifford Nass,et al.  Computers are social actors , 1994, CHI '94.

[45]  John Zimmerman,et al.  How interface agents affect interaction between humans and computers , 2007, DPPI.

[46]  Brian Scassellati,et al.  The Physical Presence of a Robot Tutor Increases Cognitive Learning Gains , 2012, CogSci.

[47]  J. Bailenson,et al.  Comparing Behavioral and Self-Report Measures of Embodied Agents' Social Presence in Immersive Virtual Environments , 2004 .