Exploring behaviour towards avatars and agents in immersive virtual environments with mixed-agency interactions

Immersive virtual environments (IVEs) in which multiple users navigate by walking and interact with each other in natural ways are perfectly suited for team applications from training to recreation. At the same time, they can solve scheduling conflicts by employing virtual agents in place of missing team members or additional participants of a scenario. While this idea has been long discussed in IVEs research there are no prior publications on social interactions in systems with multiple embodied users and agents. This paper presents an experiment at a work-in-progress stage that addresses the impact of perceived agency and control of a virtual character in a collaborative scenario with two embodied users and one virtual agent. Our future study will investigate whether users treat avatars and agents differently within a mixed-agency scenario, analysing several behavioural metrics and self-report of participants.

[1]  J. Bailenson,et al.  Virtual Humans and Persuasion: The Effects of Agency and Behavioral Realism , 2007 .

[2]  Matthew Lombard,et al.  At the Heart of It All: The Concept of Presence , 2006 .

[3]  Hannes Kaufmann,et al.  Co-presence and proxemics in shared walkable virtual environments with mixed colocation , 2018, VRST.

[4]  Helmut Hlavacs,et al.  Meeting others virtually in a day-to-day setting: Investigating social avoidance and prosocial behavior towards avatars and agents , 2018, Comput. Hum. Behav..

[5]  Albrecht Schmidt,et al.  A Human Touch: Social Touch Increases the Perceived Human-likeness of Agents in Virtual Reality , 2020, CHI.

[6]  Benjamin Lok,et al.  Training Together: How Another Human Trainee’s Presence Affects Behavior during Virtual Human-Based Team Training , 2016, Front. ICT.

[7]  Victoria Interrante,et al.  Evaluating collision avoidance effects on discomfort in virtual environments , 2017, 2017 IEEE Virtual Humans and Crowds for Immersive Environments (VHCIE).

[8]  Greg Welch,et al.  A Systematic Review of Social Presence: Definition, Antecedents, and Implications , 2018, Front. Robot. AI.

[9]  Yiorgos Chrysanthou,et al.  Interaction with virtual crowd in Immersive and semi‐Immersive Virtual Reality systems , 2017, Comput. Animat. Virtual Worlds.

[10]  Soo Youn Oh,et al.  Effect of Behavioral Realism on Social Interactions Inside Collaborative Virtual Environments , 2018, PRESENCE: Virtual and Augmented Reality.

[11]  Niels Henze,et al.  Using Presence Questionnaires in Virtual Reality , 2019, CHI.

[12]  J. Blascovich Social influence within immersive virtual environments , 2002 .

[13]  Benjamin Lok,et al.  Do Variations in Agency Indirectly Affect Behavior with Others? An Analysis of Gaze Behavior , 2016, IEEE Transactions on Visualization and Computer Graphics.

[14]  Marc Erich Latoschik,et al.  Not Alone Here?! Scalability and User Experience of Embodied Ambient Crowds in Distributed Social Virtual Reality , 2019, IEEE Transactions on Visualization and Computer Graphics.

[15]  Edward Lank,et al.  Left Them 4 Dead: Perception of Humans versus Non-Player Character Teammates in Cooperative Gameplay , 2017, Conference on Designing Interactive Systems.

[16]  Gijs A. Holleman,et al.  Looking behavior and potential human interactions during locomotion , 2020, Journal of vision.

[17]  Daniel Thalmann,et al.  Increasing the feeling of social presence by incorporating realistic interactions in multi-party VR , 2018, CASA 2018.

[18]  Ning Wang,et al.  Creating Rapport with Virtual Agents , 2007, IVA.

[19]  Dinesh Manocha,et al.  Simulating Movement Interactions Between Avatars & Agents in Virtual Worlds Using Human Motion Constraints , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[20]  Ralph Schroeder,et al.  Small-Group Behavior in a Virtual and Real Environment: A Comparative Study , 2000, Presence: Teleoperators & Virtual Environments.

[21]  Susan Persky,et al.  The Independent and Interactive Effects of Embodied-Agent Appearance and Behavior on Self-Report, Cognitive, and Behavioral Markers of Copresence in Immersive Virtual Environments , 2005, Presence: Teleoperators & Virtual Environments.

[22]  Jeremy N. Bailenson,et al.  Avatars Versus Agents: A Meta-Analysis Quantifying the Effect of Agency on Social Influence , 2015, Hum. Comput. Interact..

[23]  Frank Biocca,et al.  Toward a More Robust Theory and Measure of Social Presence: Review and Suggested Criteria , 2003, Presence: Teleoperators & Virtual Environments.