The Impact of Virtual Reality in the Social Presence of a Virtual Agent

In this work we test the hypothesis that interacting with an intelligent virtual character in Virtual Reality (VR) has a stronger impact compared to the same interaction in a traditional non-immersive platform, both in terms of presence and believability. We designed a Social Skills Training scenario of a police interview, based on interactions observed in real cases with the help of teachers and experts from that field. To test our hypothesis, we conducted experiments with two treatments: one in VR and the other displayed on a conventional computer screen. We collected qualitative and quantitative data using instruments with elements from well-established presence and situated interaction questionnaires. Results indicate that participant perception of social presence of virtual characters is higher in VR. No significant difference in believability was observed across treatments The experimental design encourages further work on measurement of effects of social presence and its impact on design of intelligent interactions in the context of Social Skills Training environments and immersive platforms.

[1]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[2]  K. M. Lee,et al.  Can robots manifest personality? : An empirical test of personality recognition, social responses, and social presence in human-robot interaction , 2006 .

[3]  Rui Prada,et al.  A Virtual Agent Toolkit for Serious Games Developers , 2018, 2018 IEEE Conference on Computational Intelligence and Games (CIG).

[4]  CyrDianne,et al.  The role of social presence in establishing loyalty in e-Service environments , 2007 .

[5]  Sang Ryong Kim,et al.  Are physically embodied social agents better than disembodied social agents?: The effects of physical embodiment, tactile interaction, and people's loneliness in human-robot interaction , 2006, Int. J. Hum. Comput. Stud..

[6]  Juliann Cortese,et al.  The Role of Social Presence in Opinion Expression During FtF and CMC Discussions , 2012 .

[7]  John C. House,et al.  Reforming Investigative Interviewing in Canada , 2010 .

[8]  F. Biocca,et al.  Internal Consistency and Reliability of the Networked MindsMeasure of Social Presence , 2004 .

[9]  A. L. Baylor Promoting motivation with virtual agents and avatars: role of visual presence and appearance , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[10]  Stefan Kopp,et al.  A Second Chance to Make a First Impression? How Appearance and Nonverbal Behavior Affect Perceived Warmth and Competence of Virtual Agents over Time , 2012, IVA.

[11]  Tibor Bosse,et al.  Virtual Agents for Professional Social Skills Training: An Overview of the State-of-the-Art , 2018, INTETAIN.

[12]  David Lester Neumann,et al.  The effects of the presence of others during a rowing exercise in a virtual reality environment , 2016 .

[13]  Brian Scassellati,et al.  Talk to Me: Verbal Communication Improves Perceptions of Friendship and Social Presence in Human-Robot Interaction , 2016, IVA.

[14]  Kangsoo Kim,et al.  Does a Digital Assistant Need a Body? The Influence of Visual Embodiment and Social Behavior on the Perception of Intelligent Virtual Agents in AR , 2018, 2018 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[15]  Ilona Heldal,et al.  Collaborating in networked immersive spaces: as good as being there together? , 2001, Comput. Graph..

[16]  Catherine Pelachaud,et al.  The TARDIS Framework: Intelligent Virtual Agents for Social Coaching in Job Interviews , 2013, Advances in Computer Entertainment.

[17]  Christopher Frauenberger,et al.  Blending Human and Artificial Intelligence to Support Autistic Children’s Social Communication Skills , 2018, ACM Trans. Comput. Hum. Interact..

[18]  Mel Slater,et al.  A Framework for Immersive Virtual Environments (FIVE): Speculations on the Role of Presence in Virtual Environments , 1997, Presence: Teleoperators & Virtual Environments.

[19]  Sara Bernardini,et al.  ECHOES: An intelligent serious game for fostering social communication in children with autism , 2014, Inf. Sci..

[20]  Greg Welch,et al.  A Systematic Review of Social Presence: Definition, Antecedents, and Implications , 2018, Front. Robot. AI.

[21]  Frank Biocca,et al.  Toward a More Robust Theory and Measure of Social Presence: Review and Suggested Criteria , 2003, Presence: Teleoperators & Virtual Environments.

[22]  Jeremy N. Bailenson,et al.  How Immersive Is Enough? A Meta-Analysis of the Effect of Immersive Technology on User Presence , 2016 .

[23]  Benjamin Lok,et al.  Predicting Student Success in Communication Skills Learning Scenarios with Virtual Humans , 2019, LAK.

[24]  Xueni Pan,et al.  Socially Anxious and Confident Men Interact with a Forward Virtual Woman: An Experimental Study , 2012, PloS one.

[25]  E. Goffman Stigma; Notes On The Management Of Spoiled Identity , 1964 .

[26]  J. Taylor,et al.  Virtual Reality Job Interview Training in Adults with Autism Spectrum Disorder , 2014, Journal of Autism and Developmental Disorders.

[27]  Guillaume Chanel,et al.  A Computational Model for Managing Impressions of an Embodied Conversational Agent in Real-Time , 2019, 2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII).

[28]  Morris D. Bell,et al.  Virtual reality job interview training and 6-month employment outcomes for individuals with schizophrenia seeking employment , 2015, Schizophrenia Research.

[29]  Andreas Syska,et al.  VIRTUAL REALITY (VR) , 2022, International Research Journal of Modernization in Engineering Technology and Science.

[30]  Jonathan Steuer,et al.  Defining virtual reality: dimensions determining telepresence , 1992 .

[31]  Ilona Heldal,et al.  Immersiveness and symmetry in copresent scenarios , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[32]  Dianne Cyr,et al.  The role of social presence in establishing loyalty in e-Service environments , 2007, Interact. Comput..

[33]  Deborah C. Beidel,et al.  Can Virtual Reality Effectively Elicit Distress Associated with Social Anxiety Disorder? , 2015 .

[34]  Daniel C. Krawczyk,et al.  Virtual Reality Social Cognition Training for children with high functioning autism , 2016, Comput. Hum. Behav..

[35]  Sandra M. Neer,et al.  Trauma management therapy with virtual-reality augmented exposure therapy for combat-related PTSD: A randomized controlled trial. , 2017, Journal of anxiety disorders.

[36]  Hayley M. D. Cleary,et al.  Police training in interviewing and interrogation methods: A comparison of techniques used with adult and juvenile suspects. , 2016, Law and human behavior.

[37]  Helmut Hlavacs,et al.  Physical Presence, Social Presence, and Anxiety in Participants with Social Anxiety Disorder During Virtual Cue Exposure , 2019, Cyberpsychology Behav. Soc. Netw..

[38]  Markus Funk,et al.  Investigating Social Presence and Communication with Embodied Avatars in Room-Scale Virtual Reality , 2017, iLRN.

[39]  Stéphane Bouchard,et al.  Virtual reality compared with in vivo exposure in the treatment of social anxiety disorder: A three-arm randomised controlled trial , 2017, British Journal of Psychiatry.

[40]  Johnathan Mell,et al.  Toward Social-Emotional Virtual Humans , 2015, AAMAS.