Experiencing Simulated Confrontations in Virtual Reality

The use of virtual reality (VR) to simulate confrontational human behaviour has significant potential for use in training, where the recreation of uncomfortable feelings may help users to prepare for challenging real-life situations. In this paper we present a user study (n=68) in which participants experienced simulated confrontational behaviour performed by a virtual character either in immersive VR, or on a 2D display. Participants reported a higher elevation in anxiety in VR, which correlated positively with a perceived sense of physical space. Character believability was influenced negatively by visual elements of the simulation, and positively by behavioural elements, which complements findings from previous work. We recommend the use of VR for simulations of confrontational behaviour, where a realistic emotional response is part of the intended experience. We also discuss incorporation of domain knowledge of human behaviours, and carefully crafted motion-captured sequences, to increase users’ sense of believability.

[1]  B. de Gelder,et al.  Is it the real deal? Perception of virtual characters versus humans: an affective cognitive neuroscience perspective , 2015, Front. Psychol..

[2]  Corey P. Carbonara,et al.  Spatial Presence and Perceived Reality as Predictors of Motion-Based Video Game Enjoyment , 2011, PRESENCE: Teleoperators and Virtual Environments.

[3]  Mel Slater,et al.  Visual Realism Enhances Realistic Response in an Immersive Virtual Environment , 2009, IEEE Computer Graphics and Applications.

[4]  M. Slater,et al.  The Use of Virtual Reality in the Study of People's Responses to Violent Incidents , 2009, Front. Behav. Neurosci..

[5]  Rachel McDonnell,et al.  The Effect of Realistic Appearance of Virtual Characters in Immersive Environments - Does the Character's Personality Play a Role? , 2018, IEEE Transactions on Visualization and Computer Graphics.

[6]  M. Griffiths,et al.  Aggressive Behaviour in Slot Machine Gamblers: A Preliminary Observational Study , 2004, Psychological Reports.

[7]  V. Braun,et al.  Using thematic analysis in psychology , 2006 .

[8]  Jonathan Freeman,et al.  A Cross-Media Presence Questionnaire: The ITC-Sense of Presence Inventory , 2001, Presence: Teleoperators & Virtual Environments.

[9]  Mark B. Powers,et al.  Virtual reality exposure therapy for anxiety and related disorders: A meta-analysis of randomized controlled trials. , 2019, Journal of anxiety disorders.

[10]  Yi Yang,et al.  Investigating Implicit Gender Bias and Embodiment of White Males in Virtual Reality with Full Body Visuomotor Synchrony , 2019, CHI.

[11]  M. Kempton,et al.  Virtual reality in the psychological treatment for mental health problems: An systematic review of recent evidence , 2016, Psychiatry Research.

[12]  Francisco Rebelo,et al.  Can Virtual Reality Increase Emotional Responses (Arousal and Valence)? A Pilot Study , 2014, HCI.

[13]  Maria V. Sanchez-Vives,et al.  First Person Experience of Body Transfer in Virtual Reality , 2010, PloS one.

[14]  Mel Slater,et al.  Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[15]  Mary C. Whitton,et al.  A Survey of Presence and Related Concepts , 2017, ACM Comput. Surv..

[16]  M. Griffiths,et al.  Aggressive behaviour in adult slot machine gamblers: an interpretative phenomenological analysis , 2005 .

[17]  Tibor Bosse,et al.  An Intelligent System for Aggression De-Escalation Training , 2016, ECAI.

[18]  Aaron Marcus,et al.  Design, User Experience, and Usability. User Experience Design for Diverse Interaction Platforms and Environments , 2014, Lecture Notes in Computer Science.

[19]  Anne-Hélène Olivier,et al.  Walking with Virtual People: Evaluation of Locomotion Interfaces in Dynamic Environments , 2018, IEEE Transactions on Visualization and Computer Graphics.

[20]  Kathrin Maria Gerling,et al.  Virtual reality crowd simulation: effects of agent density on user experience and behaviour , 2018, Virtual Reality.

[21]  Gordon S. Carlson,et al.  A Physically Immersive Platform for Training Emergency Responders and Law Enforcement Officers , 2018, Advances in Intelligent Systems and Computing.

[22]  Stéphane Bouchard,et al.  Anxiety Increases the Feeling of Presence in Virtual Reality , 2008, PRESENCE: Teleoperators and Virtual Environments.

[23]  Andrea Bönsch,et al.  Social VR: How Personal Space is Affected by Virtual Agents' Emotions , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[24]  Henrik M. Peperkorn,et al.  The impact of perception and presence on emotional reactions: a review of research in virtual reality , 2015, Front. Psychol..

[25]  M. Griffiths,et al.  Aggressive behaviour in adult slot-machine gamblers: a qualitative observational study , 2005 .

[26]  Marina Krcmar,et al.  The Impact of Controller Naturalness on Spatial Presence, Gamer Enjoyment, and Perceived Realism in a Tennis Simulation Video Game , 2011, PRESENCE: Teleoperators and Virtual Environments.

[27]  Yiorgos Chrysanthou,et al.  Interaction with virtual crowd in Immersive and semi‐Immersive Virtual Reality systems , 2017, Comput. Animat. Virtual Worlds.

[28]  Kwanguk Kim,et al.  Effects of virtual environment platforms on emotional responses , 2014, Comput. Methods Programs Biomed..

[29]  Tibor Bosse,et al.  Are Aggressive Agents as Scary as Aggressive Humans? , 2015, AAMAS.

[30]  Mel Slater,et al.  Virtual Character Personality Influences Participant Attitudes and Behavior – An Interview with a Virtual Human Character about Her Social Anxiety , 2015, Front. Robot. AI.

[31]  Mary C. Whitton,et al.  Walking > walking-in-place > flying, in virtual environments , 1999, SIGGRAPH.

[32]  M. Slater,et al.  Bystander Responses to a Violent Incident in an Immersive Virtual Environment , 2013, PloS one.

[33]  A. Hamilton,et al.  Why and how to use virtual reality to study human social interaction: The challenges of exploring a new research landscape , 2018, British journal of psychology.

[34]  Albrecht Schmidt,et al.  A Human Touch: Social Touch Increases the Perceived Human-likeness of Agents in Virtual Reality , 2020, CHI.

[35]  Dinesh Manocha,et al.  PedVR: simulating gaze-based interactions between a real user and virtual crowds , 2016, VRST.

[36]  Jeremy N. Bailenson,et al.  How Immersive Is Enough? A Meta-Analysis of the Effect of Immersive Technology on User Presence , 2016 .

[37]  Marnix S. van Gisbergen,et al.  How Real Do You See Yourself in VR? The Effect of User-Avatar Resemblance on Virtual Reality Experiences and Behaviour , 2020 .

[38]  Edward T. Hall,et al.  A System for the Notation of Proxemic Behavior1 , 1963 .

[39]  Terence S. Andre.  Advances in Human Factors in Training, Education, and Learning Sciences , 2018 .

[40]  S. Delacroix,et al.  The Responses of Medical General Practitioners to Unreasonable Patient Demand for Antibiotics - A Study of Medical Ethics Using Immersive Virtual Reality , 2016, PloS one.

[41]  K. Scherer,et al.  The Geneva affective picture database (GAPED): a new 730-picture database focusing on valence and normative significance , 2011, Behavior research methods.

[42]  Tibor Bosse,et al.  Virtually Bad: A Study on Virtual Agents that Physically Threaten Human Beings , 2018, AAMAS.

[43]  Cheryl Campanella Bracken,et al.  Presence and Image Quality: The Case of High-Definition Television , 2005 .

[44]  Doug A. Bowman,et al.  Evaluating Display Fidelity and Interaction Fidelity in a Virtual Reality Game , 2012, IEEE Transactions on Visualization and Computer Graphics.

[45]  José Gutiérrez-Maldonado,et al.  The role of presence in the level of anxiety experienced in clinical virtual environments , 2011, Comput. Hum. Behav..

[46]  Mel Slater,et al.  Proxemics with multiple dynamic characters in an immersive virtual environment , 2010, TAP.

[47]  Robert S. Allison,et al.  Personal Space in Virtual Reality , 2003, TAP.

[48]  U. Cress,et al.  Training in virtual environments: putting theory into practice , 2013, Ergonomics.

[49]  Yun Ling,et al.  Effects of Stereoscopic Viewing on Presence, Anxiety, and Cybersickness in a Virtual Reality Environment for Public Speaking , 2012, PRESENCE: Teleoperators and Virtual Environments.

[50]  Andreas Mühlberger,et al.  Triggers of fear: perceptual cues versus conceptual information in spider phobia. , 2014, Journal of clinical psychology.

[51]  Mariano Alcañiz Raya,et al.  Affective Interactions Using Virtual Reality: The Link between Presence and Emotions , 2007, Cyberpsychology Behav. Soc. Netw..