Influencing Human Affective Responses to Dynamic Virtual Environments

Detecting and measuring emotional responses while interacting with virtual reality (VR), and assessing and interpreting their impacts on human engagement and “immersion,” are both academically and technologically challenging. While many researchers have, in the past, focused on the affective evaluation of passive environments, such as listening to music or the observation of videos and imagery, virtual realities and related interactive environments have been used in only a small number of research studies as a mean of presenting emotional stimuli. This article reports the first stage (focusing on participants' subjective responses) of a range of experimental investigations supporting the evaluation of emotional responses within a virtual environment, according to a three-dimensional (Valence, Arousal, and Dominance) model of affects, developed in the 1970s and 1980s. To populate this three-dimensional model with participants' emotional responses, an “affective VR,” capable of manipulating users' emotions, has been designed and subjectively evaluated. The VR takes the form of a dynamic “speedboat” simulation, elements (controllable VR parameters) of which were assessed and selected based on a 35-respondent online survey, coupled with the implementation of an affective power approximation algorithm. A further 68 participants took part in a series of trials, interacting with a number of VR variations, while subjectively rating their emotional responses. The experimental results provide an early level of confidence that this particular affective VR is capable of manipulating individuals' emotional experiences, through the control of its internal parameters. Moreover, the approximation technique proved to be fairly reliable in predicting users' potential emotional responses, in various affective VR settings, prior to actual experiences. Finally, the analysis suggested that the emotional response of the users, with different gender and gaming experiences, could vary, when presented with the same affective VR situation.

[1]  P. Lang International affective picture system (IAPS) : affective ratings of pictures and instruction manual , 2005 .

[2]  Touradj Ebrahimi,et al.  Implicit emotional tagging of multimedia using EEG signals and brain computer interface , 2009, WSM@MM.

[3]  Robert J. Stone,et al.  Applications of Virtual Environments: An Overview , 2014, Handbook of Virtual Environments, 2nd ed..

[4]  Michael Zyda,et al.  From visual simulation to virtual reality to games , 2005, Computer.

[5]  J. Russell A circumplex model of affect. , 1980 .

[6]  Ameet Talwalkar,et al.  Foundations of Machine Learning , 2012, Adaptive computation and machine learning.

[7]  A. Rizzo,et al.  Affective outcomes of virtual reality exposure therapy for anxiety and specific phobias: a meta-analysis. , 2008, Journal of behavior therapy and experimental psychiatry.

[8]  Albert Mehrabian,et al.  A semantic space for nonverbal behavior. , 1970 .

[9]  Daniel T. Larose,et al.  Discovering Knowledge in Data: An Introduction to Data Mining , 2005 .

[10]  JoAnn Difede,et al.  Virtual Reality Applications to Address the Wounds of War , 2013 .

[11]  Christos D. Katsis,et al.  Toward Emotion Recognition in Car-Racing Drivers: A Biosignal Processing Approach , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[12]  Anton Nijholt,et al.  Turning Shortcomings into Challenges: Brain-Computer Interfaces for Games , 2009, INTETAIN.

[13]  Charalampos Bratsas,et al.  Toward Emotion Aware Computing: An Integrated Approach Using Multichannel Neurophysiological Recordings and Affective Visual Stimuli , 2010, IEEE Transactions on Information Technology in Biomedicine.

[14]  T. Furness,et al.  Virtual reality as an adjunctive pain control during burn wound care in adolescent patients , 2000, Pain.

[15]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[16]  P. Ekman Unmasking The Face , 1975 .

[17]  James F. Knight,et al.  Virtual Natural Environments for Restoration and Rehabilitation in Healthcare , 2014 .

[18]  Anna L. Cox,et al.  Quantifying the experience of immersion in games. , 2006 .

[19]  Thierry Pun,et al.  DEAP: A Database for Emotion Analysis ;Using Physiological Signals , 2012, IEEE Transactions on Affective Computing.

[20]  E. Meer,et al.  Emotion Studies in HCI – a New Approach , 2005 .

[21]  Emmanuel Dellandréa,et al.  A Large Video Database for Computational Models of Induced Emotion , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[22]  Patrick S. Bordnick,et al.  Feasibility of Using Virtual Reality to Assess Nicotine Cue Reactivity During Treatment , 2012, Research on social work practice.

[23]  H. Hoffman,et al.  Virtual reality exposure therapy for the treatment of posttraumatic stress disorder following September 11, 2001. , 2007, The Journal of clinical psychiatry.

[24]  Kazuhiko Takahashi,et al.  Remarks on emotion recognition from multi-modal bio-potential signals , 2004, 2004 IEEE International Conference on Industrial Technology, 2004. IEEE ICIT '04..

[25]  Cyrus Shahabi,et al.  Virtual Environments for the Assessment of Attention and Memory Processes: The Virtual Classroom and Office , 2002 .

[26]  M. Murugappan,et al.  Time-Frequency Analysis of EEG Signals for Human Emotion Detection , 2008 .

[27]  R. Satava,et al.  Virtual Reality Training Improves Operating Room Performance: Results of a Randomized, Double-Blinded Study , 2002, Annals of surgery.

[28]  Sazali Yaacob,et al.  Asymmetric ratio and FCM based salient channel selection for human emotion detection using EEG , 2008 .

[29]  Marian Joëls,et al.  Learning under stress: how does it work? , 2006, Trends in Cognitive Sciences.

[30]  Ricardo Gutierrez-Osuna,et al.  A Control-Theoretic Approach to Adaptive Physiological Games , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[31]  Leif Hedman,et al.  Proficiency-based virtual reality training significantly reduces the error rate for residents during their first 10 laparoscopic cholecystectomies. , 2007, American journal of surgery.

[32]  B. Parkinson,et al.  Emotion and motivation , 1995 .

[33]  Hunter G. Hoffman,et al.  Manipulating presence influences the magnitude of virtual reality analgesia , 2004, Pain.

[34]  Paul A. Cairns,et al.  A grounded investigation of game immersion , 2004, CHI EA '04.

[35]  Julian Bion,et al.  Virtual restorative environment therapy as an adjunct to pain control during burn dressing changes: study protocol for a randomised controlled trial , 2015, Trials.

[36]  Jennifer Ann Rode,et al.  Using a large projection screen as an alternative to head-mounted displays for virtual environments , 2000, CHI.

[37]  Brent Lance,et al.  Optimal Arousal Identification and Classification for Affective Computing Using Physiological Signals: Virtual Reality Stroop Task , 2010, IEEE Transactions on Affective Computing.

[38]  G.C. Burdea,et al.  Virtual reality-enhanced stroke rehabilitation , 2001, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[39]  Jeffrey I. Gold,et al.  The use of virtual reality for pain control: A review , 2009, Current pain and headache reports.