Comparing Emotional States Induced by 360° Videos Via Head-Mounted Display and Computer Screen

In recent years 360° videos have been becoming more popular. For traditional media presentations, e.g., on a computer screen, a wide range of assessment methods are available. Different constructs, such as perceived quality or the induced emotional state of viewers, can be reliably assessed by subjective scales. Many of the subjective methods have only been validated using stimuli presented on a computer screen. This paper is using 360° videos to induce varying emotional states. Videos were presented 1) via a head-mounted display (HMD) and 2) via a traditional computer screen. Furthermore, participants were asked to rate their emotional state 1) in retrospect on the self-assessment manikin scale and 2) continuously on a 2-dimensional arousal-valence plane. In a repeated measures design, all participants (N = 18) used both presentation systems and both rating systems. Results indicate that there is a statistically significant difference in induced presence due to the presentation system. Furthermore, there was no statistically significant difference in ratings gathered with the two presentation systems. Finally, it was found that for arousal measures, a statistically significant difference could be found for the different rating methods, potentially indicating an underestimation of arousal ratings gathered in retrospect for screen presentation. In the future, rating methods such as a 2-dimensional arousal-valence plane could offer the advantage of enabling a reliable measurement of emotional states while being more embedded in the experience itself, enabling a more precise capturing of the emotional states.

[1]  M. Rosa,et al.  Presence and emotions in virtual environments: the influence of stereoscopy. , 2008 .

[2]  J. Russell A circumplex model of affect. , 1980 .

[3]  D. Cicchetti Guidelines, Criteria, and Rules of Thumb for Evaluating Normed and Standardized Assessment Instruments in Psychology. , 1994 .

[4]  Rosa María Baños,et al.  Presence and Emotions in Virtual Environments: The Influence of Stereoscopy , 2008, Cyberpsychology Behav. Soc. Netw..

[5]  Sebastian Möller,et al.  Changes of vigilance caused by varying bit rate conditions , 2013, 2013 Fifth International Workshop on Quality of Multimedia Experience (QoMEX).

[6]  Holger Regenbrecht,et al.  The Experience of Presence: Factor Analytic Insights , 2001, Presence: Teleoperators & Virtual Environments.

[7]  Mel Slater,et al.  Representations Systems, Perceptual Position, and Presence in Immersive Virtual Environments , 1993, Presence: Teleoperators & Virtual Environments.

[8]  Christian Timmerer,et al.  Towards subjective quality of experience assessment for omnidirectional video streaming , 2017, 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX).

[9]  Stefania Serafin,et al.  Immersion revisited: A review of existing definitions of immersion and their relation to different theories of presence , 2016 .

[10]  Peter Schelkens,et al.  Qualinet White Paper on Definitions of Quality of Experience , 2013 .

[11]  E. Tan,et al.  The emotional and cognitive effect of immersion in film viewing , 2010 .

[12]  P. Lang International affective picture system (IAPS) : affective ratings of pictures and instruction manual , 2005 .

[13]  Mel Slater,et al.  Depth of Presence in Virtual Environments , 1994, Presence: Teleoperators & Virtual Environments.

[14]  J. Gross,et al.  Emotion elicitation using films , 1995 .

[15]  M. Tscheligi,et al.  Questionnaires embedded in virtual environments: reliability and positioning of rating scales in virtual environments , 2019, Quality and User Experience.

[16]  Rosa María Baños,et al.  Immersion and Emotion: Their Impact on the Sense of Presence , 2004, Cyberpsychology Behav. Soc. Netw..

[17]  Martijn H. Vastenburg,et al.  Mood measurement with Pick-A-Mood: review of current methods and design of a pictorial self-report scale , 2016 .

[18]  Jeremy N. Bailenson,et al.  A Public Database of Immersive VR Videos with Corresponding Ratings of Arousal, Valence, and Correlations between Head Movements and Self Report Measures , 2017, Front. Psychol..

[19]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[20]  Manuela Pereira,et al.  Factors Influencing Quality of Experience , 2014, Quality of Experience.

[21]  Yun Ling,et al.  The relationship between individual characteristics and experienced presence , 2013, Comput. Hum. Behav..

[22]  Frank Biocca,et al.  Immersive virtual reality technology , 1995 .

[23]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[24]  Katrien De Moor,et al.  Quality of Experience Versus User Experience , 2014, Quality of Experience.

[25]  Mario Vairinhos,et al.  How VR 360º Impacts the Immersion of the Viewer of Suspense AV Content , 2019, TVX.

[26]  P. Ekman,et al.  Constants across cultures in the face and emotion. , 1971, Journal of personality and social psychology.

[27]  Kevin A Hallgren,et al.  Computing Inter-Rater Reliability for Observational Data: An Overview and Tutorial. , 2012, Tutorials in quantitative methods for psychology.

[28]  Mel Slater,et al.  Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[29]  Alexander Toet,et al.  The EmojiGrid as an Immersive Self-report Tool for the Affective Assessment of 360 VR Videos , 2019, EuroVR.

[30]  Henrik M. Peperkorn,et al.  The impact of perception and presence on emotional reactions: a review of research in virtual reality , 2015, Front. Psychol..

[31]  Carrie Heater,et al.  Being There: The Subjective Experience of Presence , 1992, Presence: Teleoperators & Virtual Environments.

[32]  Alexander Raake,et al.  (Re-)actions speak louder than words? A novel test method for tracking user behavior in web video services , 2016, 2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX).

[33]  Pablo Pérez,et al.  MIRO360: A Tool for Subjective Assessment of 360 Degree Video for ITU-T P.360-VR , 2019, 2019 Eleventh International Conference on Quality of Multimedia Experience (QoMEX).

[34]  Martin Kraus,et al.  A comparison of head-mounted and hand-held displays for 360° videos with focus on attitude and behavior change , 2016, MindTrek.