The Impact of Olfactory and Wind Stimuli on 360 Videos Using Head-mounted Displays

Consuming 360 audiovisual content using a Head-Mounted Display (HMD) has become a standard feature for Immersive Virtual Reality (IVR). However, most applications rely only on visual and auditory feedback whereas other senses are often disregarded. The main goal of this work was to study the effect of tactile and olfactory stimuli on participants’ sense of presence and cybersickness while watching a 360 video using an HMD-based IVR setup. An experiment with 48 participants and three experimental conditions (360 video, 360 video with olfactory stimulus, and 360 video with tactile stimulus) was performed. Presence and cybersickness were reported via post-test questionnaires. Statistical analysis showed a significant difference in presence between the control and the olfactory conditions. From the control to the tactile condition, mean values were higher but failed to show statistical significance. Thus, results suggest that adding an olfactory stimulus increases presence significantly while the addition of a tactile stimulus only shows a positive effect. Regarding cybersickness, no significant differences were found across conditions. We conclude that an olfactory stimulus contributes to higher presence and that a tactile stimulus, delivered in the form of cutaneous perception of wind, has no influence in presence. We further conclude that multisensory cues do not affect cybersickness.

[1]  MerchantZahira,et al.  Effectiveness of virtual reality-based instruction on students' learning outcomes in K-12 and higher education , 2014 .

[2]  Gustavo Arroyo-Figueroa,et al.  Virtual reality training system for maintenance and operation of high-voltage overhead power lines , 2015, Virtual Reality.

[3]  Ken-ichi Okada,et al.  Development of a High-Performance Olfactory Display and Measurement of Olfactory Characteristics for Pulse Ejections , 2010, 2010 10th IEEE/IPSJ International Symposium on Applications and the Internet.

[4]  Naëm Baron,et al.  How incorporation of scents could enhance immersive virtual experiences , 2014, Front. Psychol..

[5]  Neff Walker,et al.  Evaluating the importance of multi-sensory input on memory and the sense of presence in virtual environments , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[6]  R. Satava,et al.  Virtual Reality Training Improves Operating Room Performance: Results of a Randomized, Double-Blinded Study , 2002, Annals of surgery.

[7]  Zhigeng Pan Technologies for E-Learning and Digital Entertainment, First International Conference, Edutainment 2006, Hangzhou, China, April 16-19, 2006, Proceedings , 2006, Edutainment.

[8]  J. P. Cater Smell/taste: odors in reality , 1994, Proceedings of IEEE International Conference on Systems, Man and Cybernetics.

[9]  Zahira Merchant,et al.  Effectiveness of virtual reality-based instruction on students' learning outcomes in K-12 and higher education: A meta-analysis , 2014, Comput. Educ..

[10]  Paul Richard,et al.  Using Olfactive Virtual Environments for Learning Organic Molecules , 2006, Edutainment.

[11]  Michael Meehan,et al.  Physiological measures of presence in stressful virtual environments , 2002, SIGGRAPH.

[12]  Mel Slater,et al.  The Influence of Body Movement on Subjective Presence in Virtual Environments , 1998, Hum. Factors.

[13]  Darren George,et al.  SPSS for Windows Step by Step: A Simple Guide and Reference , 1998 .

[14]  April L. Zenisky,et al.  Translating and Adapting Tests for Cross-Cultural Assessments , 2010 .

[15]  Woodrow Barfield,et al.  Comments on the Use of Olfactory Displays for Virtual Environments , 1996, Presence: Teleoperators & Virtual Environments.

[16]  R. Brislin Back-Translation for Cross-Cultural Research , 1970 .

[17]  Andy T. K. Ho,et al.  A Metric to Quantify Virtual Scene Movement for the Study of Cybersickness: Definition, Implementation, and Verification , 2001, Presence: Teleoperators & Virtual Environments.

[18]  Christian Geiger,et al.  Poster: Design and evaluation of 3D content with wind output , 2009, 2009 IEEE Symposium on 3D User Interfaces.

[19]  Mel Slater,et al.  Immersion, presence and performance in virtual environments: an experiment with tri-dimensional chess , 1996, VRST.

[20]  H. Hecht,et al.  Visually induced motion sickness can be alleviated by pleasant odors , 2015, Experimental Brain Research.

[21]  Chun-Yen Chang,et al.  A cost-effective interactive 3D virtual reality system applied to military live firing training , 2016, Virtual Reality.

[22]  Sheng He,et al.  Olfaction spontaneously highlights visual saliency map , 2013, Proceedings of the Royal Society B: Biological Sciences.

[23]  Marco Alberto Javarone,et al.  Modeling Radicalization Phenomena in Heterogeneous Populations , 2015, PloS one.

[24]  C. Coles,et al.  Case study: using a virtual reality computer game to teach fire safety skills to children diagnosed with fetal alcohol syndrome. , 2006, Journal of pediatric psychology.

[25]  F. Davide,et al.  Virtual olfactory interfaces : electronic noses and olfactory displays , 2001 .

[26]  C. Kimmelman,et al.  Clinical review of olfaction. , 1993, American journal of otolaryngology.

[27]  Jonathan Freeman,et al.  A Cross-Media Presence Questionnaire: The ITC-Sense of Presence Inventory , 2001, Presence: Teleoperators & Virtual Environments.

[28]  Miguel Melo,et al.  Presence and cybersickness in immersive content: Effects of content type, exposure time and gender , 2017, Comput. Graph..

[29]  Eva-Lotta Sallnäs PRESENCE IN MULTIMODAL INTERFACES , 1999 .

[30]  Matthew Lombard,et al.  At the Heart of It All: The Concept of Presence , 2006 .

[31]  J. Millot,et al.  Is there a relationship between odors and motion sickness? , 2014, Neuroscience Letters.

[32]  Kelly S. Kingdon,et al.  Human Performance in Immersive Virtual Environments: Effects of Exposure Duration, User Control, and Scene Complexity , 2002 .

[33]  J. Dungan,et al.  Effect of virtual reality training on laparoscopic surgery: randomised controlled trial , 2010 .

[34]  Daniel Thalmann,et al.  Head Mounted Wind , 2007 .

[35]  Felix Hülsmann,et al.  Simulating Wind and Warmth in Virtual Reality: Conception, Realization and Evaluation for a CAVE Environment , 2014, J. Virtual Real. Broadcast..

[36]  Yasushi Ikei,et al.  Presentation of Odor in Multi-Sensory Theater , 2013, HCI.

[37]  OmniPres project IST-2001-39237 Deliverable 5 Measuring Presence : A Guide to Current Measurement Approaches , 2004 .

[38]  Tom Diethe,et al.  HUMAN PERFORMANCE, SITUATION AWARENESS AND AUTOMATION: CURRENT RESEARCH AND TRENDS, VOL 2 , 2004 .

[39]  Florian Jentsch,et al.  Olfactory Stimuli Increase Presence in Virtual Environments , 2016, PloS one.

[40]  In-Young Kim,et al.  10 An Investigation into Physiological Responses in Virtual Environments: An Objective Measurement of Presence , 2003 .

[41]  Gerard Jounghyun Kim,et al.  Design and evaluation of a wind display for virtual reality , 2004, VRST '04.

[42]  Takamichi Nakamoto,et al.  Improvement of olfactory display using solenoid valves , 2007, 2007 IEEE Virtual Reality Conference.

[43]  Paul Strauss Human Factors In Engineering And Design , 2016 .

[44]  Jacquelyn Ford Morie,et al.  The effects of scent and game play experience on memory of a virtual environment , 2007, Virtual Reality.

[45]  S. Hashem,et al.  Transmission of olfactory information for tele-medicine , 1995 .

[46]  Robert S. Kennedy,et al.  Simulator Sickness Questionnaire: An enhanced method for quantifying simulator sickness. , 1993 .

[47]  Paul Richard,et al.  Multi-modal virtual environments for education with haptic and olfactory feedback , 2006, Virtual Reality.

[48]  Joseph J. LaViola,et al.  A discussion of cybersickness in virtual environments , 2000, SGCH.

[49]  Carolyn Axtell,et al.  Virtual, Augmented and Mixed Reality , 2016, Lecture Notes in Computer Science.

[50]  Carlo Harvey,et al.  Olfaction and Selective Rendering , 2018, Comput. Graph. Forum.

[51]  F. E. Grubbs Procedures for Detecting Outlying Observations in Samples , 1969 .

[52]  Charles Spence,et al.  Multisensory Presence in Virtual Reality: Possibilities & Limitations. , 2011 .

[53]  Carolina Cruz-Neira,et al.  Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE , 2023 .

[54]  Jouke Verlinden,et al.  Enhancement of Presence in a Virtual Sailing Environment through Localized Wind Simulation , 2013 .

[55]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[56]  António Augusto de Sousa,et al.  Adaptation and Validation of the Igroup Presence Questionnaire (IPQ) in a Portuguese Sample , 2016, PRESENCE: Teleoperators and Virtual Environments.

[57]  Holger Regenbrecht,et al.  The Experience of Presence: Factor Analytic Insights , 2001, Presence: Teleoperators & Virtual Environments.

[58]  Shinjiro Kawato,et al.  Projection based olfactory display with nose tracking , 2004, IEEE Virtual Reality 2004.

[59]  NarcisoDavid,et al.  The Impact of Olfactory and Wind Stimuli on 360 Videos Using Head-mounted Displays , 2020 .