A reproducible olfactory display for exploring olfaction in immersive media experiences

Olfaction, the sense of smell, is an important perceptual function. It has been shown to enhance the quality of life and to facilitate memory recall. However, despite its importance and potential benefits, olfaction is often neglected when creating immersive media experiences (IMEs). The probable reason is that olfactory displays are not readily available. We have developed a reproducible olfactory display that is simple and affordable to make olfactory displays more available. More importantly, we have conducted three exploratory studies on the effects of olfaction. The results of these studies indicate that olfaction is a nuanced sense that can have both positive and negative effects on user experiences. Hence, further research is needed to better understand and design for olfaction in IMEs.

[1]  Hiroshi Ishida,et al.  Smelling Screen: Development and Evaluation of an Olfactory Display System for Presenting a Virtual Odor Source , 2013, IEEE Transactions on Visualization and Computer Graphics.

[2]  Frank R. Schab.  Odors and the remembrance of things past. , 1990 .

[3]  Ruth B. Ekstrom,et al.  Manual for kit of factor-referenced cognitive tests , 1976 .

[4]  Akira Tomono,et al.  Basics for Olfactory Display , 2013 .

[5]  Jacquelyn Ford Morie,et al.  The effects of scent and game play experience on memory of a virtual environment , 2007, Virtual Reality.

[6]  George Ghinea,et al.  Perceived Synchronization of Olfactory Multimedia , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[7]  Ryan P. McMahan,et al.  Development of a Simple and Low-Cost Olfactory Display for Immersive Media Experiences , 2014, ImmersiveMe '14.

[8]  MurrayNiall,et al.  User-profile-based perceived olfactory and visual media synchronization , 2014 .

[9]  N. Bond,et al.  Context-dependent memory: colour versus odour. , 1998, Chemical senses.

[10]  F. R. Schab,et al.  Odors and the remembrance of things past. , 1990 .

[11]  Shinjiro Kawato,et al.  Projection based olfactory display with nose tracking , 2004, IEEE Virtual Reality 2004.

[12]  Sriram Subramanian,et al.  SensaBubble: a chrono-sensory mid-air display of sight and smell , 2014, CHI.

[13]  E. Tulving.  Memory and consciousness. , 1985 .

[14]  Ryan P. McMahan.  Virtual Environments for Surface Mining Powered Haulage Training , 2010 .

[15]  Gabriel-Miro Muntean,et al.  Multiple-Scent Enhanced Multimedia Synchronization , 2014, TOMM.

[16]  James Hall,et al.  March-and-Reach: A realistic ladder climbing technique , 2015, 2015 IEEE Symposium on 3D User Interfaces (3DUI).

[17]  D. Ross,et al.  Olfactory stimuli as context cues in human memory. , 1989, The American journal of psychology.

[18]  Gabriel-Miro Muntean,et al.  Age and gender influence on perceived olfactory & visual media synchronization , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[19]  Ruth de Villiers,et al.  Virtual reality training applications for the mining industry , 2009, Afrigraph.

[20]  Ryan P. McMahan,et al.  Virtual reality ladder climbing for mine safety training , 2015 .

[21]  Kyle Johnsen,et al.  Comparing Interpersonal Interactions with a Virtual Human to Those with a Real Human , 2007, IEEE Transactions on Visualization and Computer Graphics.

[22]  E. Tulving.  Elements of episodic memory , 1983 .

[23]  S. Nordin,et al.  A Scandinavian Adaptation of the Multi-Clinic Smell and Taste Questionnaire: Evaluation of Questions About Olfaction , 2003, Acta oto-laryngologica.

[24]  Doug A. Bowman,et al.  Virtual Environment Training for Preshift Inspections of Haul Trucks to Improve Mining Safety , 2008 .

[25]  Richard D. Roberts,et al.  What the nose knows: olfaction and cognitive abilities , 2001 .

[26]  Gabriel-Miro Muntean,et al.  User-profile-based perceived olfactory and visual media synchronization , 2014, ACM Trans. Multim. Comput. Commun. Appl..

[27]  Shumin Zhai,et al.  User performance in relation to 3D input device design , 1998, COMG.

[28]  Christopher James Hamblin,et al.  Transfer of *training from virtual reality environments , 2005 .

[29]  Alfred T. Lee.  Flight Simulation: Virtual Environments in Aviation , 2005 .

[30]  L. M. Jones,et al.  Could olfactory displays improve data visualization? , 2004, Comput. Sci. Eng..

[31]  Paul Richard,et al.  Multi-modal virtual environments for education with haptic and olfactory feedback , 2006, Virtual Reality.

[32]  George Ghinea,et al.  The sweet smell of success: Enhancing multimedia applications with olfaction , 2012, TOMCCAP.

[33]  Eduardo Salas,et al.  Flight Simulator Training Effectiveness: A Meta-Analysis , 1992 .

[34]  T. Grantcharov,et al.  Randomized clinical trial of virtual reality simulation for laparoscopic skills training , 2004, The British journal of surgery.

[35]  Tomohiro Tanikawa,et al.  Wearable Olfactory Display: Using Odor in Outdoor Environment , 2006, IEEE Virtual Reality Conference (VR 2006).

[36]  T. Engen,et al.  Odor memory: Review and analysis , 1996, Psychonomic bulletin & review.

[37]  Ken-ichi Okada,et al.  Development of a High-Performance Olfactory Display and Measurement of Olfactory Characteristics for Pulse Ejections , 2010, 2010 10th IEEE/IPSJ International Symposium on Applications and the Internet.

[38]  GHEORGHITA GHINEA,et al.  User perception of media content association in olfaction-enhanced multimedia , 2012, TOMCCAP.

[39]  Daniel V Santos,et al.  Hazardous events associated with impaired olfactory function. , 2004, Archives of otolaryngology--head & neck surgery.

[40]  Jeffrey Johnson,et al.  Designing with the mind in mind : simple guide to understanding user interface design guidelines , 2014 .

[41]  R. Herz,et al.  The effects of cue distinctiveness on odor-based context-dependent memory , 1997, Memory & cognition.

[42]  Neff Walker,et al.  Evaluating the importance of multi-sensory input on memory and the sense of presence in virtual environments , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[43]  Thomas C. Meyer,et al.  Presence as the Defining Factor in a VR Application , 1994 .

[44]  Y. Yanagida,et al.  A survey of olfactory displays: Making and delivering scents , 2012, 2012 IEEE Sensors.

[45]  Kamran Z Khan,et al.  Simulation in Medical Education , 2018, Understanding Medical Education.

[46]  Ivan Poupyrev,et al.  3D User Interfaces: Theory and Practice , 2004 .

[47]  Doug A. Bowman,et al.  Virtual Reality: How Much Immersion Is Enough? , 2007, Computer.

[48]  Takamichi Nakamoto,et al.  Cooking Up an Interactive Olfactory Game Display , 2008, IEEE Computer Graphics and Applications.

[49]  Ekaterina P. Volkova,et al.  Emotion categorization of body expressions in narrative scenarios , 2014, Front. Psychol..

[50]  George Ghinea,et al.  Information recall task impact in olfaction-enhanced multimedia , 2013, TOMCCAP.

[51]  Mirabelle D'Cruz.  Structured evaluation of training in virtual environments , 1999 .

[52]  Jeffrey Johnson,et al.  Designing with the Mind in Mind: Simple Guide to Understanding User Interface Design Rules , 2010 .

[53]  Jesse Schell,et al.  Designing Interactive Theme Park Rides , 2001, IEEE Computer Graphics and Applications.

[54]  Lionel Standing,et al.  Verbal Memory Elicited by Ambient Odor , 1992, Perceptual and motor skills.

[55]  Mel Slater,et al.  Taking steps: the influence of a walking technique on presence in virtual reality , 1995, TCHI.

[56]  Pamela W. Henderson,et al.  Improving the Store Environment: Do Olfactory Cues Affect Evaluations and Behaviors? , 1996 .

[57]  Charles Spence,et al.  Multisensory Presence in Virtual Reality: Possibilities & Limitations. , 2011 .

[58]  E. Reiter,et al.  Impact of olfactory impairment on quality of life and disability. , 2001, Archives of otolaryngology--head & neck surgery.

[59]  C. Spence,et al.  Crossmodal effect of music and odor pleasantness on olfactory quality perception , 2014, Front. Psychol..