Trigeminal-based Temperature Illusions

We explore a temperature illusion that uses low-powered electronics and enables the miniaturization of simple warm and cool sensations. Our illusion relies on the properties of certain scents, such as the coolness of mint or hotness of peppers. These odors trigger not only the olfactory bulb, but also the nose's trigeminal nerve, which has receptors that respond to both temperature and chemicals. To exploit this, we engineered a wearable device based on micropumps and an atomizer that emits up to three custom-made "thermal" scents directly to the user's nose. Breathing in these scents causes the user to feel warmer or cooler. We demonstrate how our device renders warmth and cooling sensations in virtual experiences. In our first study, we evaluated six candidate "thermal" scents. We found two hot-cold pairs, with one pair being less identifiable by odor. In our second study, pParticipants rated VR experiences with our device trigeminal stimulants as significantly warmer or cooler than the baseline conditions. Lastly, we believe this offers an alternative to existing thermal feedback devices, which unfortunately rely on power-hungry heat-lamps or Peltier-elements.

[1]  M. Hancock,et al.  Do people like to feel ‘neutral’?: Exploring the variation of the desired thermal sensation on the ASHRAE scale , 2007 .

[2]  Enrico Rukzio,et al.  inScent: a wearable olfactory display as an amplification for mobile notifications , 2017, SEMWEB.

[3]  G. Brand Olfactory/trigeminal interactions in nasal chemoreception , 2006, Neuroscience & Biobehavioral Reviews.

[4]  Lee Skrypchuk,et al.  Haptic Navigation Cues on the Steering Wheel , 2019, CHI.

[5]  Susumu Kunifuji,et al.  An Editing and Displaying System of Olfactory Information for the Home Video , 2006, KES.

[6]  James A. Covington,et al.  Development of a Portable, Multichannel Olfactory Display Transducer , 2018, IEEE Sensors Journal.

[7]  Akira Tomono,et al.  An unencumbering, localized olfactory display , 2003, CHI Extended Abstracts.

[8]  Adam Danielsson,et al.  A thermal information display for mobile applications , 2007, Mobile HCI.

[9]  Kouta Minamizawa,et al.  ThermalBracelet: Exploring Thermal Haptic Feedback Around the Wrist , 2019, CHI.

[10]  Sriram Subramanian,et al.  SensaBubble: a chrono-sensory mid-air display of sight and smell , 2014, CHI.

[11]  Kouta Minamizawa,et al.  Altered touch: miniature haptic display with force, thermal and tactile feedback for augmented haptics , 2017, SIGGRAPH Posters.

[12]  Liwei Qiu,et al.  Midair Ultrasound Fragrance Rendering , 2018, IEEE Transactions on Visualization and Computer Graphics.

[13]  J. Frasnelli,et al.  Intranasal Trigeminal Chemoreception , 2017 .

[14]  Myron W Krueger Addition of Olfactory Stimuli to Virtual Reality Simulations for Medical Training Applications , 1996 .

[15]  Jean M. Taylor,et al.  Food flavourings and compounds of related structure I. Acute oral toxicity , 1964 .

[16]  Chomtip Pornpanomchai,et al.  SUBSMELL: Multimedia with a Simple Olfactory Display , 2009, PSIVT.

[17]  R. Tisserand,et al.  Essential oil profiles , 2014 .

[18]  Richard Corbett,et al.  AROMA: ambient awareness through olfaction in a messaging application , 2004, ICMI '04.

[19]  F. Lepore,et al.  Perception of trigeminal mixtures. , 2015, Chemical senses.

[20]  S. Bharate,et al.  Modulation of thermoreceptor TRPM8 by cooling compounds. , 2012, ACS chemical neuroscience.

[21]  Dhruv Jain,et al.  Immersive Terrestrial Scuba Diving Using Virtual Reality , 2016, CHI Extended Abstracts.

[22]  Richard A. Volz,et al.  Evaluation of a Haptic Mixed Reality System for Interactions with a Virtual Control Panel , 2005, Presence: Teleoperators & Virtual Environments.

[23]  Cordelia A. Running Desensitization but not sensitization from commercial chemesthetic beverages , 2018, Food Quality and Preference.

[24]  Judith Amores,et al.  Essence: Olfactory Interfaces for Unconscious Influence of Mood and Cognitive Performance , 2017, International Conference on Human Factors in Computing Systems.

[25]  Wei Peng,et al.  ThermoVR: Exploring Integrated Thermal Haptic Feedback with Head Mounted Displays , 2017, CHI.

[26]  Felix Hülsmann,et al.  Wind and warmth in virtual reality: implementation and evaluation , 2014, VRIC.

[27]  Neff Walker,et al.  Evaluating the importance of multi-sensory input on memory and the sense of presence in virtual environments , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[28]  Takamichi Nakamoto,et al.  Tiny Olfactory Display Using Surface Acoustic Wave Device and Micropumps for Wearable Applications , 2016, IEEE Sensors Journal.

[29]  J. Prescott The Generalizability of Capsaicin Sensitization and Desensitization , 1999, Physiology & Behavior.

[30]  T. Bíró,et al.  Transient receptor potential channels as therapeutic targets , 2011, Nature Reviews Drug Discovery.

[31]  Krishnapura Srinivasan,et al.  Biological Activities of Red Pepper (Capsicum annuum) and Its Pungent Principle Capsaicin: A Review , 2016, Critical reviews in food science and nutrition.

[32]  Takuji Narumi,et al.  Characterizing the Space by Thermal Feedback through a Wearable Device , 2009, HCI.

[33]  P. Lawrence Essential Oil Safety — A guide for health care professionals , 1996 .

[34]  P. Jurs,et al.  Intranasal trigeminal stimulation from odorous volatiles: Psychometric responses from anosmic and normal humans , 1978, Physiology & Behavior.

[35]  M. Meredith Trigeminal Response to Odors , 1988 .

[36]  David K. McGookin,et al.  Hajukone: Developing an Open Source Olfactory Device , 2016, CHI Extended Abstracts.

[37]  Tovi Grossman,et al.  HydroRing: Supporting Mixed Reality Haptics Using Liquid Flow , 2018, UIST.

[38]  Kouta Minamizawa,et al.  A Novel Multimodal Tactile Module that Can Provide Vibro-Thermal Feedback , 2016, AsiaHaptics.

[39]  Kunihiro Chihara,et al.  Fragra: a visual-olfactory VR game , 2004, SIGGRAPH '04.

[40]  Yifei Zhang,et al.  Dexmo: An Inexpensive and Lightweight Mechanical Exoskeleton for Motion Capture and Force Feedback in VR , 2016, CHI.

[41]  J. Patil,et al.  Pulmonary drug delivery strategies: A concise, systematic review , 2012, Lung India : official organ of Indian Chest Society.

[42]  Marianna Obrist,et al.  Smell-O-Message: Integration of Olfactory Notifications into a Messaging Application to Improve Users' Performance , 2018, ICMI.

[43]  Tomohiro Tanikawa,et al.  Wearable Olfactory Display: Using Odor in Outdoor Environment , 2006, IEEE Virtual Reality Conference (VR 2006).

[44]  Beverly Horn Commentary 2. , 2001, Journal of clinical anesthesia.

[45]  Xuming Zhang,et al.  Molecular sensors and modulators of thermoreception , 2015, Channels.

[46]  Philipp Wintersberger,et al.  S(C)ENTINEL: monitoring automated vehicles with olfactory reliability displays , 2019, IUI.

[47]  Takuji Narumi,et al.  Pseudo-gustatory display system based on cross-modal integration of vision, olfaction and gustation , 2011, 2011 IEEE Virtual Reality Conference.

[48]  B. Green Temporal characteristics of capsaicin sensitization and desensitization on the tongue , 1991, Physiology & Behavior.

[49]  F. A. Patty,et al.  Patty's Industrial hygiene and toxicology , 1978 .

[50]  Adrian David Cheok,et al.  22nd International Conference on Human-Computer Interaction with Mobile Devices and Services , 2007, Lecture Notes in Computer Science.

[51]  Ellen Yi-Luen Do,et al.  Season Traveller: Multisensory Narration for Enhancing the Virtual Reality Experience , 2018, CHI.

[52]  Abderrahmane Kheddar,et al.  Tactile interfaces: a state-of-the-art survey , 2004 .

[53]  Adrian David Cheok,et al.  Sound perfume: designing a wearable sound and fragrance media for face-to-face interpersonal interaction , 2011, Advances in Computer Entertainment Technology.

[54]  David S. Wishart,et al.  DrugBank 5.0: a major update to the DrugBank database for 2018 , 2017, Nucleic Acids Res..

[55]  D. McKemy,et al.  Identification of a cold receptor reveals a general role for TRP channels in thermosensation , 2002, Nature.

[56]  Adelman Sensory Systems: II: Senses Other than Vision , 1988 .

[57]  William R. Sherman,et al.  Understanding Virtual RealityInterface, Application, and Design , 2002, Presence: Teleoperators & Virtual Environments.

[58]  L. Vecellio The mesh nebuliser: a recent technical innovation for aerosol delivery , 2006, Breathe.

[59]  Baudry,et al.  Patty ' s Industrial Hygiene and Toxicology , 2017 .

[60]  V. Michael Bove,et al.  Odor emoticon: An olfactory application that conveys emotions , 2016, Int. J. Hum. Comput. Stud..

[61]  Joseph A. Paradiso,et al.  Bin-ary: detecting the state of organic trash to prevent insalubrity , 2015, UbiComp/ISWC Adjunct.

[62]  F. Viana,et al.  Chemosensory properties of the trigeminal system. , 2011, ACS chemical neuroscience.

[63]  M. Abraham,et al.  Trigeminal and Olfactory Chemosensory Impact of Selected Terpenes , 1998, Pharmacology Biochemistry and Behavior.

[64]  Takuji Narumi,et al.  Affecting tumbler: affecting our flavor perception with thermal feedback , 2014, Advances in Computer Entertainment.

[65]  Takashi Maeno,et al.  Presentation of Sudden Temperature Change Using Spatially Divided Warm and Cool Stimuli , 2012, EuroHaptics.

[66]  Jay M. Arena,et al.  Clinical Toxicology of Commercial Products , 1964 .

[67]  T. Ishimaru,et al.  Topographical differences in the sensitivity of the human nasal mucosa to olfactory and trigeminal stimuli , 2011, Neuroscience Letters.

[68]  Ellen Yi-Luen Do,et al.  Ambiotherm: Enhancing Sense of Presence in Virtual Reality by Simulating Real-World Environmental Conditions , 2017, CHI.

[69]  Ken-ichi Okada,et al.  Ink jet olfactory display enabling instantaneous switches of scents , 2010, ACM Multimedia.

[70]  R. Khan,et al.  Perceptual convergence of multi-component mixtures in olfaction implies an olfactory white , 2012, Proceedings of the National Academy of Sciences.

[71]  Ellen Yi-Luen Do,et al.  Tainted: An olfaction-enhanced game narrative for smelling virtual ghosts , 2019, Int. J. Hum. Comput. Stud..

[72]  A. Patapoutian,et al.  ThermoTRP channels and beyond: mechanisms of temperature sensation , 2003, Nature Reviews Neuroscience.

[73]  Takamichi Nakamoto,et al.  Olfactory and Visual Presentation Using Olfactory Display Using SAW Atomizer and Solenoid Valves , 2018, IUI Companion.

[74]  J. Lundström,et al.  Perception of specific trigeminal chemosensory agonists , 2011, Neuroscience.