Virtual Taste and Smell Technologies for Multisensory Internet and Virtual Reality

To pursue the next stage of the internet, humans should not only communicate emotions with visual, audio, and tactile stimuli but also with taste (gustation). Humans will want to share these stimuli collectively as an experience digitally, like they currently do with the visual and audio media on the internet.Wewant to propose the idea of gustation creating and experiencing digital representation of taste sensation. However, a new methodology is first needed to digitally stimulate the sense of taste to enable internet communication of the sense. We propose an electrical tongue stimulation device, which the user places in their mouth to produce taste sensations. This technique operates by inducing weak electric signals by changing frequency and Pulse Width Modulation (PWM) produced by the circuitry. Several experiments were carried out to evaluate this approach of digitizing taste sensations. Results from experiments show a new user experience through digital taste stimuli.

[1]  Bernd Nilius,et al.  Heat activation of TRPM5 underlies thermal sensitivity of sweet taste , 2005, Nature.

[2]  Takuji Narumi,et al.  Affecting tumbler: affecting our flavor perception with thermal feedback , 2014, Advances in Computer Entertainment.

[3]  Takuji Narumi,et al.  Augmented reality flavors: gustatory display based on edible marker and cross-modal interaction , 2011, CHI.

[4]  Adrian David Cheok,et al.  Initial basic concept of thermal sweet taste interface , 2015, Advances in Computer Entertainment.

[5]  Tracey Hollowood,et al.  Phenotypic variation in oronasal perception and the relative effects of PROP and Thermal Taster Status , 2014 .

[6]  David K. McGookin,et al.  Hajukone: Developing an Open Source Olfactory Device , 2016, CHI Extended Abstracts.

[7]  Takuji Narumi,et al.  Evaluating cross-sensory perception of superimposing virtual color onto real drink: toward realization of pseudo-gustatory displays , 2010, AH.

[8]  Noam Sobel,et al.  The sniff is part of the olfactory percept. , 2006, Chemical senses.

[9]  G Von Békésy,et al.  Taste theories and the chemical stimulation of single papillae. , 1966, Journal of applied physiology.

[10]  Adrian David Cheok,et al.  Sound perfume: designing a wearable sound and fragrance media for face-to-face interpersonal interaction , 2011, Advances in Computer Entertainment Technology.

[11]  Richard Corbett,et al.  AROMA: ambient awareness through olfaction in a messaging application , 2004, ICMI '04.

[12]  Ryohei Nakatsu,et al.  Taste/IP: the sensation of taste for digital communication , 2012, ICMI '12.

[13]  Xueliang Huo,et al.  A Wireless Tongue-Computer Interface Using Stereo Differential Magnetic Field Measurement , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[14]  Homei Miyashita,et al.  Enhancing saltiness with cathodal current , 2013, CHI Extended Abstracts.

[15]  Gary J. Pickering,et al.  Thermal taste, PROP responsiveness, and perception of oral sensations , 2008, Physiology & Behavior.

[16]  B. Green,et al.  Thermal stimulation of taste , 2000, Nature.

[17]  B. Shah,et al.  Cellular/molecular Transient Receptor Potential Channel Type M5 Is Essential for Fat Taste , 2022 .

[18]  T Miwa,et al.  Olfactory evoked potential produced by electrical stimulation of the human olfactory mucosa. , 1997, Chemical senses.

[19]  Tom Fleischer The Tyranny Of E Mail The Four Thousand Year Journey To Your Inbox , 2016 .

[20]  Homei Miyashita,et al.  Augmented gustation using electricity , 2011, AH '11.

[21]  David J. Beebe,et al.  Development of a Tongue-Operated Switch Array as an Alternative Input Device , 2005 .

[22]  D. A. Stevens,et al.  Metallic taste from electrical and chemical stimulation. , 2005, Chemical senses.

[23]  M Ikeda,et al.  Basis and practice of clinical taste examinations. , 1986, Auris, nasus, larynx.

[24]  B. Nilius,et al.  Influence of temperature on taste perception , 2007, Cellular and Molecular Life Sciences.

[25]  Leslie M Kay,et al.  Interplay between Sniffing and Odorant Sorptive Properties in the Rat , 2012, The Journal of Neuroscience.

[26]  Stephen A. Brewster,et al.  The Role of Modality in Notification Performance , 2011, INTERACT.

[27]  Philip Kortum,et al.  HCI Beyond the GUI: Design for Haptic, Speech, Olfactory, and Other Nontraditional Interfaces , 2008 .

[28]  Aidan O'Dwyer,et al.  Handbook of PI and PID controller tuning rules , 2003 .

[29]  John Prescott,et al.  Human hedonic responses to sweetness: Role of taste genetics and anatomy , 2007, Physiology & Behavior.

[30]  Takafumi Koike,et al.  Taste change of soup by the recreating of sourness and saltiness using the electrical stimulation , 2015, AH.

[31]  B. Lindemann,et al.  Taste reception. , 1996, Physiological reviews.

[32]  Hadas Lapid,et al.  Recording odor-evoked response potentials at the human olfactory epithelium. , 2013, Chemical senses.

[33]  Enrico Rukzio,et al.  inScent: a wearable olfactory display as an amplification for mobile notifications , 2017, SEMWEB.

[34]  Ellen Yi-Luen Do,et al.  Digital Lollipop , 2016, ACM Trans. Multim. Comput. Commun. Appl..

[35]  T Ishimaru,et al.  Olfactory evoked potentials produced by electrical stimulation of the olfactory mucosa. , 1996, Auris, nasus, larynx.

[36]  Eishi Asano,et al.  Olfactory hallucinations elicited by electrical stimulation via subdural electrodes: Effects of direct stimulation of olfactory bulb and tract , 2012, Epilepsy & Behavior.

[37]  Akira Tomono,et al.  An unencumbering, localized olfactory display , 2003, CHI Extended Abstracts.

[38]  C. Yamamoto,et al.  Olfactory bulb potentials to electrical stimulation of the olfactory mucosa. , 1961, The Japanese journal of physiology.

[39]  S. Roper,et al.  Taste buds as peripheral chemosensory processors. , 2013, Seminars in cell & developmental biology.

[40]  L. M. Jones,et al.  Could olfactory displays improve data visualization? , 2004, Comput. Sci. Eng..

[41]  William R. Klemm,et al.  Topographical EEG maps of human responses to odors , 1992 .

[42]  Dan Maynes-Aminzade,et al.  Edible Bits: Seamless Interfaces between People, Data and Food , 2005 .

[43]  Matthew J. Hertenstein Touch: Its Communicative Functions in Infancy , 2002, Human Development.

[44]  Adrian David Cheok,et al.  Digital taste and smell communication , 2011, BODYNETS.

[45]  John A. DeSimone,et al.  MODELS OF TASTE RECEPTOR CELL STIMULATION , 1977 .

[46]  Adrian David Cheok,et al.  Methods to develop a low cost laboratory olfactometer for multisensory, psychology, and neuroscience experiments , 2017, IECON 2017 - 43rd Annual Conference of the IEEE Industrial Electronics Society.

[47]  R. Henkin,et al.  Taste and Smell Disorders , 1988 .

[48]  K. Hörmann,et al.  Information processing during sleep: the effect of olfactory stimuli on dream content and dream emotions , 2009, Journal of sleep research.

[49]  Noam Sobel,et al.  From Nose to Brain: Un-Sensed Electrical Currents Applied in the Nose Alter Activity in Deep Brain Structures , 2016, Cerebral cortex.

[50]  Richard L. Doty,et al.  Differential sensitivity of tongue areas and palate to electrical stimulation: a suprathreshold cross-modal matching study , 1991 .

[51]  B. Green,et al.  Temperature Affects Human Sweet Taste via At Least Two Mechanisms. , 2015, Chemical senses.

[52]  Haruo Noma,et al.  SpotScents: A Novel Method of Natural Scent Delivery Using Multiple Scent Projectors , 2006, IEEE Virtual Reality Conference (VR 2006).

[53]  A. Mackay-Sim,et al.  New techniques for biopsy and culture of human olfactory epithelial neurons. , 1998, Archives of otolaryngology--head & neck surgery.

[54]  N. Fausto,et al.  Liver regeneration , 2006, Hepatology.

[55]  J. Stillman,et al.  Studies on the relationship between electrogustometry and sour taste perception. , 2007, Auris, nasus, larynx.

[56]  Tomohiro Tanikawa,et al.  Wearable Olfactory Display: Using Odor in Outdoor Environment , 2006, IEEE Virtual Reality Conference (VR 2006).

[57]  Stephan Frings,et al.  The sour taste of a proton current , 2010, Proceedings of the National Academy of Sciences.

[58]  Gary K. Beauchamp,et al.  Development of Sweet Taste , 1987 .

[59]  Takaki Miwa,et al.  Electrically Stimulated Olfactory Evoked Potential in Olfactory Disturbance , 2002, The Annals of otology, rhinology, and laryngology.

[60]  K. -H. Plattig,et al.  Taste qualities elicited by electric stimulation of single human tongue papillae , 1976, Pflügers Archiv.

[61]  J. B. Beavers,et al.  Diaprepes abbreviatus: Laboratory and Field Behavioral and Attractancy Studies , 1982 .

[62]  Te Tang,et al.  A new gustometer for taste testing in rodents. , 2015, Chemical senses.

[63]  C. S. Lin,et al.  Mapping brain activation to odorants in patients with smell loss by functional MRI. , 1998, Journal of computer assisted tomography.

[64]  M. H. Ozdener,et al.  Primary culture of the human olfactory neuroepithelium. , 2013, Methods in molecular biology.

[65]  Ö. Göktas,et al.  Active Olfactory Training for the treatment of Smelling Disorders , 2012, Ear, nose, & throat journal.

[66]  Ravin Balakrishnan,et al.  Pressure widgets , 2004, CHI.

[67]  E. Liman,et al.  TRPM5 and taste transduction. , 2007, Handbook of experimental pharmacology.

[68]  Sriram Subramanian,et al.  SensaBubble: a chrono-sensory mid-air display of sight and smell , 2014, CHI.

[69]  C. S. Lin,et al.  Increased brain activation in response to odors in patients with hyposmia after theophylline treatment demonstrated by fMRI. , 1998, Journal of computer assisted tomography.

[70]  Arvind Ramanathan,et al.  Categorical Dimensions of Human Odor Descriptor Space Revealed by Non-Negative Matrix Factorization , 2013, PloS one.

[71]  Homei Miyashita,et al.  Controlling saltiness without salt: evaluation of taste change by applying and releasing cathodal current , 2013, CEA '13.