Touch, Taste, & Smell User Interfaces: The Future of Multisensory HCI

The senses we call upon when interacting with technology are very restricted. We mostly rely on vision and audition, increasingly harnessing touch, whilst taste and smell remain largely underexploited. In spite of our current knowledge about sensory systems and sensory devices, the biggest stumbling block for progress concerns the need for a deeper understanding of people's multisensory experiences in HCI. It is essential to determine what tactile, gustatory, and olfactory experiences we can design for, and how we can meaningfully stimulate such experiences when interacting with technology. Importantly, we need to determine the contribution of the different senses along with their interactions in order to design more effective and engaging digital multisensory experiences. Finally, it is vital to understand what the limitations are that come into play when users need to monitor more than one sense at a time. The aim of this workshop is to deepen and expand the discussion on touch, taste, and smell within the CHI community and promote the relevance of multisensory experience design and research in HCI.

[1]  Sriram Subramanian,et al.  Emotions Mediated Through Mid-Air Haptics , 2015, CHI.

[2]  Rob Comber,et al.  Temporal, affective, and embodied characteristics of taste experiences: a framework for design , 2014, CHI.

[3]  B. Stein The new handbook of multisensory processes , 2012 .

[4]  Ali Israr,et al.  FeelCraft: crafting tactile experiences for media using a feel effect library , 2014, UIST.

[5]  C. Spence Multisensory Flavor Perception , 2015, Cell.

[6]  C. Spence,et al.  Review: The New Handbook of Multisensory Processing: Sensory Ecology, Behaviour, and Evolution , 2013 .

[7]  C. Spence,et al.  The Handbook of Multisensory Processing , 2004 .

[8]  Takuji Narumi,et al.  Augmented reality flavors: gustatory display based on edible marker and cross-modal interaction , 2011, CHI.

[9]  John Prescott,et al.  Flavour as a psychological construct: implications for perceiving and measuring the sensory qualities of foods , 1999 .

[10]  Ellen Yi-Luen Do,et al.  Taste+: Digitally Enhancing Taste Sensations of Food and Beverages , 2014, ACM Multimedia.

[11]  A. Keller,et al.  Humans Can Discriminate More than 1 Trillion Olfactory Stimuli , 2014, Science.

[12]  Alexandre N. Tuch,et al.  Opportunities for odor: experiences with smell and implications for technology , 2014, CHI.

[13]  Sriram Subramanian,et al.  Talking about tactile experiences , 2013, CHI.

[14]  Manfred Tscheligi,et al.  LOLLio: exploring taste as playful modality , 2013, TEI '13.

[15]  Adrian David Cheok,et al.  Digital taste and smell communication , 2011, BODYNETS.