A Moving Feast: Effects of Color, Shape and Animation on Taste Associations and Taste Perceptions

Research into multimodal flavor perceptions has demonstrated associations between basic tastes and visual cues. Moreover, such associations have been found to influence taste perception. Here we are interested in how mixed reality technology in the form of projection mapping can be used to introduce such visual cues during consumption. First, associations between basic tastes and visualizations that differed in color, shape and animation speed were investigated in a crowdsourcing study. The study demonstrated associations between sweetness and red rounded shapes, and sourness and green angular shapes with a fast animation speed. A subsequent lab study where the visualizations were projected around a cup of yogurt that participants tasted confirmed these associations. Finally, specific combinations of visualizations and animation types were found to influence taste perceptions of the yogurt. The implications of these findings are discussed.

[1]  John Zimmerman,et al.  Your dinner's calling: supporting family dinnertime activities , 2007, DPPI.

[2]  Ellen Yi-Luen Do,et al.  FunRasa: an interactive drinking platform , 2014, TEI '14.

[3]  Eric Robinson,et al.  Evaluation of a Smart Fork to Decelerate Eating Rate. , 2016, Journal of the Academy of Nutrition and Dietetics.

[4]  Thomas Johannes Lucas van Rompay,et al.  Tough package, strong taste: The influence of packaging design on taste impressions and product evaluations , 2011 .

[5]  C. Spence,et al.  Crossmodal correspondences between sounds and tastes , 2012, Psychonomic bulletin & review.

[6]  Carlos Velasco,et al.  Assessing crossmodal correspondences in exotic fruit juices: The case of shape and sound symbolism , 2013 .

[7]  Takuji Narumi,et al.  Evaluating cross-sensory perception of superimposing virtual color onto real drink: toward realization of pseudo-gustatory displays , 2010, AH.

[8]  T. Hummel,et al.  Cross-modal integration between odors and abstract symbols , 2010, Neuroscience Letters.

[9]  Charles Spence,et al.  Multisensory flavour perception , 2013, Current Biology.

[10]  J. Verhagen,et al.  The neurocognitive bases of human multimodal food perception: Sensory integration , 2006, Neuroscience & Biobehavioral Reviews.

[11]  Lina Engelen,et al.  Food Oral Processing: Fundamentals of Eating and Sensory Perception , 2012 .

[12]  Bruno Mesz,et al.  The Taste of Music , 2011, Perception.

[13]  Charles Spence,et al.  Grape expectations: The role of cognitive influences in color–flavor interactions , 2010, Consciousness and Cognition.

[14]  C. Spence,et al.  Rotating plates: Online study demonstrates the importance of orientation in the plating of food , 2015 .

[15]  Ilpo Koskinen,et al.  Proceedings of the 2007 conference on Designing pleasurable products and interfaces , 2007 .

[16]  Carmel A Levitan,et al.  Assessing the role of color cues and people's beliefs about color-flavor associations on the discrimination of the flavor of sugar-coated chocolates. , 2008, Chemical senses.

[17]  C. Spence,et al.  Colour, pleasantness, and consumption behaviour within a meal , 2014, Appetite.

[18]  C. Spence,et al.  Multisensory flavor perception: Assessing the influence of fruit acids and color cues on the perception of fruit-flavored beverages , 2008 .

[19]  Jan O. Borchers,et al.  First-person cooking: a dual-perspective interactive kitchen counter , 2010, CHI EA '10.

[20]  Elia Gatti,et al.  A taste of Kandinsky: assessing the influence of the artistic visual presentation of food on the dining experience , 2014, Flavour.

[21]  Charles Spence,et al.  Cross-modal associations between odors and colors. , 2006, Chemical senses.

[22]  Homei Miyashita,et al.  Communication by change in taste , 2011, CHI Extended Abstracts.

[23]  Ophelia Deroy,et al.  Fast lemons and sour boulders: Testing crossmodal correspondences using an internet-based testing methodology , 2013, i-Perception.

[24]  C. Spence,et al.  Is it the plate or is it the food? Assessing the influence of the color (black or white) and shape of the plate on the perception of the food placed on it , 2012 .

[25]  Ellen Yi-Luen Do,et al.  Simulating the sensation of taste for immersive experiences , 2013, ImmersiveMe '13.

[26]  Tara S. Behrend,et al.  The viability of crowdsourcing for survey research , 2011, Behavior research methods.

[27]  Charles Spence,et al.  “What’s Your Taste in Music?” A Comparison of the Effectiveness of Various Soundscapes in Evoking Specific Tastes , 2015, i-Perception.

[28]  Adrian David Cheok,et al.  Eating with our eyes: From visual hunger to digital satiation , 2016, Brain and Cognition.

[29]  Xuan Wang,et al.  CoDine: an interactive multi-sensory system for remote dining , 2011, UbiComp '11.

[30]  Charles Spence,et al.  There's More to Taste in a Coloured Bowl , 2011, Perception.

[31]  C. Spence,et al.  Hedonic mediation of the crossmodal correspondence between taste and shape , 2015 .

[32]  Larissa Hjorth,et al.  TastyBeats: Designing Palatable Representations of Physical Activity , 2015, CHI.

[33]  Lawrence L. Garber,et al.  Placing Food Color Experimentation into a Valid Consumer Context , 2001 .

[34]  Robert Hurling,et al.  Eating with your eyes: effect of appearance on expectations of liking , 2003, Appetite.

[35]  P. Bertelson,et al.  Multisensory integration, perception and ecological validity , 2003, Trends in Cognitive Sciences.

[36]  Subbarao Kambhampati,et al.  What We Instagram: A First Analysis of Instagram Photo Content and User Types , 2014, ICWSM.

[37]  C. Spence,et al.  The multisensory perception of flavor: Assessing the influence of color cues on flavor discrimination responses , 2007 .

[38]  Takuji Narumi,et al.  Augmented reality flavors: gustatory display based on edible marker and cross-modal interaction , 2011, CHI.

[39]  C. J. Overbeeke,et al.  The Taste of Desserts' Packages , 1991, Perceptual and motor skills.

[40]  Charles Spence,et al.  ‘Bouba’ and ‘Kiki’ in Namibia? A remote culture make similar shape–sound matches, but different shape–taste matches to westerners , 2013 .

[41]  F. W. Edridge-Green,et al.  Test for Colour Blindness , 1895 .

[42]  C. Spence,et al.  Does Food Color Influence Taste and Flavor Perception in Humans? , 2010 .

[43]  Brian M. Young.  Does food advertising influence children’s food choices? A critical review of some of the recent literature , 2003 .

[44]  C. Spence,et al.  Technology at the dining table , 2013, Flavour.

[45]  J. Delwiche,et al.  You eat with your eyes first , 2012, Physiology & Behavior.

[46]  Hervé Abdi,et al.  What can cognitive psychology and sensory evaluation learn from each other , 2002 .

[47]  J. Delwiche.  The impact of perceptual interactions on perceived flavor , 2004 .

[48]  C. Spence.  Crossmodal correspondences: A tutorial review , 2011, Attention, perception & psychophysics.

[49]  C. Spence,et al.  Crossmodal correspondences between odors and contingent features: odors, musical notes, and geometrical shapes , 2013, Psychonomic bulletin & review.

[50]  Ares Lagae,et al.  Procedural noise using sparse Gabor convolution , 2009, SIGGRAPH '09.

[51]  Adrian David Cheok,et al.  Chop Chop: A Sound Augmented Kitchen Prototype , 2012, Advances in Computer Entertainment.

[52]  C. Spence,et al.  Smelling shapes: crossmodal correspondences between odors and shapes. , 2013, Chemical senses.

[53]  Charles Spence,et al.  Multi‐Sensory Integration and the Psychophysics of Flavour Perception , 2012 .

[54]  Richard Harper,et al.  Celebratory technology: new directions for food research in HCI , 2008, CHI.

[55]  P. Bertelson,et al.  The psychology of multimodal perception , 2004 .

[56]  M. L. Demattè,et al.  Olfactory discrimination: when vision matters? , 2008, Chemical senses.

[57]  Charles Spence,et al.  The taste of cutlery: how the taste of food is affected by the weight, size, shape, and colour of the cutlery used to eat it , 2013, Flavour.

[58]  Kenton O'Hara,et al.  FoodWorks: tackling fussy eating by digitally augmenting children's meals , 2014, NordiCHI.

[59]  Samuel M. McClure,et al.  An Expectation-Based Approach to Explaining the Crossmodal Influence of Color on Orthonasal Odor Identification: The Influence of Expertise , 2010 .

[60]  C. Spence,et al.  The multisensory perception of flavor , 2008, Consciousness and Cognition.

[61]  Jun Rekimoto,et al.  Spot-Light: Multimodal Projection Mapping on Food , 2013, HCI.

[62]  M. Hirose.  Mixed Reality - Merging Real and Virtual Worlds , 1999 .

[63]  Amy C. Traylor,et al.  What Virtual Reality Research in Addictions Can Tell Us about the Future of Obesity Assessment and Treatment , 2011, Journal of diabetes science and technology.