Exploring Food based Interactive, Multi-Sensory, and Tangible Storytelling Experiences

Much work has been done on the design of both interactive narratives and food-based interaction systems, however their intersection has received little attention within the design research community. We took the relative dearth of food-based interactive storytelling systems as an opportunity to explore a compelling design space for multisensory interactive narratives, given these few systems often position people only as passive observers. We report the results of a design workshop conducted among the authors who are design researchers in interactive narratives and food-based play. In the workshop, we discussed existing works, asynchronously brainstormed new food-based interactive storytelling systems, and then reconvened to discuss our ideas. We present the portfolio of designs that arose from this workshop, and the design themes that we synthesized from the portfolio. We recommend how to position people not just as observers, but as active participants in the interactive food-based storytelling system.

[1]  Ali Mazalek,et al.  genieBottles: An Interactive Narrative in Bottles , 2001, SIGGRAPH 2001.

[2]  Melanie C. Green,et al.  Interactive Narratives: Processes and Outcomes in User‐Directed Stories , 2014 .

[3]  Rob Comber,et al.  Temporal, affective, and embodied characteristics of taste experiences: a framework for design , 2014, CHI.

[4]  Yan Wang,et al.  Towards Understanding the Design of Playful Gustosonic Experiences with Ice Cream , 2019, CHI PLAY.

[5]  George Ghinea,et al.  Olfaction-enhanced multimedia: perspectives and challenges , 2011, Multimedia Tools and Applications.

[6]  David Bordwell,et al.  Film Art: An Introduction , 1979 .

[7]  A. Galloway,et al.  Speculative design as research method , 2018, Undesign.

[8]  Abu Saleh Md. Mahfujur Rahman,et al.  Mobile haptic e-book system to support 3D immersive reading in ubiquitous environments , 2013, TOMCCAP.

[9]  Yan Wang,et al.  Towards Experiencing Eating as a Form of Play , 2018, CHI PLAY.

[10]  Carlos Velasco,et al.  Towards Multisensory Storytelling with Taste and Flavor , 2018, MHFI@ICMI.

[11]  William W. Gaver,et al.  Alternatives: exploring information appliances through conceptual design proposals , 2000, CHI.

[12]  M. Premila,et al.  Ayurvedic Herbs: A Clinical Guide to the Healing Plants of Traditional Indian Medicine , 2006 .

[13]  Rohit Ashok Khot,et al.  GustaCine: Towards Designing a Gustatory Cinematic Experience , 2020, Tangible and Embedded Interaction.

[14]  Elise van den Hoven,et al.  Technologies for Everyday Life Reflection: Illustrating a Design Space , 2016, TEI.

[15]  J. G. Tanenbaum,et al.  Agency as commitment to meaning: communicative competence in games , 2010, Digit. Creativity.

[16]  Ali Mazalek,et al.  Tangible VR: Diegetic Tangible Objects for Virtual Reality Narratives , 2017, Conference on Designing Interactive Systems.

[17]  Joshua Tanenbaum Identity Transformation and Agency in Digital Narratives and Story Based Games , 2015 .

[18]  Florian Mueller,et al.  Experiencing the Body as Play , 2018, CHI.

[19]  Marek Hatala,et al.  Experiencing the reading glove , 2010, TEI.

[20]  Katherine Isbister,et al.  Playful Human-Food Interaction Research: State of the Art and Future Directions , 2019, CHI PLAY.

[21]  C. Spence Gastrophysics: A New Scientific Approach to Eating , 2019, Handbook of Molecular Gastronomy.

[22]  Janet van der Linden,et al.  Control and Being Controlled: Exploring the use of Technology in an Immersive Theatre Performance , 2017, Conference on Designing Interactive Systems.

[23]  Elena Márquez Segura,et al.  Chasing Play Potentials in Food Culture to Inspire Technology Design , 2019, CHI PLAY.

[24]  Koji Tsukada,et al.  EducaTableware: computer-augmented tableware to enhance the eating experiences , 2013, CHI Extended Abstracts.

[25]  Huaxin Wei,et al.  Designing Physical Artifacts for Tangible Narratives: Lessons Learned from Letters to José , 2021, TEI.

[26]  Jim Bizzocchi,et al.  Games, narrative and the design of interface , 2011, Int. J. Arts Technol..

[27]  Larissa Hjorth,et al.  TastyBeats: Celebrating Heart Rate Data with a Drinkable Spectacle , 2015, Tangible and Embedded Interaction.

[28]  Danielle Wilde,et al.  Participatory Research through Gastronomy Design: A designerly move towards more playful gastronomy , 2019, International Journal of Food Design.

[29]  Jonas Löwgren,et al.  Annotated portfolios and other forms of intermediate-level knowledge , 2013, INTR.

[30]  Ben A. M. Schouten,et al.  A Breathtaking Journey. On the Design of an Empathy-Arousing Mixed-Reality Game , 2016, CHI PLAY.

[31]  J. G. Tanenbaum,et al.  Shiva's Rangoli: Tangible Storytelling through Diegetic Interfaces in Ambient Environments , 2019, TEI.

[32]  Jim Bizzocchi,et al.  Rock Band: a case study in the design of embodied interface experience , 2009, Sandbox@SIGGRAPH.

[33]  J. G. Tanenbaum,et al.  Evaluating the Pleasures of Agency in Shiva's Rangoli, a Tangible Storytelling Installation , 2019, Conference on Designing Interactive Systems.

[34]  Carlos Velasco,et al.  Digitizing the chemical senses: Possibilities & pitfalls , 2017, Int. J. Hum. Comput. Stud..

[35]  E. S. Campbell,et al.  The Art Institute of Chicago , 2010 .

[36]  Takuji Narumi,et al.  Multi-sensorial virtual reality and augmented human food interaction , 2016, MHFI@ICMI.

[37]  J. Murray Hamlet on the Holodeck , 1997 .

[38]  Hiroshi Ishii,et al.  Tangible viewpoints: a physical approach to multimedia stories , 2002, MULTIMEDIA '02.

[39]  Ali Mazalek,et al.  Towards a Framework for Tangible Narratives , 2016, Tangible and Embedded Interaction.

[40]  Jörn Hurtienne,et al.  Multimodal Effects of Color and Haptics on Intuitive Interaction with Tangible User Interfaces , 2018, TEI.

[41]  Ali Mazalek,et al.  Tangible comics: a performance space with full-body interaction , 2007, ACE '07.

[42]  Hidekazu Tanaka,et al.  Chewing jockey: augmented food texture by using sound based on the cross-modal effect , 2011, SA '11.

[43]  Paul Clifton,et al.  Universal Threshold Object: Designing Haptic Interaction for Televised Interactive Narratives , 2015, Tangible and Embedded Interaction.

[44]  Miguel P Caldas,et al.  Research design: qualitative, quantitative, and mixed methods approaches , 2003 .

[45]  K. Isbister,et al.  Where interaction design meets gastronomy: Crafting increasingly playful and interactive eating experiences , 2020, Experiencing Food, Designing Sustainable and Social Practices.

[46]  Wei Wang,et al.  The Guts Game: Towards Designing Ingestible Games , 2018, CHI PLAY.