Prototyping strategies for multisensory product experience engineering

The paper deals with prototyping strategies aimed at supporting engineers in the design of the multisensory experience of products. It is widely recognised that the most effective strategy to design it is to create working prototypes and analyse user’s reactions when interacting with them. Starting from this consciousness, we will discuss of how virtual reality (VR) technologies can support engineers to build prototypes suitable to this aim. Furthermore we will demonstrate how VR-based prototypes do not only represent a valid alternative to physical prototypes, but also a step forward thanks to the possibility of simulating and rendering multisensory and real-time modifiable interactions between the user and the prototype. These characteristics of VR-based prototypes enable engineers to rapidly test with users different variants and to optimise the multisensory experience perceived by them during the interaction. The discussion is supported both by examples available in literature and by case studies we have developed over the years on this topic. Specifically, in our research we have concentrated on what happens in the physical contact between the user and the product. Such contact strongly influences the user’s impression about the product.

[1]  Ruth Mugge,et al.  Newer is better! The influence of a novel appearance on the perceived performance quality of products , 2012 .

[2]  E. Ozcan Vieira,et al.  Product Sound Design: Intentional and Consequential Sounds , 2013 .

[3]  B. Joseph Pine,et al.  The Experience Economy , 2020, Journal of Orthopaedic Experience & Innovation.

[4]  Davide Rocchesso,et al.  Interactive Simulation of rigid body interaction with friction-induced sound generation , 2005, IEEE Transactions on Speech and Audio Processing.

[5]  Umberto Cugini,et al.  Mixed prototyping for product assessment: a reference framework , 2009 .

[6]  Masahiko Inami,et al.  The SmartTool: a system for augmented reality of haptics , 2002, Proceedings IEEE Virtual Reality 2002.

[7]  Jane Fulton Suri,et al.  Experience prototyping , 2000, DIS '00.

[8]  Martin Buss,et al.  Development and Evaluation of a Device for the Haptic Rendering of Rotatory Car Doors , 2011, IEEE Transactions on Industrial Electronics.

[9]  Andy Farnell,et al.  Designing Sound , 2008 .

[10]  M. Hassenzahl,et al.  Designing Moments of Meaning and Pleasure. Experience Design and Happiness , 2013 .

[11]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[12]  Takuji Narumi,et al.  Augmented reality flavors: gustatory display based on edible marker and cross-modal interaction , 2011, CHI.

[13]  Roberta L. Klatzky,et al.  Please Touch: Object Properties that Invite Touch , 2012, IEEE Transactions on Haptics.

[14]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[15]  In Lee,et al.  Haptic simulation of refrigerator door , 2012, 2012 IEEE Haptics Symposium (HAPTICS).

[16]  D. W. F. van Krevelen,et al.  A Survey of Augmented Reality Technologies, Applications and Limitations , 2010, Int. J. Virtual Real..

[17]  Monica Bordegoni,et al.  A method for capturing and translating qualitative user experience into design specifications: the haptic feedback of appliance interfaces , 2013 .

[18]  Monica Bordegoni,et al.  Designing interaction with consumer products in a multisensory virtual reality environment , 2013 .

[19]  Benjamin B. Bederson,et al.  Audio augmented reality: a prototype automated tour guide , 1995, CHI 95 Conference Companion.

[20]  Davide Rocchesso,et al.  Sonic Interaction Design , 2013, Int. J. Hum. Comput. Stud..

[21]  Monica Bordegoni,et al.  Use of interactive Virtual Prototypes to define product design specifications: A pilot study on consumer products , 2011, 2011 IEEE International Symposium on VR Innovation.

[22]  Monica Bordegoni,et al.  A Method for Designing Users’ Experience with Industrial Products based on a Multimodal Environment and Mixed Prototypes , 2013 .

[23]  Oliver Bimber,et al.  Displays: Fundamentals and Applications , 2011 .

[24]  M. Morrin,et al.  Product Scent and Memory , 2010 .

[25]  Philippe Coiffet,et al.  Virtual Reality Technology , 2003, Presence: Teleoperators & Virtual Environments.

[26]  C. Spence,et al.  Auditory contributions to multisensory product perception , 2006 .

[27]  Monica Bordegoni,et al.  Reverse engineering of interactive mechanical interfaces for product experience design , 2014 .

[28]  Caterina Rizzi,et al.  Innovation in product design: from CAD to virtual prototyping , 2011 .

[29]  Monica Bordegoni Product Virtualization: An Effective Method for the Evaluation of Concept Design of New Products , 2011 .

[30]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[31]  M. Grunwald Human haptic perception : basics and applications , 2008 .

[32]  Marc Hassenzahl,et al.  MARC HASSENZAHL CHAPTER 3 The Thing and I: Understanding the Relationship Between User and Product , 2003 .

[33]  Jodi Forlizzi,et al.  Understanding experience in interactive systems , 2004, DIS '04.

[34]  Mark Lehto,et al.  A review of: “Virtual Reality Technology” Grigore Burdea and Philippe Coiffet John Wiley & Sons, Inc., 1994 , 1996 .

[35]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[36]  Hiroshi Ishii,et al.  Sublimate: state-changing virtual and physical rendering to augment interaction with shape displays , 2013, CHI.

[37]  Stig Ottosson,et al.  Virtual reality in the product development process , 2002 .

[38]  C. Spence,et al.  Multisensory design: Reaching out to touch the consumer , 2011 .

[39]  F Zorriassatine,et al.  A survey of virtual prototyping techniques for mechanical product development , 2003 .

[40]  Charles Spence,et al.  Multisensory Presence in Virtual Reality: Possibilities & Limitations. , 2011 .

[41]  Monica Bordegoni,et al.  Product Design Review Application Based on a Vision-Sound-Haptic Interface , 2010, HAID.

[42]  Monica Bordegoni,et al.  Optimization of the Force Feedback of a Dishwasher Door Putting the Human in the Design Loop , 2013 .

[43]  T. Love,et al.  Path-dependent Foundation of Global Design-driven Outdoor Trade in the Northwest of England , 2007 .

[44]  Charles Spence,et al.  In Touch with the Future , 2015, ITS.

[45]  Alan Lipschultz,et al.  Virtual Reality Technology, 2nd edition , 2004 .

[46]  Ron Frederick,et al.  Audio aura: light-weight audio augmented reality , 1997, UIST '97.

[47]  Marc Hassenzahl,et al.  User experience - a research agenda , 2006, Behav. Inf. Technol..

[48]  D. Norman Emotional design : why we love (or hate) everyday things , 2004 .

[49]  P. Desmet,et al.  Framework of product experience , 2007 .

[50]  Charles Spence,et al.  Store Atmospherics: A Multisensory Perspective , 2014 .

[51]  G. Gary Wang,et al.  Definition and Review of Virtual Prototyping , 2002, J. Comput. Inf. Sci. Eng..

[52]  Takamichi Nakamoto,et al.  Human Olfactory Displays and Interfaces: Odor Sensing and Presentation , 2012 .

[53]  Vincent Hayward,et al.  Haptic interfaces and devices , 2004 .

[54]  Chee Kai Chua,et al.  Rapid Prototyping:Principles and Applications , 2010 .

[55]  Seokhee Jeon,et al.  Haptic Augmented Reality: Taxonomy and an Example of Stiffness Modulation , 2009, PRESENCE: Teleoperators and Virtual Environments.

[56]  Umberto Cugini,et al.  Interactive Virtual Prototypes for Testing the Interaction with new Products , 2013 .