Mixed prototypes for the evaluation of usability and user experience: simulating an interactive electronic device

Mixed prototyping technology can be used to represent and simulate the behavior of interactive products at low cost and with great flexibility. This preliminary experimental research intends to verify the suitability of using this technology in the evaluation of usability and user experience of interactive products. Users and experts evaluate the mixed prototype of an image projector with regard to its own usability, and also with respect to its ability to be used to evaluate usability and user experience aspects of the real projector. Users perform tasks on both the real projector and its mixed prototype. In regard to these comparative performance evaluations, time to perform the task and number of errors show a clear positive relationship with the difficulty of the task for both mixed prototype and real projector. In regard to more subjective UX evaluations, the results show to be congruent. However, we realize that emotions assigned to the mixed prototype are influenced by the “fascination” that augmented reality arises in individuals. Experts evaluate the mixed prototype with respect to aspects of the interaction with the product that it is able to simulate, and with respect to the classes of products best suited to be prototyped. They highlighted the possibility of using the technology to evaluate product performance, ergonomics, and operation. In regard to the classes of products to be prototyped, experts’ suggestions coincided with the classes of products that have already been used in research: household appliances, information and communication devices, and automotive parts and accessories.

[1]  P. Desmet,et al.  Introducing PrEmo2 : New directions for the non-verbal measurement of emotion in design , 2012 .

[2]  Wookho Son,et al.  Design Evaluation System with Visualization and Interaction of Mobile Devices Based on Virtual Reality Prototypes , 2008 .

[3]  Hyungjun Park,et al.  Design evaluation of information appliances using augmented reality-based tangible interaction , 2013, Comput. Ind..

[4]  Debora Shaw,et al.  Handbook of usability testing: How to plan, design, and conduct effective tests , 1996 .

[5]  Hidetomo Takahashi,et al.  Touch-sensitive augmented reality system for development of handheld information appliances , 2010 .

[6]  Stefano Mottura,et al.  Virtual reality as a support tool in the shoe life cycle , 2004, Int. J. Comput. Integr. Manuf..

[7]  Fabio Bruno,et al.  Mixed prototyping with configurable physical archetype for usability evaluation of product interfaces , 2013, Comput. Ind..

[8]  Pieter Desmet,et al.  Measuring Emotion: Development and Application of an Instrument to Measure Emotional Responses to Products , 2005, Funology.

[9]  Jeffrey Rubin,et al.  Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests , 1994 .

[10]  Patrick Jordan The Personalities of Products , 2002 .

[11]  Russ Unger,et al.  A Project Guide to UX Design: For User Experience Designers in the Field or in the Making , 2009 .

[12]  A. de Smit,et al.  Development of a Flexible Augmented Prototyping System , 2003, WSCG.

[13]  Philip T. Kortum,et al.  Determining what individual SUS scores mean: adding an adjective rating scale , 2009 .

[14]  Marcelo Gitirana Gomes Ferreira,et al.  Use of augmented reality in the usability evaluation of products. , 2012, Work.

[15]  Fabio Bruno,et al.  Reliable behaviour simulation of product interface in mixed reality , 2012, Engineering with Computers.

[16]  Monica Bordegoni,et al.  Geodesic Spline Interface for Haptic Curve Rendering , 2011, IEEE Transactions on Haptics.

[17]  Tek-Jin Nam,et al.  Recording augmented reality experiences to capture design reviews , 2009 .

[18]  Hyungjun Park,et al.  Tangible AR interaction based on fingertip touch using small-sized nonsquare markers , 2014, J. Comput. Des. Eng..

[19]  Pieter Desmet Measuring Emotion: Development and Application of an Instrument to Measure Emotional Responses to Products , 2018, Funology, 2nd ed..

[20]  A. Noorul Haq,et al.  Analysis of enablers for the implementation of leagile supply chain management using an integrated fuzzy QFD approach , 2017, J. Intell. Manuf..

[21]  Tom Tullis,et al.  Measuring the User Experience, Second Edition: Collecting, Analyzing, and Presenting Usability Metrics , 2013 .

[22]  Hyungjun Park,et al.  Immersive modeling system (IMMS) for personal electronic products using a multi-modal interface , 2010, Comput. Aided Des..

[23]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[24]  Young Mi Choi Utilizing end User Input in Early Product Development , 2015 .

[25]  Hirokazu Kato,et al.  Augmented prototyping of 3D rigid curved surfaces , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[26]  Monica Bordegoni,et al.  Prototyping strategies for multisensory product experience engineering , 2015, Journal of Intelligent Manufacturing.

[27]  Hyungjun Park,et al.  Design evaluation of digital consumer products using virtual reality-based functional behaviour simulation , 2008 .

[28]  Imre Horváth,et al.  Analyzing opportunities for using interactive augmented prototyping in design practice , 2009, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[29]  Umberto Cugini,et al.  Mixed prototyping for product assessment: a reference framework , 2009 .

[30]  Holger Regenbrecht,et al.  MagicMeeting: A Collaborative Tangible Augmented Reality System , 2002, Virtual Reality.

[31]  Imre Horváth,et al.  TREATISE OF TECHNOLOGIES FOR INTERACTIVE AUGMENTED PROTOTYPING , 2006 .

[32]  Hideki Aoyama,et al.  Mixed reality system for evaluating designability and operability of information appliances , 2009 .

[33]  Hyungjun Park,et al.  Tangible augmented prototyping of digital handheld products , 2009, Comput. Ind..

[34]  Hyungjun Park,et al.  Note on Tangible Interaction Using Paper Models for AR-Based Design Evaluation , 2013 .

[35]  Jaromír Landa,et al.  Usage of Microsoft Kinect for augmented prototyping speed-up , 2012 .

[36]  Monica Bordegoni,et al.  Mixed reality distributed platform for collaborative design review of automotive interiors , 2012 .

[37]  Imre Horváth,et al.  The enablers for interactive augmented prototyping , 2010 .

[38]  Imre Horváth,et al.  Enabling Interactive Augmented Prototyping by a Portable Hardware and a Plug-In-Based Software Architecture , 2008 .

[39]  Rajit Gadh,et al.  Virtual and Augmented Reality Technologies for Product Realization , 1999 .

[40]  Jae Yeol Lee,et al.  AR/RP-based tangible interactions for collaborative design evaluation of digital products , 2009 .

[41]  Kwan H. Lee,et al.  Spatial augmented reality for product appearance design evaluation , 2015, J. Comput. Des. Eng..

[42]  Monica Bordegoni,et al.  A Method for Designing Users’ Experience with Industrial Products based on a Multimodal Environment and Mixed Prototypes , 2013 .