Mixed prototyping with configurable physical archetype for usability evaluation of product interfaces

Mixed prototyping (MP) is an emerging approach for usability testing, thanks to its multimodal environment, which is able to involve sight, hearing and touch thus improving the ability to analyze the inter-relationships between the physical form and the behavior of the industrial products. This paper presents a method to perform usability tests in a mixed reality (MR) environment for analyzing human performance in target acquisition tasks while interacting with household appliances. The proposed method is based on the use of different kinds of digital and physical prototypes and, moreover, it introduces an experimental physical archetype for mixed prototyping that contributes to increase the efficiency of the usability evaluation process. Through this archetype the design of a user interface can be easily changed by the adoption of plug-and-play moving components (knobs and buttons) that allow to model in a few seconds any kind of control panel for washing machines, thus reducing the prototyping costs and enlarging the variety of MR interfaces that can be evaluated. The paper proposes also a validation of the use of the physical archetype through a case study in which three different control panel alternatives have been evaluated in a competitive usability study. The competitive testing allows to gather user behaviors with a broad range of design options before the development of a new control panel refined through iterative design. Experimental results show that the proposed method based on the physical archetype can be an effective support to improve the usability of the product interface.

[1]  Gilbert Cockton,et al.  Why and when five test users aren’t enough , 2001 .

[2]  Hidetomo Takahashi,et al.  Touch-sensitive augmented reality system for development of handheld information appliances , 2010 .

[3]  James A. Landay,et al.  Sketching Interfaces: Toward More Human Interface Design , 2001, Computer.

[4]  John Kenneth Salisbury,et al.  Haptic Rendering: Introductory Concepts , 2004, IEEE Computer Graphics and Applications.

[5]  Fischer,et al.  Research in interactive design , 2005 .

[6]  M. Germani,et al.  A method for systematic usability evaluation of interactive product interfaces , 2011 .

[7]  Gavriel Salvendy,et al.  Handbook of Human Factors and Ergonomics , 2005 .

[8]  Jeffrey Rubin,et al.  Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests , 1994 .

[9]  Akihiko Yokoyama,et al.  An Integrated Environment for Testing and Assessing the Usability of Information Appliances Using Digital and Physical Mock-Ups , 2007, HCI.

[10]  Oscar Mauricio Serrano Jaimes,et al.  EVALUACION DE LA USABILIDAD EN SITIOS WEB, BASADA EN EL ESTANDAR ISO 9241-11 (International Standard (1998) Ergonomic requirements For office work with visual display terminals (VDTs)-Parts II: Guidance on usability , 2012 .

[11]  K. Koffka.  Principles Of Gestalt Psychology , 1936 .

[12]  Fabio Bruno,et al.  Mixed Prototyping for Products Usability Evaluation , 2010 .

[13]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[14]  Lars Schmidt,et al.  Comparative evaluation of usability tests , 1999, CHI Extended Abstracts.

[15]  Fabio Bruno,et al.  Product interface design: A participatory approach based on virtual reality , 2010, Int. J. Hum. Comput. Stud..

[16]  Monica Bordegoni.  Product Virtualization: An Effective Method for the Evaluation of Concept Design of New Products , 2011 .

[17]  H.-J. Bullinger,et al.  Human aspects in computing : design and use of interative systems and work with terminals : proceedings of the Fourth International Conference on Human-Computer Interaction, Stuttgart, F.R. Germany, September 1-6, 1991 , 1991 .

[18]  Jae Yeol Lee,et al.  Tangible authoring of 3D virtual scenes in dynamic augmented reality environment , 2011, Comput. Ind..

[19]  A. Shepherd,et al.  Hierarchical Task Analysis and Training Decisions. , 1985 .

[20]  Abe Crystal,et al.  Task analysis and human-computer interaction: approaches, techniques, and levels of analysis , 2004, AMCIS.

[21]  J R Lewis,et al.  Sample Sizes for Usability Studies: Additional Considerations , 1994, Human factors.

[22]  Donald A. Norman,et al.  Design rules based on analyses of human error , 1983, CACM.

[23]  Björn Johansson,et al.  A cognitive systems engineering perspective on the design of mixed reality systems , 2006, ECCE '06.

[24]  Angela M. Cirucci,et al.  Usability Testing , 2021, UX Research Methods for Media and Communication Studies.

[25]  Nikolaos G. Bourbakis,et al.  A survey of skin-color modeling and detection methods , 2007, Pattern Recognit..

[26]  John L. Bennett,et al.  Usability Engineering: Our Experience and Evolution , 1988 .

[27]  Clare-Marie Karat,et al.  Cost-Justifying Usability Engineering in the Software Life Cycle , 1997 .

[28]  Mark R. Lehto,et al.  Evaluation of customer impressions using virtual prototypes in the internet environment , 2011 .

[29]  Jouke Verlinden,et al.  Advanced prototyping for human-centered design for information appliances , 2009 .

[30]  Carolyn Snyder,et al.  Paper Prototyping: The Fast and Easy Way to Design and Refine User Interfaces , 2003 .

[31]  Hyungjun Park,et al.  Immersive modeling system (IMMS) for personal electronic products using a multi-modal interface , 2010, Comput. Aided Des..

[32]  Monica Bordegoni,et al.  Product Design Review Application Based on a Vision-Sound-Haptic Interface , 2010, HAID.

[33]  Shirley Ann Becker,et al.  Web usability: a review of the research , 1999, SGCH.

[34]  Raffaele de Amicis,et al.  Spacedesign: a mixed reality workspace for aesthetic industrial design , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[35]  Joseph S. Dumas,et al.  Expert Reviews: How Many Experts is Enough? , 1995 .

[36]  Jurek Kirakowski,et al.  What is Usability , 1991 .

[37]  Mark W. Newman,et al.  DENIM: finding a tighter fit between tools and practice for Web site design , 2000, CHI.

[38]  Michael J. Wenger,et al.  Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests by Jeffrey Rubin 330 pages, $34.95 New York: John Wiley & Sons, 1994 ISBN 0-471-59403-2 , 1995 .

[39]  Hyungjun Park,et al.  Tangible augmented prototyping of digital handheld products , 2009, Comput. Ind..

[40]  Jakob Nielsen,et al.  Determining Usability Test Sample Size , 2006 .

[41]  Fabio Bruno,et al.  Mixed prototyping environment with different video tracking techniques , 2011 .

[42]  Umberto Cugini,et al.  Mixed prototyping for product assessment: a reference framework , 2009 .

[43]  Cathleen Wharton,et al.  Cognitive Walkthroughs: A Method for Theory-Based Evaluation of User Interfaces , 1992, Int. J. Man Mach. Stud..

[44]  Jürgen Sauer,et al.  The influence of user expertise and prototype fidelity in usability tests. , 2010, Applied ergonomics.

[45]  Christophe Kolski,et al.  State of the Art on the Cognitive Walkthrough Method, Its Variants and Evolutions , 2010, Int. J. Hum. Comput. Interact..

[46]  A. de Smit,et al.  Development of a Flexible Augmented Prototyping System , 2003, WSCG.

[47]  Vladimir Vezhnevets,et al.  A Survey on Pixel-Based Skin Color Detection Techniques , 2003 .

[48]  Xavier Fischer,et al.  Research in Interactive Design: Proceedings of Virtual Concept 2005 , 2006 .

[49]  Fabio Bruno,et al.  Comparing Different Visuo-Haptic Environments for Virtual Prototyping Applications , 2011 .

[50]  T. Landauer,et al.  Handbook of Human-Computer Interaction , 1997 .

[51]  Imre Horváth,et al.  Framework for testing and validating Interactive Augmented Prototyping as a Design Means in Industrial Practice , 2006 .

[52]  Robert A. Virzi,et al.  Refining the Test Phase of Usability Evaluation: How Many Subjects Is Enough? , 1992 .

[53]  Joseph F. Dumas,et al.  A Practical Guide to Usability Testing , 1993 .

[54]  Abdesselam Bouzerdoum,et al.  Skin segmentation using color pixel classification: analysis and comparison , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[55]  Fabio Bruno,et al.  Product Behaviour Simulation in Mixed Reality , 2010 .

[56]  R Likert,et al.  A TECHNIQUE FOR THE MEASUREMENT OF ATTITUDE SCALES , 1932 .