The Chicken and the Pig: User Involvement in Developing Usability Heuristics

Traditionally, users have not been involved in certain usability engineering methods, although they arguably are the most important stakeholders. This paper explores the possibility of involving users in developing a set of usability heuristics for a specific type of application, an activity they are not usually involved in. Using a qualitative approach based on interviews, a focus group, and an online survey, usability experts and software users evaluated existing sets of heuristics in terms of their applicability to a specific type of application and developed new heuristics to supplement them. The results indicate that the users provide a valuable contribution to the adaptation of existing heuristics to a specific type of application. Users add a new perspective and can address problem areas that usability experts, especially those with little or no experience with the specific application area, would not have identified.

[1]  Jakob Nielsen,et al.  Finding usability problems through heuristic evaluation , 1992, CHI.

[2]  Ephraim R. McLean,et al.  Information Systems Success: The Quest for the Independent Variables , 1992, J. Manag. Inf. Syst..

[3]  Virginica Rusu,et al.  A Methodology to Establish Usability Heuristics , 2011, ACHI 2011.

[4]  Jakob Nielsen,et al.  Improving a human-computer dialogue , 1990, CACM.

[5]  Ray McKenzie The Relationship Based Enterprise , 2001 .

[6]  Shailey Minocha,et al.  Usability beyond the website: An empirically-grounded e-commerce evaluation instrument for the total customer experience , 2006, Behav. Inf. Technol..

[7]  Kenton O'Hara,et al.  Social Impact , 2019, Encyclopedia of Food and Agricultural Ethics.

[8]  Dale Goodhue,et al.  Understanding user evaluations of information systems , 1995 .

[9]  Ephraim R. McLean,et al.  The DeLone and McLean Model of Information Systems Success: A Ten-Year Update , 2003, J. Manag. Inf. Syst..

[10]  Jiajie Zhang,et al.  TURF: Toward a unified framework of EHR usability , 2011, J. Biomed. Informatics.

[11]  Asil Oztekin,et al.  UseLearn: A novel checklist and usability evaluation method for eLearning systems by criticality metric analysis , 2010 .

[12]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[13]  Teresa Roselli,et al.  An approach to usability evaluation of e-learning applications , 2006, Universal Access in the Information Society.

[14]  Gary Perlman Practical usability evaluation , 1994, CHI '94.

[15]  Stanley A. Brown Customer Relationship Management: A Strategic Imperative in the World of e-Business , 1999 .

[16]  Ray McKenzie Relationship-based enterprise : powering business success through customer relationship management , 2001 .

[17]  Colin Potts,et al.  Design of Everyday Things , 1988 .

[18]  Akash Singh,et al.  Evaluation criteria for assessing the usability of ERP systems , 2009, SAICSIT '09.

[19]  Gary Perlman Practical usability evaluation , 1995, CHI 95 Conference Companion.

[20]  Elaine Weiss Making Computers People-Literate , 1994 .

[21]  Heuristic Evaluation-A System Checklist , 2014 .