Heuristic Evaluation on Mobile Interfaces: A New Checklist

The rapid evolution and adoption of mobile devices raise new usability challenges, given their limitations (in screen size, battery life, etc.) as well as the specific requirements of this new interaction. Traditional evaluation techniques need to be adapted in order for these requirements to be met. Heuristic evaluation (HE), an Inspection Method based on evaluation conducted by experts over a real system or prototype, is based on checklists which are desktop-centred and do not adequately detect mobile-specific usability issues. In this paper, we propose a compilation of heuristic evaluation checklists taken from the existing bibliography but readapted to new mobile interfaces. Selecting and rearranging these heuristic guidelines offer a tool which works well not just for evaluation but also as a best-practices checklist. The result is a comprehensive checklist which is experimentally evaluated as a design tool. This experimental evaluation involved two software engineers without any specific knowledge about usability, a group of ten users who compared the usability of a first prototype designed without our heuristics, and a second one after applying the proposed checklist. The results of this experiment show the usefulness of the proposed checklist for avoiding usability gaps even with nontrained developers.

[1]  Jack Duffy,et al.  Web Page Transformation When Switching Devices , 2004, Mobile HCI.

[2]  Abigail Sellen,et al.  How knowledge workers use the web , 2002, CHI.

[3]  Roger Frost,et al.  International Organization for Standardization (ISO) , 2004 .

[4]  Jakob Nielsen,et al.  Guerrilla HCI: using discount usability engineering to penetrate the intimidation barrier , 1994 .

[5]  Sylvain Sénécal,et al.  Measuring Perceived Website Usability , 2007 .

[6]  Yusef Hassan Montero,et al.  Guía de Evaluación Heurística de Sitios Web , 2003 .

[7]  Jakob Nielsen,et al.  Heuristic evaluation of user interfaces , 1990, CHI '90.

[8]  Henry Been-Lirn Duh,et al.  Usability evaluation for mobile device: a comparison of laboratory and field tests , 2006, Mobile HCI.

[9]  John Karat,et al.  User-Centered Software Evaluation Methodologies , 1997 .

[10]  Murray Turoff,et al.  The Delphi Method: Techniques and Applications , 1976 .

[11]  Gustavo Rossi,et al.  Specifying Quality Characteristics and Attributes for Websites , 2001, Web Engineering.

[12]  Clare-Marie Karat,et al.  Comparison of empirical testing and walkthrough methods in user interface evaluation , 1992, CHI.

[13]  Stephen Kimani,et al.  Appropriating and assessing heuristics for mobile computing , 2006, AVI '06.

[14]  Heuristic Evaluation-A System Checklist , 2014 .

[15]  Michael A. Shepherd,et al.  A Goal-based Classification of Web Information Tasks , 2006, ASIST.

[16]  James E. Pitkow,et al.  Characterizing Browsing Strategies in the World-Wide Web , 1995, Comput. Networks ISDN Syst..

[17]  Mark A. Neerincx,et al.  Usability engineering for mobile maps , 2007, Mobility '07.

[18]  Stuart K. Card,et al.  A taxonomic analysis of what world wide web activities significantly impact people's decisions and actions , 2001, CHI Extended Abstracts.

[19]  Steve Howard,et al.  Heuristic Evaluation and Mobile Usability: Bridging the Realism Gap , 2004, Mobile HCI.

[20]  Ergonomic requirements for office work with visual display terminals ( VDTs ) — Part 11 : Guidance on usability , 1998 .

[21]  Jakob Nielsen,et al.  Heuristic Evaluation of Prototypes (individual) , 2022 .

[22]  Jakob Nielsen,et al.  Severity Ratings for Usability Problems , 2006 .

[23]  Marti A. Hearst,et al.  The state of the art in automating usability evaluation of user interfaces , 2001, CSUR.

[24]  Dongsong Zhang,et al.  Challenges, Methodologies, and Issues in the Usability Testing of Mobile Applications , 2005, Int. J. Hum. Comput. Interact..

[25]  Jeongyun Heo,et al.  A framework for evaluating the usability of mobile phones based on multi-level, hierarchical model of usability factors , 2009, Interact. Comput..

[26]  Niels Ole Bernsen,et al.  WIZARD OF OZ PROTOTYPING : WHEN AND HOW ? , 1993 .

[27]  Virginica Rusu,et al.  A Methodology to Establish Usability Heuristics , 2011, ACHI 2011.

[28]  Chun Wei Choo,et al.  A behavioral model of information seeking on the web: preliminary results of a study of how managers and IT specialists use the web , 1998 .

[29]  Harry Hochheiser,et al.  Research Methods for Human-Computer Interaction , 2008 .

[30]  Virginica Rusu,et al.  Usability Heuristics for Touchscreen-based Mobile Devices , 2012, 2012 Ninth International Conference on Information Technology - New Generations.

[31]  F. Fernández,et al.  Diseño Web Centrado en el Usuario: Usabilidad y Arquitectura de la Información , 2004 .

[32]  Keith Instone.  Usability engineering for the Web , 1997, World Wide Web J..

[33]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[34]  Mark D. Dunlop,et al.  The Challenge of Mobile Devices for Human Computer Interaction , 2002, Personal and Ubiquitous Computing.

[35]  Virpi Roto,et al.  How people use the web on mobile devices , 2008, WWW.

[36]  George M. Giaglis,et al.  An Empirical Assessment of Environmental Factors that Influence the Usability of a Mobile Website , 2010, 2010 Ninth International Conference on Mobile Business and 2010 Ninth Global Mobility Roundtable (ICMB-GMR).

[37]  Viswanath Venkatesh,et al.  Assessing a Firm's Web Presence: A Heuristic Evaluation Procedure for the Measurement of Usability , 2002, Inf. Syst. Res..

[38]  A. Adam.  Whatever happened to information systems ethics? Caught between the devil and the deep blue sea , 2004 .