The usability analysis with heuristic evaluation and analytic hierarchy process

Abstract Today people increasingly expect more from the functionality of a web site, so the web usability has emerged as an important topic. It is generally hard to renew the existing web sites to meet the changing demands of users. Therefore, the present study is aimed at detailing the usability problems of web sites. To this end, Heuristic Evaluation (HE) is used to identify the usability problems, and Analytic Hierarchy Process (AHP) is used to rate their severity. Finally, for a more user-friendly web site, a new approach to judging severity of usability problems is developed by integrating AHP into HE. Relevance to industry There is an increasing importance for higher usability in the web development industry and communities. Different usability evaluation techniques have been developed and incorporated into the process of web site design and development. This study proposes a new approach to reveal usability problems on a web site and to define solution priority of these problems.

[1]  Jakob Nielsen,et al.  Finding usability problems through heuristic evaluation , 1992, CHI.

[2]  Jakob Nielsen,et al.  Usability inspection methods , 1994, CHI 95 Conference Companion.

[3]  Ben Shneiderman,et al.  Designing The User Interface , 2013 .

[4]  Ramaratnam R Bishu,et al.  Web evaluation: heuristic evaluation vs. user testing. , 2009 .

[5]  Holley Long,et al.  The flight plan of a digital initiatives project, part 2: Usability testing in the context of user-centered design , 2005, OCLC Syst. Serv..

[6]  Terttu Kortelainen,et al.  Heuristic evaluation applied to library web services , 2008 .

[7]  Chen Ling.  Advances in heuristic usability evaluation method , 2005 .

[8]  T. Saaty,et al.  The Analytic Hierarchy Process , 1985 .

[9]  Shih-Wen Hsiao,et al.  Concurrent design method for developing a new product , 2002 .

[10]  Ruth Dickstein,et al.  Usability testing at the University of Arizona library : How to let the users in on the design , 2000 .

[11]  Erik Liljegren,et al.  Usability in a medical technology context assessment of methods for usability evaluation of medical equipment , 2006 .

[12]  Jan Bosch,et al.  Architecting for usability: a survey , 2004, J. Syst. Softw..

[13]  Jakob Nielsen,et al.  Traditional dialogue design applied to modern user interfaces , 1990, CACM.

[14]  Jakob Nielsen,et al.  Enhancing the explanatory power of usability heuristics , 1994, CHI '94.

[15]  Colin Potts,et al.  Design of Everyday Things , 1988 .

[16]  Sushil Kumar,et al.  Analytic hierarchy process: An overview of applications , 2006, Eur. J. Oper. Res..

[17]  Serkan Yavuz,et al.  Weapon selection using the AHP and TOPSIS methods under fuzzy environment , 2009, Expert Syst. Appl..

[18]  Metin Dagdeviren,et al.  Using the analytic network process (ANP) in a SWOT analysis - A case study for a textile firm , 2007, Inf. Sci..

[19]  Thomas L. Saaty,et al.  Decision making with dependence and feedback : the analytic network process : the organization and prioritization of complexity , 1996 .

[20]  H Kanis,et al.  Usage centred research for everyday product design. , 1998, Applied ergonomics.

[21]  Jakob Nielsen,et al.  Heuristic evaluation of user interfaces , 1990, CHI '90.

[22]  Beom Suk Jin,et al.  Development of AHP Model for Telematics Haptic Interface Evaluation , 2007, HCI.

[23]  Jun Liu,et al.  An integrated AHP-DEA methodology for bridge risk assessment , 2008, Comput. Ind. Eng..

[24]  Gülçin Büyüközkan,et al.  Using a multi-criteria decision making approach to evaluate mobile phone alternatives , 2007, Comput. Stand. Interfaces.

[25]  Catherine Ebenezer.  Usability evaluation of an NHS library website. , 2003, Health information and libraries journal.

[26]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[27]  Ming-Chyuan Lin,et al.  Using HCA and TOPSIS approaches in personal digital assistant menu-icon interface design. , 2009 .

[28]  D. A. Mitta,et al.  An Application of the Analytic Hierarchy Process: A Rank-Ordering of Computer Interfaces , 1993 .

[29]  Kyung S. Park,et al.  A STRUCTURED METHODOLOGY FOR COMPARATIVE EVALUATION OF USER INTERFACE DESIGNS USING USABILITY CRITERIA AND MEASURES , 1999 .

[30]  William Ho,et al.  Integrated analytic hierarchy process and its applications - A literature review , 2008, Eur. J. Oper. Res..

[31]  Jakob Nielsen,et al.  Improving a human-computer dialogue , 1990, CACM.

[32]  Ebba Þóra Hvannberg,et al.  Heuristic evaluation: Comparing ways of finding and reporting usability problems , 2007, Interact. Comput..