Characterizing Usability Inspection Methods through the Analysis of a Systematic Mapping Study Extension

Usability is one of the most relevant quality aspects in Web applications. A Web application is usable if it provides a friendly, direct and easy to understand interface. Many Usability Inspection Methods (UIMs) have been proposed as a cost effective way to enhance usability. However, many companies are not aware of these UIMs and consequently, are not using them. A secondary study can identify, evaluate and interpret all data that is relevant to the current knowledge available regarding UIMs that have been used to evaluate Web applications in the past few decades. Therefore, we have extended a systematic mapping study about Usability Evaluation Methods by analyzing 26 of its research papers from which we extracted and categorized UIMs. We provide practitioners and researches with the rationale to understand both the strengths and weaknesses of the emerging UIMs for the Web. Furthermore, we have summarized the relevant information of the UIMs, which suggested new ideas or theoretical basis regarding usability inspection in the Web domain. In addition, we present a new UIM and a tool for Web usability inspection starting from the results shown in this paper.

[1]  Carmelo Ardito,et al.  A tool to support usability inspection , 2006, AVI '06.

[2]  Jacqueline Brodie,et al.  Applying user testing data to UEM performance metrics , 2004, CHI EA '04.

[3]  Jakob Nielsen,et al.  Heuristic Evaluation of Prototypes (individual) , 2022 .

[4]  Vicente Moret-Bonillo,et al.  An HTML analyzer for the study of web usability , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[5]  K. G. Jöreskog,et al.  A GENERAL METHOD FOR ANALYSIS OF COVARIANCE STRUCTURES WITH APPLICATIONS: PART I: GENERAL METHODOLOGY* , 1969 .

[6]  Fabio Paternò,et al.  Automatic reconstruction of the underlying interaction design of web applications , 2002, SEKE '02.

[7]  Guilherme Horta Travassos,et al.  Web usability inspection technique based on design perspectives , 2007, IET Softw..

[8]  Selim Zaim,et al.  UWIS: An assessment methodology for usability of web-based information systems , 2009, J. Syst. Softw..

[9]  Vicente Pelechano,et al.  Applying the Oows Model-Driven Approach for Developing Web Applications. The Internet Movie Database Case Study , 2008, Web Engineering.

[10]  Ergonomic requirements for office work with visual display terminals ( VDTs ) — Part 11 : Guidance on usability , 1998 .

[11]  Emilio Insfrán,et al.  A Systematic Review of Usability Evaluation in Web Development , 2008, WISE Workshops.

[12]  Ben Shneiderman,et al.  Perspective-based Usability Inspection: An Empirical Validation of Efficacy , 1999, Empirical Software Engineering.

[13]  Vimla L. Patel,et al.  Heuristic evaluation of paper-based Web pages: A simplified inspection usability methodology , 2006, J. Biomed. Informatics.

[14]  Piero Fraternali,et al.  Identifying Cultural Markers for Web Application Design Targeted to a Multi-cultural Audience , 2008, 2008 Eighth International Conference on Web Engineering.

[15]  B. Shneiderman Designing the User Interface (3rd Ed.) , 1998 .

[16]  Lucia Vilela Leite Filgueiras,et al.  Recoverability Walkthrough: An Alternative to Evaluate Digital Inclusion Interfaces , 2009, 2009 Latin American Web Congress.

[17]  Gustavo Rossi,et al.  Web Engineering , 2001, Lecture Notes in Computer Science.

[18]  Mario Piattini,et al.  Ontology driven definition of a usability model for second generation portals , 2006, ICWE '06.

[19]  Giovanni Toffetti Carughi,et al.  Web Usability: Principles and Evaluation Methods , 2006, Web Engineering.

[20]  Gustavo Rossi,et al.  Web Quality , 2006, Web Engineering.

[21]  Paolo Paolini Hypermedia, the Web and Usability issues , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[22]  Marilyn Hughes Blackmon,et al.  Cognitive walkthrough for the web , 2002, CHI.

[23]  Oreste Signore,et al.  A comprehensive model for Web sites quality , 2005, Seventh IEEE International Symposium on Web Site Evolution.

[24]  C. Burton,et al.  Will World Wide Web user interfaces be usable? , 1998, Proceedings 1998 Australasian Computer Human Interaction Conference. OzCHI'98 (Cat. No.98EX234).

[25]  Franca Garzotto,et al.  SUE inspection: an effective method for systematic usability evaluation of hypermedia , 2002, IEEE Trans. Syst. Man Cybern. Part A.

[26]  Shazeeye Kirmani Heuristic evaluation quality score (HEQS): defining heuristic expertise , 2008 .

[27]  Daniel Cunliffe,et al.  Developing usable Web sites - a review and model , 2000, Internet Res..

[28]  T. Landauer,et al.  A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. , 1997 .

[29]  Amit Basu,et al.  Context-driven assessment of commercial Web sites , 2003, 36th Annual Hawaii International Conference on System Sciences, 2003. Proceedings of the.

[30]  Silvia Mara Abrahão,et al.  Usability evaluation methods for the web: A systematic mapping study , 2011, Inf. Softw. Technol..

[31]  Juan Manuel Cueva Lovelle,et al.  Comparison of Methods and Existing Tools for the Measurement of Usability in the Web , 2003, ICWE.

[32]  Marilyn Hughes Blackmon,et al.  Repairing usability problems identified by the cognitive walkthrough for the web , 2003, CHI '03.

[33]  Cathleen Wharton,et al.  Cognitive Walkthroughs: A Method for Theory-Based Evaluation of User Interfaces , 1992, Int. J. Man Mach. Stud..

[34]  Roger S. Pressman,et al.  Web Engineering , 2001, Lecture Notes in Computer Science.

[35]  Franca Garzotto,et al.  HDM—a model-based approach to hypertext application design , 1993, TOIS.

[36]  Jean Vanderdonckt,et al.  Automated Evaluation of Web Usability and Accessibility by Guideline Review , 2004, ICWE.

[37]  Jakob Nielsen,et al.  Finding usability problems through heuristic evaluation , 1992, CHI.

[38]  A. Jefferson Offutt,et al.  Quality Attributes of Web Software Applications , 2002, IEEE Softw..

[39]  Davide Bolchini,et al.  Evaluating Web usability with MiLE+ , 2005, Seventh IEEE International Symposium on Web Site Evolution.

[40]  Muneo Kitajima,et al.  Comparison of eye movements in searching for easy-to-find and hard-to-find information in a hierarchically organized information structure , 2008, ETRA '08.

[41]  Edward Cutrell,et al.  What are you looking for?: an eye-tracking study of information usage in web search , 2007, CHI.

[42]  Ben Shneiderman,et al.  Designing The User Interface , 2013 .

[43]  Marilyn Hughes Blackmon,et al.  Tool for accurately predicting website navigation problems, non-problems, problem severity, and effectiveness of repairs , 2005, CHI.

[44]  José Ambrosio Toval Álvarez,et al.  Integrating usability requirements that can be evaluated in design time into Model Driven Engineering of Web Information Systems , 2009, Adv. Eng. Softw..

[45]  Elizabeth A. Kemp,et al.  Web 2.0: extending the framework for heuristic evaluation , 2009, CHINZ '09.

[46]  Franca Garzotto,et al.  Quality of Web Usability Evaluation Methods: An Empirical Study on MiLE+ , 2007, WISE Workshops.

[47]  Tayana Conte,et al.  Using the Results from a Systematic Mapping Extension to Define a Usability Inspection Method for Web Applications , 2012, SEKE.

[48]  Albrecht Schmidt,et al.  Adding Usability to Web Engineering Models and Tools , 2005, ICWE.

[49]  Marilyn Hughes Blackmon,et al.  A Comprehension-based Model of Web Navigation and Its Application to Web Usability Analysis , 2000, BCS HCI.

[50]  Martin R. Gibbs,et al.  Mediating intimacy: designing technologies to support strong-tie relationships , 2005, CHI.

[51]  Emilia Mendes,et al.  The Need for Web Engineering: An Introduction , 2006, Web Engineering.

[52]  Maria Francesca Costabile,et al.  Guidelines for Hypermedia Usability Inspection , 2001, IEEE Multim..

[53]  Tayana Conte,et al.  Using an Empirical Study to Evaluate the Feasibility of a New Usability Inspection Technique for Paper Based Prototypes of Web Applications , 2012, SBES.