Usability Inspection in Model-Driven Web Development: Empirical Validation in WebML

There is a lack of empirically validated usability evaluation methods that can be applied to models in model-driven Web development. Evaluation of these models allows an early detection of usability problems perceived by the end-user. This motivated us to propose WUEP, a usability inspection method which can be integrated into different model-driven Web development processes. We previously demonstrated how WUEP can effectively be used when following the Object-Oriented Hypermedia method. In order to provide evidences about WUEP's generalizability, this paper presents the operationalization and empirical validation of WUEP into another well-known method: WebML. The effectiveness, efficiency, perceived ease of use, and satisfaction of WUEP were evaluated in comparison to Heuristic Evaluation HE from the viewpoint of novice inspectors. The results show that WUEP was more effective and efficient than HE when detecting usability problems on models. Also, inspectors were satisfied when applying WUEP, and found it easier to use than HE.

[1]  Natalia Juristo Juzgado,et al.  Basics of Software Engineering Experimentation , 2010, Springer US.

[2]  Albrecht Schmidt,et al.  Adding Usability to Web Engineering Models and Tools , 2005, ICWE.

[3]  San Murugesan.  Web engineering , 1999, LINK.

[4]  Giovanni Toffetti Carughi,et al.  Architectural Issues and Solutions in the Development of Data-Intensive Web Applications , 2003, CIDR.

[5]  Piero Fraternali,et al.  WQA: an XSL framework for analyzing the quality of Web applications , 2002 .

[6]  C. M. Neuwirth,et al.  Guest Editor's Introduction - usability and the web , 2002 .

[7]  Silvia Mara Abrahão,et al.  Further analysis on the validation of a usability inspection method for model-driven web development , 2012, Proceedings of the 2012 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement.

[8]  Natalia Juristo Juzgado,et al.  Guidelines for Eliciting Usability Functionalities , 2007, IEEE Transactions on Software Engineering.

[9]  Jakob Nielsen,et al.  Heuristic Evaluation of Prototypes (individual) , 2022 .

[10]  A. Jefferson Offutt,et al.  Quality Attributes of Web Software Applications , 2002, IEEE Softw..

[11]  Ricardo Valerdi.  Cognitive Limits of Software Cost Estimation , 2007, ESEM 2007.

[12]  Silvia Mara Abrahão,et al.  A Web Usability Evaluation Process for Model-Driven Web Development , 2011, CAiSE.

[13]  Gavriel Salvendy,et al.  Number of people required for usability evaluation , 2010, Commun. ACM.

[14]  Massimiliano Di Penta,et al.  An experimental investigation of formality in UML-based development , 2005, IEEE Transactions on Software Engineering.

[15]  Franca Garzotto,et al.  SUE inspection: an effective method for systematic usability evaluation of hypermedia , 2002, IEEE Trans. Syst. Man Cybern. Part A.

[16]  Antonio Vallecillo,et al.  Towards interoperable Web engineering methods , 2008, J. Assoc. Inf. Sci. Technol..

[17]  Kasper Hornbæk,et al.  Dogmas in the assessment of usability evaluation methods , 2010, Behav. Inf. Technol..

[18]  José Ambrosio Toval Álvarez,et al.  Integrating usability requirements that can be evaluated in design time into Model Driven Engineering of Web Information Systems , 2009, Adv. Eng. Softw..

[19]  Rocco J. Perla,et al.  Ten Common Misunderstandings, Misconceptions, Persistent Myths and Urban Legends about Likert Scales and Likert Response Formats and their Antidotes , 2007 .

[20]  Silvia Mara Abrahão,et al.  Usability evaluation methods for the web: A systematic mapping study , 2011, Inf. Softw. Technol..

[21]  Nelly Condori-Fernández,et al.  Understandability measurement in an early usability evaluation for model-driven development: an empirical study , 2008, ESEM '08.

[22]  Anne Marsden,et al.  International Organization for Standardization , 2014 .

[23]  Claes Wohlin,et al.  Experimentation in software engineering: an introduction , 2000 .

[24]  Victor R. Basili,et al.  The TAME Project: Towards Improvement-Oriented Software Environments , 1988, IEEE Trans. Software Eng..

[25]  Katrina D. Maxwell,et al.  Applied Statistics for Software Managers , 2002 .

[26]  Jean Vanderdonckt,et al.  Usability Evaluation of User Interfaces Generated with a Model-Driven Architecture Tool , 2008, Maturing Usability.

[27]  Guilherme Horta Travassos,et al.  Usability Evaluation Based on Web Design Perspectives , 2007, First International Symposium on Empirical Software Engineering and Measurement (ESEM 2007).

[28]  Jakob Nielsen,et al.  Usability inspection methods , 1994, CHI 95 Conference Companion.

[29]  Giovanni Toffetti Carughi,et al.  Web Usability: Principles and Evaluation Methods , 2006, Web Engineering.

[30]  Silvia Mara Abrahão,et al.  Empirical validation of a usability inspection method for model-driven Web development , 2013, J. Syst. Softw..

[31]  Stefano Ceri,et al.  Web Modeling Language (WebML): a modeling language for designing Web sites , 2000, Comput. Networks.