Early Usability Measurement in Model-Driven Development: Definition and Empirical Evaluation

Usability is currently a key feature for developing quality systems. A system that satisfies all the functional requirements can be strongly rejected by end-users if it presents usability problems. End-users demand intuitive interfaces and an easy interaction in order to simplify their work. The first step in developing usable systems is to determine whether a system is or is not usable. To do this, there are several proposals for measuring the system usability. Most of these proposals are focused on the final system and require a large amount of resources to perform the evaluation (end-users, video cameras, questionnaires, etc.). Usability problems that are detected once the system has been developed involve a lot of reworking by the analyst since these changes can affect the analysis, design, and implementation phases. This paper proposes a method to minimize the resources needed for the evaluation and reworking of usability problems. We propose an early usability evaluation that is based on conceptual models. The analyst can measure the usability of attributes that depend on conceptual primitives. This evaluation can be automated taking as input the conceptual models that represent the system abstractly.

[1]  Oscar Pastor,et al.  Model-driven architecture in practice - a software production environment based on conceptual modeling , 2007 .

[2]  Piero Fraternali,et al.  WQA: an XSL framework for analyzing the quality of Web applications , 2002 .

[3]  Tony Clark,et al.  Model-driven development - Guest editor's introduction , 2003 .

[4]  Claes Wohlin,et al.  Experimentation in software engineering: an introduction , 2000 .

[5]  Antonio Vallecillo,et al.  An Ontology for Software Measurement , 2006, Ontologies for Software Engineering and Software Technology.

[6]  Fabio Paternò,et al.  Automatic Support for Usability Evaluation , 1998, IEEE Trans. Software Eng..

[7]  Alain Abran,et al.  Usability Meanings and Interpretations in ISO Standards , 2003, Software Quality Journal.

[8]  Natalia Juristo Juzgado,et al.  Basics of Software Engineering Experimentation , 2010, Springer US.

[9]  G. A. Miller THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[10]  Rex B. Kline,et al.  Usability measurement and metrics: A consolidated model , 2006, Software Quality Journal.

[11]  Barry W. Boehm,et al.  Software Engineering Economics , 1993, IEEE Transactions on Software Engineering.

[12]  Mario Piattini,et al.  Finding "early" indicators of UML class diagrams understandability and modifiability , 2004, Proceedings. 2004 International Symposium on Empirical Software Engineering, 2004. ISESE '04..

[13]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[14]  Dominique L. Scapin,et al.  Ergonomic criteria for the evaluation of human-computer interfaces , 1993 .

[15]  Sebastián Uchitel,et al.  Model-based Simulation of Web Applications for Usability Assessment , 2003, ICSE Workshop on SE-HCI.

[16]  Silvia Mara Abrahão,et al.  Integrating a Usability Model into Model-Driven Web Development Processes , 2009, WISE.

[17]  Lenja Sorokin,et al.  Flex RIA Development and Usability Evaluation , 2007, WISE Workshops.

[18]  Nelly Condori-Fernández,et al.  Towards an Early Usability Evaluation for Web Applications , 2007, IWSM/Mensura.

[19]  Ramayya Krishnan,et al.  CMU-WEB: A Conceptual Model for Designing Usable Web Applications , 1999, J. Database Manag..

[20]  Pier Luca Lanzi,et al.  Model-Driven Web Usage Analysis for the Evaluation of Web Application Quality , 2004, J. Web Eng..