Towards an Early Usability Evaluation for Web Applications

In the Human-Computer Interaction (HCI) community, the usual way to measure usability is through a user test. The disadvantage of this way is that the system must be implemented before performing the test. As a consequence, developers must solve the usability issues in the last stages of the development process. Currently, the model-driven software development is gaining popularity as a solution to reduce changes impact. In this paper, a usability model is proposed to evaluate early usability from the conceptual schemas that represents a Web Application. This approach allows to incorporate usability improvements before the implementation of the final web application. We evaluate the usability of artefacts modelled with OOWS, a model-driven web engineering method. In addition, two case studies are used to verify the instruments proposed to evaluate our early usability model.

[1]  Yoshiki Mitani,et al.  An empirical trial of multi-dimensional in-process measurement and feedback on a governmental multi-vendor software project , 2005 .

[2]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[3]  Nelly Condori-Fernández,et al.  Requisitos No Funcionales: Evaluando el Impacto de Decisiones , 2007, JIISIC.

[4]  Mark C. Paulk,et al.  Practices of High Maturity Organizations , 1999 .

[5]  Ralf Kneuper,et al.  Supporting Software Processes Using Knowledge Management , 2001 .

[6]  Kent L. Norman,et al.  Development of an instrument measuring user satisfaction of the human-computer interface , 1988, CHI '88.

[7]  Pankaj Jalote,et al.  Quantitative Quality Management through Defect Prediction and Statistical Process Control , 2003 .

[8]  R. Sitgreaves.  Psychometric theory (2nd ed.). , 1979 .

[9]  Silvia Mara Abrahão,et al.  Early Usability Evaluation in Model Driven Architecture Environments , 2006, 2006 Sixth International Conference on Quality Software (QSIC'06).

[10]  Dominique L. Scapin,et al.  Ergonomic criteria for the evaluation of human-computer interfaces , 1993 .

[11]  Oscar Pastor,et al.  Model-driven architecture in practice - a software production environment based on conceptual modeling , 2007 .

[12]  W. Buxton.  Human-Computer Interaction , 1988, Springer Berlin Heidelberg.

[13]  Gruia-Catalin Roman,et al.  A taxonomy of current issues in requirements engineering , 1985, Computer.

[14]  Jakob Nielsen,et al.  Chapter 4 – The Usability Engineering Lifecycle , 1993 .

[15]  William A. Florac,et al.  Measuring the Software Process: Statistical Process Control for Software Process Improvement , 1999 .

[16]  Oscar Pastor,et al.  Evaluación de la Usabilidad en un Entorno de Arquitecturas Orientada a Modelo , 2006, CIbSE.

[17]  Austen Rainer,et al.  Key success factors for implementing software process improvement: a maturity-based analysis , 2002, J. Syst. Softw..

[18]  Onur Demirörs,et al.  Utilization of statistical process control (SPC) in emergent software organizations: Pitfalls and suggestions , 2006, Software Quality Journal.

[19]  A. Abran,et al.  Validating and understanding software cost estimation models based on neural networks , 2004, Proceedings. 2004 International Conference on Information and Communication Technologies: From Theory to Applications, 2004..

[20]  June M. Verner.  Function Point Analysis , 2002 .

[21]  Ergonomic requirements for office work with visual display terminals ( VDTs ) — Part 11 : Guidance on usability , 1998 .

[22]  Douglas Fisher,et al.  Machine Learning Approaches to Estimating Software Development Effort , 1995, IEEE Trans. Software Eng..

[23]  S. K. Pillai,et al.  Statistical Process Control to Improve Coding and Code Review , 2003, IEEE Softw..

[24]  Chuen-Tsai Sun,et al.  Functional equivalence between radial basis function networks and fuzzy inference systems , 1993, IEEE Trans. Neural Networks.

[25]  Didar Zowghi,et al.  A model for the implementation of software process improvement: a pilot study , 2003, Third International Conference on Quality Software, 2003. Proceedings..

[26]  Ricardo de Almeida Falbo,et al.  Using knowledge management to improve software process performance in a CMM level 3 organization , 2004, Fourth International Conference onQuality Software, 2004. QSIC 2004. Proceedings..

[27]  William A. Florac,et al.  Statistical Process Control: Analyzing a Space Shuttle Onboard Software Process , 2000, IEEE Softw..

[28]  A. Abran,et al.  An Experiment on the Design of Radial Basis Function Neural Networks for Software Cost Estimation , 2006, 2006 2nd International Conference on Information & Communication Technologies.

[29]  Ronan Fitzpatrick,et al.  Usable Software and Its Attributes: A Synthesis of Software Quality, European Community Law and Human-Computer Interaction , 1998, BCS HCI.

[30]  Colin J Burgess,et al.  Can genetic programming improve software effort estimation? A comparative evaluation , 2001, Inf. Softw. Technol..

[31]  J. B. Dreger,et al.  Function point analysis , 1989 .

[32]  Gavin R. Finnie,et al.  Estimating software development effort with connectionist models , 1997, Inf. Softw. Technol..

[33]  John A. Zachman,et al.  A Framework for Information Systems Architecture , 1987, IBM Syst. J..

[34]  Taghi M. Khoshgoftaar,et al.  Estimating software project effort by analogy based on linguistic values , 2002, Proceedings Eighth IEEE Symposium on Software Metrics.

[35]  Mary Corbett,et al.  SUMI: the Software Usability Measurement Inventory , 1993, Br. J. Educ. Technol..

[36]  Martin J. Shepperd,et al.  Estimating Software Project Effort Using Analogies , 1997, IEEE Trans. Software Eng..

[37]  Katsuro Inoue,et al.  A Proposal for Analysis and Prediction for Software Projects using Collaborative Filtering, In-Process Measurements and a Benchmarks Database , 2006 .

[38]  T.C. Lethbridge,et al.  Guide to the Software Engineering Body of Knowledge (SWEBOK) and the Software Engineering Education Knowledge (SEEK) - a preliminary mapping , 2001, 10th International Workshop on Software Technology and Engineering Practice.

[39]  G. Steiner,et al.  A CHINESE PROVERB , 2013 .

[40]  Tok Wang Ling,et al.  Conceptual Modeling - ER 2003 , 2003, Lecture Notes in Computer Science.

[41]  Oscar Pastor,et al.  A MDA-based Environment for Web Applications Development : From Conceptual Models to Code 1 , 2007 .

[42]  Edward F. Weller.  Practical Applications of Statistical Process Control , 2000, IEEE Softw..

[43]  Watts S. Humphrey,et al.  Managing the software process , 1989, The SEI series in software engineering.

[44]  John Moody,et al.  Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.

[45]  Barbara Kitchenham,et al.  A comparison of cross-company and within-company effort estimation models for Web applications , 2004, ICSE 2004.

[46]  Joseph O. Voelkel.  Understanding Variation: The Key to Managing Chaos , 1994 .

[47]  Scott A. Whitmire,et al.  Object-Oriented Design Measurement , 1997 .

[48]  Shari Lawrence Pfleeger,et al.  Software Metrics : A Rigorous and Practical Approach , 1998 .

[49]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[50]  Gerrit C. van der Veer,et al.  Breaking Down Usability , 1999, INTERACT.

[51]  Onur Demirörs,et al.  Investigating Suitability of Software Process and Metrics for Statistical Process Control , 2006, EuroSPI.

[52]  Taghi M. Khoshgoftaar,et al.  Can neural networks be easily interpreted in software cost estimation? , 2002, 2002 IEEE World Congress on Computational Intelligence. 2002 IEEE International Conference on Fuzzy Systems. FUZZ-IEEE'02. Proceedings (Cat. No.02CH37291).

[53]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[54]  Vicente Pelechano,et al.  Development of Web Applications from Web Enhanced Conceptual Schemas , 2003, ER.

[55]  Jooyoung Park,et al.  Approximation and Radial-Basis-Function Networks , 1993, Neural Computation.

[56]  Ivo Düntsch,et al.  The IsoMetrics usability inventory: An operationalization of ISO 9241-10 supporting summative and formative evaluation of software systems , 1999, Behav. Inf. Technol..