Classifying web metrics using the web quality model

Purpose – The purpose of this paper is to classify the most important metrics proposed for web information systems, with the aim of offering the user a global vision of the state of the research within this area.Design/methodology/approach – WQM distinguishes three dimensions related to web features, lifecycle processes and quality characteristics. A range of recently published (1992‐2004) works that include web metrics definitions have been studied and classified within this model.Findings – In this work, a global vision of web metrics is provided. Concretely, it was found that about 44 percent of metrics are related to “presentation” and that most metrics (48 percent) are usability metrics. Regarding the life cycle, the majority of metrics are related to operation and maintenance processes. Nevertheless, focusing on metrics validation, it was found that there is not too much work done, with only 3 percent of metrics validated theoretically and 37 percent of metrics validated empirically.Practical implic...

[1]  Coral Calero,et al.  Empirical validation of referential integrity metrics , 2001, Inf. Softw. Technol..

[2]  Tomas Escobar-Rodriguez,et al.  Online transparency of the banking sector , 2006, Online Inf. Rev..

[3]  Ben Shneiderman,et al.  Navigating in hyperspace: designing a structure-based toolbox , 1994, CACM.

[4]  Marti A. Hearst,et al.  An empirical foundation for automated web interface evaluation , 2001 .

[5]  Luis Olsina,et al.  Defining and validating metrics for navigational models , 2003, Proceedings. 5th International Workshop on Enterprise Networking and Computing in Healthcare Industry (IEEE Cat. No.03EX717).

[6]  Emilia Mendes,et al.  A comparison of development effort estimation techniques for Web hypermedia applications , 2002, Proceedings Eighth IEEE Symposium on Software Metrics.

[7]  Emilia Mendes,et al.  Comparison of Web size measures for predicting Web design and authoring effort , 2002, IEE Proc. Softw..

[8]  Donald J. Reifer.  Estimating Web Development Costs: There Are Differences , 2002 .

[9]  D. Ross Jeffery,et al.  Cost estimation for web applications , 2003, 25th International Conference on Software Engineering, 2003. Proceedings..

[10]  Stefano Ceri,et al.  Web Modeling Language (WebML): a modeling language for designing Web sites , 2000, Comput. Networks.

[11]  Luisa Mich,et al.  Evaluating and designing Web site quality , 2003 .

[12]  Ioannis Stamelos,et al.  Measuring functionality and productivity in Web-based applications: a case study , 1999, Proceedings Sixth International Software Metrics Symposium (Cat. No.PR00403).

[13]  Oscar Pastor,et al.  Towards the Design of a Metrics Cataloging System by Exploiting Conceptual and Semantic Web Approaches , 2003, ICWE.

[14]  Eelco Herder.  Metrics for the Adaptation of Site Structure , 2002 .

[15]  Luis Olsina,et al.  Automatizando Métricas Web , 2001, QUATIC.

[16]  Piero Fraternali,et al.  Tools and approaches for developing data-intensive Web applications: a survey , 1999, CSUR.

[17]  Guy Fitzgerald,et al.  Where now for development methodologies? , 2003, CACM.

[18]  Dr. Melody Y. Ivory.  Automated Web Site Evaluation , 2003, Human-Computer Interaction Series.

[19]  Ramayya Krishnan,et al.  CMU-WEB: A Conceptual Model for Designing Usable Web Applications , 1999, J. Database Manag..

[20]  Petra Schubert,et al.  Extended Web Assessment Method (EWAM): Evaluation of Electronic Commerce Applications from the Customer's Viewpoint , 2002, Int. J. Electron. Commer..

[21]  Monika Henzinger,et al.  Hyperlink Analysis for the Web , 2001, IEEE Internet Comput..

[22]  Genny Tortora,et al.  A COSMIC-FFP Based Method to Estimate Web Application Development Effort , 2004, ICWE.

[23]  Gustavo Rossi,et al.  Specifying Quality Characteristics and Attributes for Websites , 2001, Web Engineering.

[24]  Donald J. Reifer.  Ten Deadly Risks in Internet and Intranet Software Development , 2002, IEEE Softw..

[25]  Steve Krug,et al.  Don't Make Me Think!: A Common Sense Approach to Web Usability , 2000 .

[26]  Mario Piattini,et al.  A Three Dimensional Web Quality Model , 2003, ICWE.

[27]  D. Ross Jeffery,et al.  Using Web objects for estimating software development effort for Web applications , 2003, Proceedings. 5th International Workshop on Enterprise Networking and Computing in Healthcare Industry (IEEE Cat. No.03EX717).

[28]  Gustavo Rossi,et al.  Measuring Web Application Quality with WebQEM , 2002, IEEE Multim..

[29]  Nora Koch,et al.  A UML-based Methodology for Hypermedia Design , 2000, UML.

[30]  Dieter Fink.  Web site effectiveness: a measure of information and service quality , 2001 .

[31]  Giuseppe A. Di Lucca,et al.  Towards the definition of a maintainability model for Web applications , 2004, Eighth European Conference on Software Maintenance and Reengineering, 2004. CSMR 2004. Proceedings..

[32]  Cristina Cachero,et al.  Conceptual Modeling of Device-Independent Web Applications , 2001, JISBD.

[33]  Luciano Baresi,et al.  Estimating the design effort of Web applications , 2003, Proceedings. 5th International Workshop on Enterprise Networking and Computing in Healthcare Industry (IEEE Cat. No.03EX717).

[34]  Donald J. Reifer,et al.  Web Development: Estimating Quick-to-Market Software , 2000, IEEE Softw..

[35]  Harri Oinas-Kukkonen,et al.  Requirements for Web Engineering Methodologies , 2001, Information Modeling in the New Millennium.

[36]  Gregg C. Vanderheiden,et al.  Web content accessibility guidelines 1.0 , 2001, INTR.

[37]  Emilia Mendes,et al.  Web Metrics-Estimating Design and Authoring Effort , 2001, IEEE Multim..

[38]  Gail Miles,et al.  Resource estimation for Web applications , 2004, 10th International Symposium on Software Metrics, 2004. Proceedings..

[39]  A. Jefferson Offutt,et al.  Quality Attributes of Web Software Applications , 2002, IEEE Softw..

[40]  Jakob Nielsen,et al.  Designing web usability , 1999 .

[41]  Sourav S. Bhowmick,et al.  A survey of Web metrics , 2002, CSUR.

[42]  Emilia Mendes,et al.  Web development effort estimation using analogy , 2000, Proceedings 2000 Australian Software Engineering Conference.

[43]  Gerti Kappel,et al.  Web Engineering - Old Wine in New Bottles? , 2004, ICWE.

[44]  Lutz Heuser.  The Real World or Web Engineering? , 2004, ICWE.

[45]  Peter Dolog,et al.  Model-Driven Design of Web Applications with Client-Side Adaptation , 2004, ICWE.

[46]  Jonathan W. Palmer,et al.  Web Site Usability, Design, and Performance Metrics , 2002, Inf. Syst. Res..

[47]  Paolo Ciancarini,et al.  Towards a Framework for Web Sites Quality Evaluation , 2003, SEKE.

[48]  Ben Shneiderman,et al.  Structural analysis of hypertexts: identifying hierarchies and useful metrics , 1992, TOIS.

[49]  Emilia Mendes,et al.  Early Web size measures and effort prediction for Web costimation , 2003, Proceedings. 5th International Workshop on Enterprise Networking and Computing in Healthcare Industry (IEEE Cat. No.03EX717).

[50]  Keng Siau,et al.  Information quality in internet commerce design , 2002, Information and Database Quality.

[51]  Marti A. Hearst,et al.  Empirically validated web page design metrics , 2001, CHI.

[52]  Mario Piattini,et al.  A Web Metrics Survey Using WQM , 2004, ICWE.

[53]  Marti A. Hearst,et al.  The state of the art in automating usability evaluation of user interfaces , 2001, CSUR.

[54]  San Murugesan.  Web engineering , 1999, LINK.