Rank-Order Weighting of Web Attributes for Website Evaluation

The rapid growth of web applications increases the need to evaluate web applications objectively. In the past few years some valuable works like WebQEM tried to objectively evaluate the web applications. However, still weighting web attributes which is one step of evaluation of web applications is completely subjective, depending mostly on experts' judgments. In this paper a two,step weighting approach is proposed. The approach divided the weighting step into two steps which are ranking and then weighting by using rank,order weighting formula. A simulation was conducted to compare using different rank,order weighting methods (RR, RS, and ROC) with the TRUE weights (simulated experts' judgments without prior ranking). Two kinds of comparison were done; comparison on weights and comparison on quality scores. From the results, using Rank,Sum is suggested as a good surrogate for experts' weights for the attributes when evaluating some web applications.

[1]  D. Winterfeldt,et al.  Comparison of weighting judgments in multiattribute utility measurement , 1991 .

[2]  Robert J. McQueen,et al.  Developing an Evaluation Instrument for e-Commerce Web Sites from the First-Time Buyer’s Viewpoint , 2004 .

[3]  Gustavo Rossi,et al.  Specifying Quality Characteristics and Attributes for Websites , 2001, Web Engineering.

[4]  Silvia Mara Abrahão,et al.  Early Usability Evaluation in Model Driven Architecture Environments , 2006, 2006 Sixth International Conference on Quality Software (QSIC'06).

[5]  Gustavo Rossi,et al.  Measuring Web Application Quality with WebQEM , 2002, IEEE Multim..

[6]  R. Hämäläinen,et al.  An Experiment on the Numerical Modelling of Verbal Ratio Statements , 1997 .

[7]  Giuseppe A. Di Lucca,et al.  Towards the definition of a maintainability model for Web applications , 2004, Eighth European Conference on Software Maintenance and Reengineering, 2004. CSMR 2004. Proceedings..

[8]  Luis Olsina,et al.  Assessing quality in use in a consistent way , 2006, ICWE '06.

[9]  San Murugesan.  Web engineering , 1999, LINK.

[10]  Byeong Seok Ahn,et al.  Comparing methods for multiattribute decision making with ordinal weights , 2008, Comput. Oper. Res..

[11]  Ping Zhang,et al.  A Comparison of the Most Important Website Features in Different Domains: An Empirical Study of User Perceptions , 2000 .

[12]  David L. Olson,et al.  Ordinal judgments in multiattribute decision analysis , 2002, Eur. J. Oper. Res..

[13]  Bruce E. Barrett,et al.  Decision quality using ranked attribute weights , 1996 .

[14]  Luis Antonio Olsina Santos.  Web-site Quality Evaluation Method: a Case Study on Museums , 1999 .

[15]  G. Gledec.  Quality model for the world wide web , 2005, Proceedings of the 8th International Conference on Telecommunications, 2005. ConTEL 2005..

[16]  Luis Olsina,et al.  How to Measure and Evaluate Web Applications in a Consistent Way , 2008, Web Engineering.