Automated Usability Testing: Analysing Asia Web Sites

Web usability is continuing to be a pressing problem. For number of years researchers have been developed tools for doing automatic web usability testing. This study uses our own PHP, and MySQL based tool AWebHUT: Automated Web Homepage Usability Tester to evaluate web usability of full Dmoz (www.dmoz.org) Asia web sites (45126 on time stamp 2011-12-03 04:12:46 GMT). The tool uses an extensive automated quantitative analysis of XHTML source code of homepages against seventeen organised web usability guidelines. The automated quantitative approach is effective on large scale to achieve better usability. The AWebHUT uses four web usability levels such as N: Neutral, V: Violate, R: Respect, and E: Error to evaluate web usability. The main objective of the study is to produce data which is used to answer research questions, (1) Are there any categories of web sites which have usability problems? Which ones? and (2) Are there any categories in which the usability is typically higher? Why? The findings were indicated that all Asia categories have usability problems. Furthermore, there are four web sites which have highest web usability problem with violation percentage 71. One step further, the Asia category: Weather has highest usability problems with 42.2819 as the average of the violation percentage. The category Weather uses tables and images, considerable amount of those were not satisfying web usability guidelines which relates to tables and images. One step further, the Asia wants to get the same level of usability as North America, Europe, and Australia therefore it is essential to have an automated web usability evaluation in Asia web sites to identify web usability problems which are important for improving Asia web sites.

[1]  Jean Vanderdonckt,et al.  Automated Repair Tool For Usability And Accessibility Of Web Sites , 2006, CADUI.

[2]  Jean Scholtz,et al.  Developing Usability Tools and Techniques for Designing and Testing Web Sites , 1998 .

[3]  Gail E. Kaiser,et al.  DOM-based content extraction of HTML documents , 2003, WWW '03.

[4]  Marti A. Hearst,et al.  Improving Web Site Design , 2002, IEEE Internet Comput..

[5]  Marti A. Hearst,et al.  An empirical foundation for automated web interface evaluation , 2001 .

[6]  Jean Vanderdonckt,et al.  KWARESMI - Knowledge-based web automated evaluation with REconfigurable guidelineS optiMIzation , 2002 .

[7]  Gregg C. Vanderheiden,et al.  Web Content Accessibility Guidelines (WCAG) 2.0 , 2008 .

[8]  Benjamin M. Good,et al.  Fast, Cheap and Out of Control: A Zero Curation Model for Ontology Development , 2005, Pacific Symposium on Biocomputing.

[9]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[10]  Carl Bedingfield.  A pattern language for web usability , 2003, UBIQ.

[11]  Dominique L. Scapin,et al.  A Framework for Organizing Web Usability Guidelines , 2000 .

[12]  Jakob Nielsen,et al.  Usability , 2009 .

[13]  Marti A. Hearst,et al.  The state of the art in automating usability evaluation of user interfaces , 2001, CSUR.

[14]  Jean Vanderdonckt,et al.  Computer-Aided Design of User Interfaces II , 1999, Springer Netherlands.

[15]  Ken Maskrey,et al.  Improving the Design , 2010 .

[16]  Tom Brinck,et al.  Automatically evaluating the usability of web sites , 2002, CHI Extended Abstracts.

[17]  Janice Anne Rohn,et al.  Usability in practice: alternatives to formative evaluations-evolution and revolution , 2002, CHI Extended Abstracts.

[18]  Jean Vanderdonckt,et al.  Automated Web Evaluation by Guideline Review , 2005, J. Web Eng..

[19]  Maysoon F. Abulkhair,et al.  A multilingual automated web usability evaluation agent , 2004 .

[20]  Andres Baravalle,et al.  A quantitative approach to usability evaluation of web sites , 2011 .

[21]  Jakob Nielsen,et al.  Homepage Usability: 50 Websites Deconstructed , 2001 .