Web site evolution: Usability evaluation using Time Series Analysis of Selected Episode Graphs

Evaluations of website effectiveness have evolved from metrics based on page hits and visits to assessments of the impact of site changes on the behavior of particular user groups. Typically, this involves the use of clustering algorithms to generate behavior-based groupings, followed by profile-based analyses. One weakness of this approach is that resulting groups are often based on aspects of user behavior not relevant for the revision under study. A second weakness is that profiles may be difficult to interpret. To address these weaknesses we employ 1) a semi-supervised clustering algorithm seeded with evaluator-selected, representative sessions; 2) Time Series Analysis - Selected Episode Graphs (TSA-SEGs), annotated graphical representations of “interesting” aspects of behavior, based on episodes (sequences of requests) and time windows selected by the evaluator. Our approach compared favorably with a leading approach, H-UNC and analysis of profiles created from the resultant clusters, on a case study of an important revision to a biological database site (www.cryptodb.org).

[1]  Hichem Frigui,et al.  A Robust Competitive Clustering Algorithm With Applications in Computer Vision , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Patrick Gallinari,et al.  Characterizing Sequences of User Actions for Access Logs Analysis , 2001, User Modeling.

[3]  Hendrik Blockeel,et al.  Web mining research: a survey , 2000, SKDD.

[4]  Olfa Nasraoui,et al.  An Evolutionary Approach to Mining Robust Multi-Resolution Web Profiles and Context Sensitive URL Associations , 2002, Int. J. Comput. Intell. Appl..

[5]  Chris North,et al.  An insight-based methodology for evaluating bioinformatics visualizations , 2005, IEEE Transactions on Visualization and Computer Graphics.

[6]  Arindam Banerjee,et al.  Semi-supervised Clustering by Seeding , 2002, ICML.

[7]  Padhraic Smyth,et al.  Model-Based Clustering and Visualization of Navigation Patterns on a Web Site , 2003, Data Mining and Knowledge Discovery.

[8]  Zhenglu Yang,et al.  An Effective System for Mining Web Log , 2006, APWeb.

[9]  Raghu Krishnapuram,et al.  Fitting an unknown number of lines and planes to image data through compatible cluster merging , 1992, Pattern Recognit..

[10]  Lakhmi C. Jain,et al.  Evolutionary computation in data mining , 2005 .

[11]  Virgílio A. F. Almeida,et al.  A methodology for workload characterization of E-commerce sites , 1999, EC '99.

[12]  R. Mooney,et al.  Comparing and Unifying Search-Based and Similarity-Based Approaches to Semi-Supervised Clustering , 2003 .

[13]  Jean-Daniel Fekete,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS , 2022 .

[14]  Jaideep Srivastava,et al.  Web usage mining: discovery and applications of usage patterns from Web data , 2000, SKDD.

[15]  Padhraic Smyth,et al.  Visualization of navigation patterns on a Web site using model-based clustering , 2000, KDD '00.

[16]  Joshue O. Connor.  User Testing: How to Involve Users in Technical Web Development Cycles as a Natural Evolution in the Creation of Inclusive Technologies and Accessible Content , 2008, ICCHP.

[17]  Zhigang Li,et al.  Improving the Web Site's Effectiveness by Considering Each Page's Temporal Information , 2003, WAIM.

[18]  Thorsten Joachims,et al.  WebWatcher : A Learning Apprentice for the World Wide Web , 1995 .

[19]  Jean-Michel Jolion,et al.  Robust Clustering with Applications in Computer Vision , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Mei Cao,et al.  B2C e-commerce web site quality: an empirical examination , 2005, Ind. Manag. Data Syst..

[21]  Giuseppe Scanniello,et al.  Using Semantic clustering to enhance the navigation structure of Web sites , 2008, 2008 10th International Symposium on Web Site Evolution.

[22]  G. Premkumar,et al.  E-government evolution: an evaluation of local online services , 2006, Int. J. Electron. Bus..