Web browsing behavior analysis and interactive hypervideo

Processing data on any sort of user interaction is well known to be cumbersome and mostly time consuming. In order to assist researchers in easily inspecting fine-grained browsing data, current tools usually display user interactions as mouse cursor tracks, a video-like visualization scheme. However, to date, traditional online video inspection has not explored the full capabilities of hypermedia and interactive techniques. In response to this need, we have developed SMT2ε, a Web-based tracking system for analyzing browsing behavior using feature-rich hypervideo visualizations. We compare our system to related work in academia and the industry, showing that ours features unprecedented visualization capabilities. We also show that SMT2ε efficiently captures browsing data and is perceived by users to be both helpful and usable. A series of prediction experiments illustrate that raw cursor data are accessible and can be easily handled, providing evidence that the data can be used to construct and verify research hypotheses. Considering its limitations, it is our hope that SMT2ε will assist researchers, usability practitioners, and other professionals interested in understanding how users browse the Web.

[1]  Gunnar Liestøl,et al.  Aesthetic and rhetorical aspects of linking video in hypermedia , 1994, ECHT '94.

[2]  Alex Paramythis,et al.  Using browser interaction data to determine page reading behavior , 2011, UMAP'11.

[3]  Ryen W. White,et al.  No clicks, no problem: using cursor movements to understand and improve search , 2011, CHI.

[4]  Eric Brill,et al.  Improving web search ranking by incorporating user behavior information , 2006, SIGIR.

[5]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[6]  Eugene Agichtein,et al.  Beyond dwell time: estimating document relevance from cursor movements and other post-click searcher behavior , 2012, WWW.

[7]  Ernesto Arroyo,et al.  Usability tool for analysis of web designs using mouse tracks , 2006, CHI Extended Abstracts.

[8]  Luis A. Leiva,et al.  Assessing users' interactions for clustering web documents: a pragmatic approach , 2010, HT '10.

[9]  Morten Hertzum,et al.  The evaluator effect in usability tests , 1998, CHI Conference Summary.

[10]  John R. Anderson,et al.  What can a mouse cursor tell us more?: correlation of eye/mouse movements on web browsing , 2001, CHI Extended Abstracts.

[11]  Min Chen,et al.  Video visualization , 2003, IEEE Visualization, 2003. VIS 2003..

[12]  Eugene Agichtein,et al.  Ready to buy or just browsing?: detecting web searcher goals from interaction data , 2010, SIGIR.

[13]  Ryen W. White,et al.  User see, user point: gaze and cursor alignment in web search , 2012, CHI.

[14]  Susan T. Dumais,et al.  Improving Web Search Ranking by Incorporating User Behavior Information , 2019, SIGIR Forum.

[15]  Andrea Lockerd Thomaz,et al.  Cheese: tracking mouse movement activity on websites, a tool for user modeling , 2001, CHI Extended Abstracts.

[16]  Eugene Agichtein,et al.  Towards predicting web searcher gaze position from mouse movements , 2010, CHI Extended Abstracts.

[17]  Alexander Toet,et al.  Gaze directed displays as an enabling technology for attention aware systems , 2006, Comput. Hum. Behav..

[18]  A. Raftery Bayesian Model Selection in Social Research , 1995 .

[19]  Naoki Shibata,et al.  Media-based navigation for hypermedia systems , 1993, Hypertext.

[20]  Darius Miniotas,et al.  Visualization of eye gaze data using heat maps , 2007 .

[21]  J. G. Adair,et al.  The Hawthorne effect: A reconsideration of the methodological artifact. , 1984 .

[22]  Peter Tarasewich,et al.  The Enhanced Restricted Focus Viewer , 2005, Int. J. Hum. Comput. Interact..

[23]  Yoshinori Hijikata,et al.  Implicit user profiling for on demand relevance feedback , 2004, IUI '04.

[24]  Robert W. Reeder,et al.  WebEyeMapper and WebLogger: tools for analyzing eye tracking data collected in web-use studies , 2001, CHI Extended Abstracts.

[25]  Isabelle Guyon,et al.  UNIPEN project of on-line data exchange and recognizer benchmarks , 1994, Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 3 - Conference C: Signal Processing (Cat. No.94CH3440-5).

[26]  M. Braga,et al.  Exploratory Data Analysis , 2018, Encyclopedia of Social Network Analysis and Mining. 2nd Ed..

[27]  John W. Tukey,et al.  Exploratory Data Analysis. , 1979 .

[28]  Michael J. Shiffer,et al.  Interactive Multimedia Planning Support: Moving from Stand-Alone Systems to the World Wide Web , 1995 .

[29]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[30]  Kerry Rodden,et al.  Eye-mouse coordination patterns on web search results pages , 2008, CHI Extended Abstracts.

[31]  Christian Müller-Tomfelde,et al.  Dwell-Based Pointing in Applications of Human Computer Interaction , 2007, INTERACT.

[32]  Min Chen,et al.  Video visualization , 2003 .

[33]  David Stotts An Extensible Object Tracking Architecture for Hyperlinking in Real-time and Stored Video Streams , 2002 .

[34]  David R. Anderson,et al.  Multimodel Inference , 2004 .

[35]  Albrecht Schmidt,et al.  Knowing the User's Every Move – User Activity Tracking for Website Usability Evaluation and Implicit Interaction , 2006 .

[36]  Ryen W. White,et al.  Large-scale analysis of individual and task differences in search result page examination strategies , 2012, WSDM '12.

[37]  Luis A. Leiva,et al.  Interactive hypervideo visualization for browsing behavior analysis , 2012, WWW.

[38]  David Hauger,et al.  Analyzing Client-Side Interactions to Determine Reading Behavior , 2009, LWA.