Understanding Within-Content Engagement through Pattern Analysis of Mouse Gestures

The availability of large volumes of interaction data and scalable data mining techniques have made possible to study the online behaviour for millions of Web users. Part of the efforts have focused on understanding how users interact and engage with web content. However, the measurement of within-content engagement remains a difficult and unsolved task. This is because of the lack of standardised, well-validated methods for measuring engagement, especially in an online context. To address this gap, we perform a controlled user study where we observe how users respond to online news in the presence or lack of interest. We collect mouse tracking data, which are known to correlate with visual attention, and examine how cursor behaviour can inform user engagement measures. The proposed method does not use any pre-determined concepts to characterise the cursor patterns. We, rather, follow an unsupervised approach and use a large set of features engineered from our data to extract the cursor patterns. Our findings support the connection between gaze and cursor behaviour but also, and more importantly, reveal other dependencies, such as the correlation between cursor activity and experienced affect. Finally, we demonstrate the value of our method by predicting the outcome of online news reading experiences.

[1]  Ryen W. White,et al.  No clicks, no problem: using cursor movements to understand and improve search , 2011, CHI.

[2]  Eugene Agichtein,et al.  Beyond dwell time: estimating document relevance from cursor movements and other post-click searcher behavior , 2012, WWW.

[3]  Heather L. O'Brien,et al.  Mixed-methods approach to measuring user experience in online news interactions , 2013, J. Assoc. Inf. Sci. Technol..

[4]  S. S. Ravi,et al.  Heuristic and Special Case Algorithms for Dispersion Problems , 1994, Oper. Res..

[5]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[6]  Thomas A. Farmer,et al.  Hand in Motion Reveals Mind in Motion , 2011, Front. Psychology.

[7]  Michalis Vazirgiannis,et al.  c ○ 2001 Kluwer Academic Publishers. Manufactured in The Netherlands. On Clustering Validation Techniques , 2022 .

[8]  Heather L. O'Brien,et al.  Exploring user engagement in online news interactions , 2011, ASIST.

[9]  Ryen W. White,et al.  User see, user point: gaze and cursor alignment in web search , 2012, CHI.

[10]  Jakob Nielsen,et al.  Eyetracking Web Usability , 2009 .

[11]  Jiawei Han,et al.  Data Mining: Concepts and Techniques , 2000 .

[12]  Eugene Agichtein,et al.  Predicting web search success with fine-grained interaction data , 2012, CIKM.

[13]  Kerry Rodden,et al.  Eye-mouse coordination patterns on web search results pages , 2008, CHI Extended Abstracts.

[14]  Fernando Diaz,et al.  Robust models of mouse movement on dynamic web search results pages , 2013, CIKM.

[15]  D. Watson,et al.  Development and validation of brief measures of positive and negative affect: the PANAS scales. , 1988, Journal of personality and social psychology.

[16]  Veranika Lim,et al.  Eye Gaze and Mouse Cursor Relationship in a Debugging Task , 2013, HCI.

[17]  Ryen W. White,et al.  Text selections as implicit relevance feedback , 2012, SIGIR '12.

[18]  Joemon M. Jose,et al.  User engagement in online News: Under the scope of sentiment, interest, affect, and gaze , 2014, J. Assoc. Inf. Sci. Technol..

[19]  Ryen W. White,et al.  Large-scale analysis of individual and task differences in search result page examination strategies , 2012, WSDM '12.

[20]  Hilary Hutchinson,et al.  User Preference and Search Engine Latency , 2008 .

[21]  Punit Shah Toward a Neurobiology of Unrealistic Optimism , 2012, Front. Psychology.

[22]  Dan Morris,et al.  Instrumenting the Dynamic Web , 2007, J. Web Eng..

[23]  Alexander J. Smola,et al.  Measurement and modeling of eye-mouse behavior in the presence of nonlinear page layouts , 2013, WWW.

[24]  Luis A. Leiva,et al.  Interactive hypervideo visualization for browsing behavior analysis , 2012, WWW.

[25]  Eugene Agichtein,et al.  Discovering common motifs in cursor movement data for improving web search , 2014, WSDM.

[26]  Vasyl Pihur,et al.  Weighted rank aggregation of cluster validation measures: a Monte Carlo cross-entropy approach , 2007, Bioinform..

[27]  Bracha Shapira,et al.  Study of the usefulness of known and new implicit indicators and their optimal combination for accurate inference of users interests , 2006, SAC.

[28]  Dmitry Lagun,et al.  Improving Relevance Prediction by Addressing Biases and Sparsity in Web Search Click Data , 2012 .

[29]  Eugene Agichtein,et al.  Exploring mouse movements for inferring query intent , 2008, SIGIR '08.

[30]  Andreas Dengel,et al.  Eye tracking analysis of preferred reading regions on the screen , 2010, CHI Extended Abstracts.

[31]  Elaine Toms,et al.  The development and evaluation of a survey to measure user engagement , 2010, J. Assoc. Inf. Sci. Technol..

[32]  Ryen W. White,et al.  Improving searcher models using mouse cursor activity , 2012, SIGIR '12.

[33]  Andrea Lockerd Thomaz,et al.  Cheese: tracking mouse movement activity on websites, a tool for user modeling , 2001, CHI Extended Abstracts.

[34]  Scott Counts,et al.  Taking It All In? Visual Attention in Microblog Consumption , 2021, ICWSM.

[35]  Eugene Agichtein,et al.  Towards predicting web searcher gaze position from mouse movements , 2010, CHI Extended Abstracts.

[36]  Mark D. Smucker,et al.  Mouse movement during relevance judging: implications for determining user attention , 2014, SIGIR.

[37]  Elizabeth F. Churchill,et al.  Mouse tracking: measuring and predicting users' experience of web-based content , 2012, CHI.

[38]  Alan Olinsky,et al.  The comparative efficacy of imputation methods for missing data in structural equation modeling , 2003, Eur. J. Oper. Res..

[39]  M H Fischer,et al.  An Investigation of Attention Allocation during Sequential Eye Movement Tasks , 1999, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[40]  Moni Naor,et al.  Rank aggregation methods for the Web , 2001, WWW '01.