Online multitasking and user engagement

Users often access and re-access more than one site during an online session, effectively engaging in multitasking. In this paper, we study the effect of online multitasking on two widely used engagement metrics designed to capture users browsing behavior with a site. Our study is based on browsing data of 2.5M users across 760 sites encompassing diverse types of services such as social media, news and mail. To account for multitasking we need to redefine how user sessions are represented and we need to adapt the metrics under study. We introduce a new representation of user sessions: tree-streams -- as opposed to the commonly used click-streams -- present a more accurate picture of the browsing behavior of a user that includes how users switch between sites (e.g., hyperlinking, teleporting, backpaging). We then discuss a number of insights on multitasking patterns, and show how these help to better understand how users engage with sites. Finally, we define metrics that characterize multitasking during online sessions and show how they provide additional insights to standard engagement metrics.

[1]  D. Meyer,et al.  Executive control of cognitive processes in task switching. , 2001, Journal of experimental psychology. Human perception and performance.

[2]  Abigail Sellen,et al.  "It's simply integral to what I do": enquiries into how the web is weaved into everyday life , 2012, WWW.

[3]  Ravi Kumar,et al.  Stochastic models for tabbed browsing , 2010, WWW '10.

[4]  Mounia Lalmas,et al.  Models of user engagement , 2012, UMAP.

[5]  Ravin Balakrishnan,et al.  A study of tabbed browsing among mozilla firefox users , 2010, CHI.

[6]  Jaime Teevan,et al.  Large scale query log analysis of re-finding , 2010, WSDM '10.

[7]  Geoffray Bonnin,et al.  Taking into account Tabbed Browsing in Predictive Web Usage Mining , 2011 .

[8]  Elaine Toms,et al.  What is user engagement? A conceptual framework for defining user engagement with technology , 2008, J. Assoc. Inf. Sci. Technol..

[9]  Qing Wang,et al.  Multitasking bar: prototype and evaluation of introducing the task concept into a browser , 2010, CHI.

[10]  Mounia Lalmas,et al.  Absence time and user engagement: evaluating ranking functions , 2013, WSDM '13.

[11]  Filippo Menczer,et al.  What's in a session: tracking individual behavior on the web , 2009, HT '09.

[12]  Dror G. Feitelson,et al.  On extracting session data from activity logs , 2012, SYSTOR '12.

[13]  Eelco Herder,et al.  Web page revisitation revisited: implications of a long-term click-stream study of browser usage , 2007, CHI.

[14]  Andy Cockburn,et al.  An empirical analysis of web page revisitation , 2001, Proceedings of the 34th Annual Hawaii International Conference on System Sciences.

[15]  Michael A. Shepherd,et al.  A Goal-based Classification of Web Information Tasks , 2006, ASIST.

[16]  Shengdong Zhao,et al.  Measuring web page revisitation in tabbed browsing , 2011, CHI.

[17]  Saul Greenberg,et al.  How people revisit web pages: empirical findings and implications for the design of history systems , 1997, Int. J. Hum. Comput. Stud..

[18]  I. Dhillon,et al.  A Unified View of Kernel k-means , Spectral Clustering and Graph Cuts , 2004 .

[19]  Amanda Spink,et al.  How to Define Searching Sessions on Web Search Engines , 2006, WEBKDD.

[20]  Ravi Kumar,et al.  A characterization of online browsing behavior , 2010, WWW '10.

[21]  Michal Skubacz,et al.  Relevance and Impact of Tabbed Browsing Behavior on Web Usage Mining , 2006, 2006 IEEE/WIC/ACM International Conference on Web Intelligence (WI 2006 Main Conference Proceedings)(WI'06).

[22]  Inderjit S. Dhillon,et al.  Kernel k-means: spectral clustering and normalized cuts , 2004, KDD.

[23]  Amanda Spink,et al.  Multitasking during Web search sessions , 2006, Inf. Process. Manag..

[24]  Eelco Herder.  Characterizations of User Web Revisit Behavior , 2005, LWA.

[25]  Fabrizio Silvestri,et al.  Identifying task-based sessions in search engine query logs , 2011, WSDM '11.

[26]  Ryen W. White,et al.  Parallel browsing behavior on the web , 2010, HT '10.