Challenges of Capturing Natural Web-Based User Behaviors

It can be difficult to properly understand aspects of user behavior on the Web without examining the behaviors in a realistic setting, such as through field studies. In this article, an overview of the experiences in augmenting logged data with contextual information over the course of two separate research projects conducted in the field is presented. One project investigated the privacy sensitivity of normal Web browsing, and the other examined user behavior during Web-based information-seeking tasks. Throughout both projects, the contextual information was collected through participant annotations of their Web usage. Based on experiences in conducting this research, implications of methodological decisions are considered, unanswered questions are highlighted, and considerations for other researchers are provided. These shared experiences and perspectives will assist future researchers planning similar field studies, allowing them to build upon the lessons learned.

[1]  C. Allen.  The use of video in organizational studies , 1989, SGCH.

[2]  Kori Inkpen Quinn,et al.  Keeping up appearances: understanding the dimensions of incidental information privacy , 2006, CHI.

[3]  Jonathan Grudin,et al.  A study of preferences for sharing and privacy , 2005, CHI Extended Abstracts.

[4]  Carolyn Watters,et al.  A field study characterizing Web-based information-seeking tasks , 2007 .

[5]  S. Margulis.  Privacy as a Social Issue and Behavioral Concept , 2003 .

[6]  Vivian Cothey,et al.  A longitudinal study of World Wide Web users' information-searching behavior , 2002, J. Assoc. Inf. Sci. Technol..

[7]  Eva M. Thury.  Analysis of student Web browsing behavior: implications for designing and evaluating Web sites , 1998, SIGDOC '98.

[8]  Mika Käki,et al.  Information search and re-access strategies of experienced web users , 2005, WWW '05.

[9]  Amanda Spink,et al.  Real life, real users, and real needs: a study and analysis of user queries on the web , 2000, Inf. Process. Manag..

[10]  Saul Greenberg,et al.  How people revisit web pages: empirical findings and implications for the design of history systems , 1997, Int. J. Hum. Comput. Stud..

[11]  Michael A. Shepherd,et al.  The impact of task on the usage of web browser navigation mechanisms , 2006, Graphics Interface.

[12]  Gary T. Marx,et al.  A Tack in the Shoe: Neutralizing and Resisting the New Surveillance , 2003 .

[13]  Ion Juvina,et al.  Discovery of Individual User Navigation Styles , 2004 .

[14]  Mark Claypool,et al.  Implicit interest indicators , 2001, IUI '01.

[15]  Brian Detlor,et al.  Information Seeking on the Web: An Integrated Model of Browsing and Searching , 2000, First Monday.

[16]  Azer Bestavros,et al.  Changes in Web client access patterns: Characteristics and caching implications , 1999, World Wide Web.

[17]  Amanda Spink,et al.  A temporal comparison of AltaVista Web searching , 2005, J. Assoc. Inf. Sci. Technol..

[18]  R. Fisher.  Social Desirability Bias and the Validity of Indirect Questioning , 1993 .

[19]  Bryce Allen,et al.  Cognitive and task influences on Web searching behavior , 2002, J. Assoc. Inf. Sci. Technol..

[20]  Andy Cockburn,et al.  What do web users do? An empirical analysis of web use , 2001, Int. J. Hum. Comput. Stud..

[21]  David F. Redmiles,et al.  Extracting usability information from user interface events , 2000, CSUR.

[22]  Donna L. Hoffman,et al.  Measuring the Customer Experience in Online Environments: A Structural Modeling Approach , 2000 .

[23]  Jeffrey Heer,et al.  WebQuilt : A Proxy-based Approach to Remote Web Usability Testing , 2001 .

[24]  Kori Inkpen Quinn,et al.  Privacy gradients: exploring ways to manage incidental information during co-located collaboration , 2005, CHI EA '05.

[25]  Hong Zhou,et al.  User information-seeking behavior in a medical Web portal environment: A preliminary study , 2004, J. Assoc. Inf. Sci. Technol..

[26]  Kori Inkpen Quinn,et al.  Examining the content and privacy of web browsing incidental information , 2006, WWW '06.

[27]  Abigail Sellen,et al.  How knowledge workers use the web , 2002, CHI.

[28]  Christoph Hölscher,et al.  Web search behavior of Internet experts and newbies , 2000, Comput. Networks.

[29]  James E. Pitkow,et al.  Characterizing Browsing Strategies in the World-Wide Web , 1995, Comput. Networks ISDN Syst..

[30]  Robert W. Reeder,et al.  WebEyeMapper and WebLogger: tools for analyzing eye tracking data collected in web-use studies , 2001, CHI Extended Abstracts.

[31]  Stuart K. Card,et al.  A taxonomic analysis of what world wide web activities significantly impact people's decisions and actions , 2001, CHI Extended Abstracts.

[32]  Alexandra I. Cristea,et al.  A WWW Information Seeking Process Model , 2003, J. Educ. Technol. Soc..

[33]  Mark S. Ackerman,et al.  The perfect search engine is not enough: a study of orienteering behavior in directed search , 2004, CHI.

[34]  Kenton O'Hara,et al.  A diary study of information capture in working life , 2000, CHI.

[35]  Joke Kort,et al.  Usage analysis: combining logging and qualitative methods , 2005, CHI EA '05.

[36]  Michael A. Shepherd,et al.  A Goal-based Classification of Web Information Tasks , 2006, ASIST.

[37]  Hartmut Obendorf,et al.  Automatic support for web user studies with SCONE and TEA , 2004, CHI EA '04.

[38]  Nicholas J. Belkin,et al.  Display time as implicit feedback: understanding task effects , 2004, SIGIR '04.

[39]  Soo Young Rieh.  Investigating Web searching behavior in home environments , 2003, ASIST.

[40]  Michael D. Byrne,et al.  The tangled Web we wove: a taskonomy of WWW use , 1999, CHI '99.

[41]  Chang Liu,et al.  Beyond concern - a privacy-trust-behavioral intention model of electronic commerce , 2004, Inf. Manag..

[42]  Amanda Spink,et al.  Searching the Web: the public and their queries , 2001 .

[43]  Susan T. Dumais,et al.  Keeping and re-finding information on the web: What do people do and what do they need? , 2005, ASIST.