Effect of task on time spent reading as an implicit measure of interest

Information Filtering systems learn user preferences either through explicit or implicit feedback. However, requiring users to explicitly rate items as part of the interface interaction can place a large burden on the user. Implicit feedback removes the burden of explicit user ratings by transparently monitoring user behavior such as time spent reading, mouse movements and scrolling behavior. Previous research has shown that task may have an impact on the effectiveness of some implicit measures. In this work we report both qualitative and quantitative results of an initial study examining the relationship between user time spent reading and relevance for three web search tasks: relevance judgment, simple question answering and complex question answering. This study indicates that the usefulness of time spent as a measure of user interest is related to task and is more useful for more complex web search tasks. Future directions for this research are presented.

[1]  Stuart E. Middleton,et al.  Capturing interest through inference and visualization: ontological user profiling in recommender systems , 2003, K-CAP '03.

[2]  Yoshinori Hijikata,et al.  Implicit user profiling for on demand relevance feedback , 2004, IUI '04.

[3]  Yoichi Shinoda,et al.  Information filtering based on user behavior analysis and best match text retrieval , 1994, SIGIR '94.

[4]  Jaime Teevan,et al.  Implicit feedback for inferring user preference: a bibliography , 2003, SIGF.

[5]  Jude W. Shavlik,et al.  Learning users' interests by unobtrusively observing their normal behavior , 2000, IUI '00.

[6]  Bill N. Schilit,et al.  From reading to retrieval: freeform ink annotations as queries , 1999, SIGIR '99.

[7]  Douglas W. Oard,et al.  User Modeling for Information Access Based on Implicit Feedback , 2000 .

[8]  Mary Beth Rosson,et al.  An empirical study of Web personalization assistants supporting end-users in Web information systems , 2002, Proceedings IEEE 2002 Symposia on Human Centric Computing Languages and Environments.

[9]  Nicholas J. Belkin,et al.  Reading time, scrolling and interaction: exploring implicit sources of user preferences for relevance feedback , 2001, Annual International ACM SIGIR Conference on Research and Development in Information Retrieval.

[10]  David M. Nichols,et al.  Implicit Rating and Filtering , 1998 .

[11]  Ryen W. White,et al.  The Use of Implicit Evidence for Relevance Feedback in Web Retrieval , 2002, ECIR.

[12]  Mark Claypool,et al.  Implicit interest indicators , 2001, IUI '01.

[13]  Bradley N. Miller,et al.  GroupLens: applying collaborative filtering to Usenet news , 1997, CACM.

[14]  Douglas W. Oard,et al.  Modeling Information Content Using Observable Behavior , 2001 .

[15]  Young-Woo Seo,et al.  Learning user's preferences by analyzing Web-browsing behaviors , 2000, AGENTS '00.