Effects of Past Interactions on User Experience with Recommended Documents

Recommender systems are commonly used in entertainment, news, e-commerce, and social media. Document recommendation is a new and under-explored application area, in which both re-finding and discovery of documents need to be supported. In this paper we provide an initial exploration of users' experience with recommended documents, with a focus on how prior interactions influence recognition and interest. Through a field study of more than 100 users, we investigate the effects of past interactions with recommended documents on users' recognition of, prior intent to open, and interest in the documents. We examined different presentations of interaction history, and the recency and richness of prior interaction. We found that presentation only influenced recognition time. Our findings also indicate that people are more likely to recognize documents they had accessed recently and to do so more quickly. Similarly, documents that people had interacted with more deeply were also more frequently and quickly recognized. However, people were more interested in older documents or those with which they had less involved interactions. This finding suggests that in addition to helping users quickly access documents they intend to re-find, document recommendation can add value in helping users discover other documents. Our results offer implications for designing document recommendation systems that help users fulfil different needs.

[1]  Jaime Teevan,et al.  Information re-retrieval: repeat queries in Yahoo's logs , 2007, SIGIR.

[2]  Sandeep Tata,et al.  Quick Access: Building a Smart Experience for Google Drive , 2017, KDD.

[3]  Susan T. Dumais,et al.  The Lifetime of Email Messages: A Large-Scale Analysis of Email Revisitation , 2018, CHIIR.

[4]  Rafi Nachmias,et al.  The effect of folder structure on personal file navigation , 2010, J. Assoc. Inf. Sci. Technol..

[5]  Andy Cockburn,et al.  WebView: A Graphical Aid for Revisiting Web Pages , 1999 .

[6]  Greenbergsaul,et al.  How people revisit web pages , 1997 .

[7]  Ana Carolina Lorena,et al.  A Survey on Recommender Systems for News Data , 2010, Smart Information and Knowledge Management.

[8]  Milad Shokouhi,et al.  Exploring User Behavior in Email Re-Finding Tasks , 2019, WWW.

[9]  Jaime Teevan,et al.  Visual snippets: summarizing web pages for search and revisitation , 2009, CHI.

[10]  Vaclav Petricek,et al.  Recommender System for Online Dating Service , 2007, ArXiv.

[11]  Jiahui Liu,et al.  Personalized news recommendation based on click behavior , 2010, IUI '10.

[12]  Saul Greenberg,et al.  How people revisit web pages: empirical findings and implications for the design of history systems , 1997, Int. J. Hum. Comput. Stud..

[13]  Eugene Agichtein,et al.  Understanding Music Listening Intents During Daily Activities with Implications for Contextual Music Recommendation , 2018, CHIIR.

[14]  Qiang Yang,et al.  Matrix Factorization+ for Movie Recommendation , 2016, IJCAI.

[15]  Yoelle Maarek,et al.  How Many Folders Do You Really Need?: Classifying Email into a Handful of Categories , 2014, CIKM.

[16]  Susan T. Dumais,et al.  Stuff I've Seen: A System for Personal Information Retrieval and Re-Use , 2003, SIGF.

[17]  Rafi Nachmias,et al.  Improved search engines and navigation preference in personal information management , 2008, TOIS.

[18]  N. Latha,et al.  Personalized Recommendation Combining User Interest and Social Circle , 2015 .

[19]  Ido Guy,et al.  Personalized recommendation of social software items based on social relations , 2009, RecSys '09.

[20]  Sergei Vassilvitskii,et al.  The dynamics of repeat consumption , 2014, WWW.

[21]  Jianmin Wang,et al.  Will You "Reconsume" the Near Past? Fast Prediction on Short-Term Reconsumption Behaviors , 2015, AAAI.

[22]  Izak Benbasat,et al.  E-Commerce Product Recommendation Agents: Use, Characteristics, and Impact , 2007, MIS Q..

[23]  Paul Covington,et al.  Deep Neural Networks for YouTube Recommendations , 2016, RecSys.

[24]  Ravi Kumar,et al.  Modeling User Consumption Sequences , 2016, WWW.

[25]  M. B. Blake,et al.  Two Decades of Recommender Systems at Amazon.com , 2017 .

[26]  Anoop Gupta,et al.  Supporting Email Workflow , 2001 .

[27]  Farida Karimova,et al.  A Survey of e-Commerce Recommender Systems , 2016 .

[28]  Anthony Tang,et al.  Going with the flow: email awareness and task management , 2006, CSCW '06.

[29]  Chun Chen,et al.  Document recommendation in social tagging services , 2010, WWW '10.

[30]  Junho Choi,et al.  Enhancing user experience with conversational agent for movie recommendation: Effects of self-disclosure and reciprocity , 2017, Int. J. Hum. Comput. Stud..

[31]  Andy Cockburn,et al.  What do web users do? An empirical analysis of web use , 2001, Int. J. Hum. Comput. Stud..

[32]  Susan T. Dumais,et al.  Once found, what then? A study of "keeping" behaviors in the personal use of Web information , 2005, ASIST.

[33]  Sharon M. Gray Looking for Information: A Survey of Research on Information Seeking, Needs, and Behavior. , 2003 .

[34]  Susan T. Dumais,et al.  Searching to eliminate personal information management , 2006, CACM.

[35]  Jaime Teevan,et al.  How people recall, recognize, and reuse search results , 2008, ACM Trans. Inf. Syst..

[36]  Greg Linden,et al.  Two Decades of Recommender Systems at Amazon.com , 2017, IEEE Internet Computing.