Fostering serendipity in online information systems

Serendipity, the process of making fortunate discoveries for which someone was not looking for, plays a critical role in leveraging creativity and innovation. In this paper we propose a framework for facilitating serendipity in web information systems. We focus on three main technological areas which use the World Wide Web as a space for information seeking and knowledge creation: search, browse (navigation) and recommender systems. We argue that there are five factors that, individually and jointly, facilitate serendipity: novelty (or unexpectedness); diversity; personalization; visualization; and social collaboration. The paper reviews methods and techniques for each factor in each of the three technological areas and argues for a research agenda that addresses them in an effort to foster surprising discoveries and creative insights in the online world.

[1]  Sophie Ahrens,et al.  Recommender Systems , 2012 .

[2]  Christian Fuchs,et al.  Towards a dynamic theory of virtual communities , 2007, Int. J. Knowl. Learn..

[3]  Lennart Björneborn,et al.  Design Dimensions Enabling Divergent Behaviour across Physical, Digital, and Social Library Interfaces , 2010, PERSUASIVE.

[4]  Wolfgang Nejdl,et al.  Increasing Diversity in Web Search Results , 2010 .

[5]  Yunjie Xu,et al.  Novelty and topicality in interactive information retrieval , 2008 .

[6]  Henry Lieberman,et al.  Letizia: An Agent That Assists Web Browsing , 1995, IJCAI.

[7]  Yi Zhang,et al.  Novelty and redundancy detection in adaptive filtering , 2002, SIGIR '02.

[8]  Victoria L. Rubin,et al.  Promoting serendipity online: recommendations for tool design , 2012, iConference '12.

[9]  Shogo Nishida,et al.  Discovery-oriented collaborative filtering for improving user satisfaction , 2009, IUI.

[10]  José Campos,et al.  Searching the Unsearchable: Inducing Serendipitous Insights , 2001 .

[11]  Craig MacDonald,et al.  Exploiting query reformulations for web search result diversification , 2010, WWW '10.

[12]  Jonathan L. Herlocker,et al.  Evaluating collaborative filtering recommender systems , 2004, TOIS.

[13]  Takahira Yamaguchi,et al.  Implementing an Image Search System with Integrating Social Tags and DBpedia , 2010, KES.

[14]  David E. Meyer,et al.  Demystification of cognitive insight: Opportunistic assimilation and the prepared-mind hypothesis , 1994 .

[15]  Michael S. Bernstein,et al.  Short and tweet: experiments on recommending content from information streams , 2010, CHI.

[16]  Susan T. Dumais,et al.  From x-rays to silly putty via Uranus: serendipity and its role in web search , 2009, CHI.

[17]  Fabrizio Silvestri,et al.  Efficient Diversification of Web Search Results , 2011, Proc. VLDB Endow..

[18]  Paul Resnick,et al.  Recommender systems , 1997, CACM.

[19]  Panagiotis Adamopoulos,et al.  On Unexpectedness in Recommender Systems: Or How to Expect the Unexpected , 2011, DiveRS@RecSys.

[20]  Miguel Pina e Cunha,et al.  Serendipity: Why Some Organizations are Luckier than Others , 2005 .

[21]  Mark Levene,et al.  An Introduction to Search Engines and Web Navigation (2. ed.) , 2005 .

[22]  Ricky W. Griffin,et al.  Toward a Theory of Organizational Creativity , 1993 .

[23]  Susan T. Dumais,et al.  Discovery is never by chance: designing for (un)serendipity , 2009, C&C '09.

[24]  Sean M. McNee,et al.  Improving recommendation lists through topic diversification , 2005, WWW '05.

[25]  Elaine Toms,et al.  Measuring the dimensions of serendipity in digital environments , 2011, Inf. Res..

[26]  Takayuki Akiyama,et al.  Proposal and Evaluation of Serendipitous Recommendation Method Using General Unexpectedness , 2010, PRSAT@RecSys.

[27]  Oren Etzioni,et al.  Grouper: A Dynamic Clustering Interface to Web Search Results , 1999, Comput. Networks.

[28]  Christian Wolff,et al.  The Many Ways of Searching the Web Together : A Comparison of Social Search Engines , 2012 .

[29]  Cong Yu,et al.  It takes variety to make a world: diversification in recommender systems , 2009, EDBT '09.

[30]  Kerstin Denecke,et al.  Chapter 6 Diversity-Aware Search: New Possibilities and Challenges for Web Search , 2012 .

[31]  Sahin Albayrak,et al.  Increasing Diversity Through Furthest Neighbor-Based Recommendation , 2012 .

[32]  Teresa M. Amabile,et al.  Creativity and Innovation in Organizations , 1996 .

[33]  Stefan Siersdorfer,et al.  Social recommender systems for web 2.0 folksonomies , 2009, HT '09.

[34]  Russell Beale,et al.  Supporting serendipity: Using ambient intelligence to augment user exploration for data mining and web browsing , 2007, Int. J. Hum. Comput. Stud..

[35]  Dirk Lewandowski Web Search Engine Research , 2012 .

[36]  Kenneth A. Cory Discovering Hidden Analogies in an Online Humanities Database , 1999, Libr. Trends.

[37]  Elaine Toms,et al.  The process of serendipity in knowledge work , 2010, IIiX.

[38]  Nigel Ford,et al.  Serendipity and information seeking: an empirical study , 2003, J. Documentation.

[39]  Ido Guy,et al.  Social Recommendation Based on a Rich Aggregation Model , 2012, Recommender Systems for the Social Web.

[40]  Ryohei Orihara,et al.  Metrics for Evaluating the Serendipity of Recommendation Lists , 2007, JSAI.

[41]  Amanda Spink,et al.  From Highly Relevant to Not Relevant: Examining Different Regions of Relevance , 1998, Inf. Process. Manag..

[42]  Meng Yang,et al.  Social bookmarking and exploratory search , 2007, ECSCW.

[43]  Tobias Höllerer,et al.  TopicLens : An Interactive Recommender System based on Topical and Social Connections , 2012 .

[44]  Russell Beale,et al.  Visualising sequences of queries: a new tool for information retrieval , 1997, Proceedings. 1997 IEEE Conference on Information Visualization (Cat. No.97TB100165).

[45]  Charles L. A. Clarke,et al.  Novelty and diversity in information retrieval evaluation , 2008, SIGIR '08.

[46]  Mouzhi Ge,et al.  Beyond accuracy: evaluating recommender systems by coverage and serendipity , 2010, RecSys '10.

[47]  Gerhard Fischer,et al.  Social creativity: turning barriers into opportunities for collaborative design , 2004, PDC 04.

[48]  Stewart Clegg,et al.  On serendipity and organizing , 2010 .

[49]  Robert J. Sandusky Accessing and browsing information and communication , 2002, J. Assoc. Inf. Sci. Technol..

[50]  M. Boden Dimensions of creativity , 1996 .

[51]  Pasquale Lops,et al.  Introducing Serendipity in a Content-Based Recommender System , 2008, 2008 Eighth International Conference on Hybrid Intelligent Systems.

[52]  Wolfgang Nejdl,et al.  Current Approaches to Search Result Diversification , 2009, LivingWeb@ISWC.

[53]  Michael S. Bernstein,et al.  Eddi: interactive topic-based browsing of social status streams , 2010, UIST.

[54]  Jade Goldstein-Stewart,et al.  The use of MMR, diversity-based reranking for reordering documents and producing summaries , 1998, SIGIR '98.

[55]  Pablo Castells,et al.  Personalized diversification of search results , 2012, SIGIR '12.