Discovery is never by chance: designing for (un)serendipity

Serendipity has a long tradition in the history of science as having played a key role in many significant discoveries. Computer scientists, valuing the role of serendipity in discovery, have attempted to design systems that encourage serendipity. However, that research has focused primarily on only one aspect of serendipity: that of chance encounters. In reality, for serendipity to be valuable chance encounters must be synthesized into insight. In this paper we show, through a formal consideration of serendipity and analysis of how various systems have seized on attributes of interpreting serendipity, that there is a richer space for design to support serendipitous creativity, innovation and discovery than has been tapped to date. We discuss how ideas might be encoded to be shared or discovered by 'association-hunting' agents. We propose considering not only the inventor's role in perceiving serendipity, but also how that inventor's perception may be enhanced to increase the opportunity for serendipity. We explore the role of environment and how we can better enable serendipitous discoveries to find a home more readily and immediately.

[1]  Henry Lieberman,et al.  Letizia: An Agent That Assists Web Browsing , 1995, IJCAI.

[2]  Royston M. Roberts,et al.  Serendipity: Accidental Discoveries in Science , 1989 .

[3]  L. White,et al.  Lateral thinking , 1997, Nature.

[4]  Don R. Swanson,et al.  Complementary structures in disjoint science literatures , 1991, SIGIR '91.

[5]  John Riedl,et al.  Item-based collaborative filtering recommendation algorithms , 2001, WWW '01.

[6]  Roberto C. Delgadillo,et al.  FUTURE HISTORIANS : THEIR QUEST FOR INFORMATION , 1999 .

[7]  Alan J. Dix.  Deconstructing Experience: Pulling Crackers Apart , 2005, Funology.

[8]  Robin D. Burke,et al.  Hybrid Recommender Systems: Survey and Experiments , 2002, User Modeling and User-Adapted Interaction.

[9]  Amanda Spink,et al.  From Highly Relevant to Not Relevant: Examining Different Regions of Relevance , 1998, Inf. Process. Manag..

[10]  Francesina R. Jackson.  Outliers: The Story of Success , 2009 .

[11]  Susan T. Dumais,et al.  Beyond the Commons: Investigating the Value of Personalizing Web Search , 2005 .

[12]  Oscar de Bruijn,et al.  A New Framework for Theory-Based Interaction Design Applied to Serendipitous Information Retrieval , 2008, TCHI.

[13]  P. Andel.  Anatomy of the Unsought Finding. Serendipity: Orgin, History, Domains, Traditions, Appearances, Patterns and Programmability , 1994, The British Journal for the Philosophy of Science.

[15]  E. Wilson,et al.  The Superorganism: The Beauty, Elegance, and Strangeness of Insect Societies , 2008 .

[16]  ErdelezSanda.  Investigation of information encountering in the controlled research environment , 2004 .

[17]  Max L. Wilson,et al.  EPrintCast - A document repository podcast , 2008 .

[18]  Susan T. Dumais,et al.  From x-rays to silly putty via Uranus: serendipity and its role in web search , 2009, CHI.

[19]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[20]  Robert W. Weisberg,et al.  Problem solving and creativity , 1988 .

[21]  Sandra Erdelez.  Information Encountering: It's More Than Just Bumping into Information , 2005 .

[22]  Beverly Yang,et al.  Retroactive answering of search queries , 2006, WWW '06.

[23]  Alfred Kobsa.  User Modeling and User-Adapted Interaction , 2005, User Modeling and User-Adapted Interaction.

[24]  Neil R. Smalheiser,et al.  Implicit Text Linkages between Medline Records: Using Arrowsmith as an Aid to Scientific Discovery , 1999, Libr. Trends.

[25]  José Campos,et al.  Searching the Unsearchable: Inducing Serendipitous Insights , 2001 .

[26]  M A Meyers,et al.  Glen W. Hartman Lecture. Science, creativity, and serendipity. , 1995, AJR. American journal of roentgenology.

[27]  Ronald E. Rice,et al.  Accessing and Browsing Information and Communication , 2001 .

[28]  Nigel Ford,et al.  Information retrieval and creativity: towards support for the original thinker , 1999, J. Documentation.

[29]  Russell Beale,et al.  Supporting serendipity: Using ambient intelligence to augment user exploration for data mining and web browsing , 2007, Int. J. Hum. Comput. Stud..

[30]  Sean M. McNee,et al.  Improving recommendation lists through topic diversification , 2005, WWW '05.

[31]  Alan G. Robinson,et al.  Corporate Creativity: How Innovation and Improvement Actually Happen , 1997 .

[32]  Alexander Kohn,et al.  Fortune or Failure: Missed Opportunities and Chance Discoveries , 1989 .

[33]  S. Russ.  Affect and Creativity: the Role of Affect and Play in the Creative Process , 1993 .

[34]  Roni Reiter-Palmon,et al.  Encyclopedia of Creativity , 2011 .

[35]  Klaus-Peter Zauner,et al.  Robot control with biological cells , 2007, Biosyst..

[36]  Brian Vandenberg,et al.  Play, problem‐solving, and creativity , 1980 .

[37]  Sanda Erdelez,et al.  Investigation of information encountering in the controlled research environment , 2004, Inf. Process. Manag..

[38]  Gary Marchionini,et al.  Finding facts vs. browsing knowledge in hypertext systems , 1988, Computer.

[39]  Jonathan L. Herlocker,et al.  Evaluating collaborative filtering recommender systems , 2004, TOIS.

[40]  H. Zollinger.  Color chemistry: Syntheses, properties, and applications of organic dyes and pigments , 1987 .

[41]  ChengXiang Zhai,et al.  Implicit user modeling for personalized search , 2005, CIKM '05.

[42]  J. H. Comroe,et al.  Retrospectroscope: Insights into Medical Discovery , 1977 .

[43]  Nigel Ford,et al.  Serendipity and information seeking: an empirical study , 2003, J. Documentation.