Towards Humane Feedback Mechanisms in Exploratory Search

Machine learning (ML) plays a central role in modern information retrieval (IR) systems. We argue that, in IR systems for multi-session exploratory search, there are unexploited opportunities for IR document ranking models to leverage users’ knowledge about the search task to better support users’ search needs. Specifically, we propose a method to enable users to adapt an IR document ranking model according to their information needs, using an interface that supports search strategies and methods for engaging with documents known to be useful when people explore new or complex domains of knowledge. We also discuss the major challenges in creating human-centered machine learning models and interfaces for exploratory search.

[1]  Jaime Teevan,et al.  Implicit feedback for inferring user preference: a bibliography , 2003, SIGF.

[2]  Burr Settles,et al.  Closing the Loop: Fast, Interactive Semi-Supervised Annotation With Queries on Features and Instances , 2011, EMNLP.

[3]  Simon DeDeo,et al.  Exploration and exploitation of Victorian science in Darwin’s reading notebooks , 2015, Cognition.

[4]  Bradley C. Love,et al.  Exploration in the wild , 2018 .

[5]  Mounia Lalmas,et al.  A survey on the use of relevance feedback for information access systems , 2003, The Knowledge Engineering Review.

[6]  Vannevar Bush,et al.  As we may think , 1945, INTR.

[7]  Bret Victor,et al.  Humane representation of thought: a trail map for the 21st century , 2014, UIST.

[8]  Bill N. Schilit,et al.  From reading to retrieval: freeform ink annotations as queries , 1999, SIGIR '99.

[9]  Sanjoy Dasgupta,et al.  Learning with Feature Feedback: from Theory to Practice , 2017, AISTATS.

[10]  Tie-Yan Liu,et al.  Learning to rank for information retrieval , 2009, SIGIR.

[11]  Sally Jo Cunningham,et al.  Annotations in an Academic Digital Library: The Case of Conference Note-Taking and Annotation , 2005, ICADL.

[12]  悠太 菊池,et al.  大規模要約資源としてのNew York Times Annotated Corpus , 2015 .

[13]  Gerard Salton,et al.  Improving retrieval performance by relevance feedback , 1997, J. Am. Soc. Inf. Sci..

[14]  D. C. Englebart,et al.  Augmenting human intellect: a conceptual framework , 1962 .

[15]  Amanda Spink,et al.  Use of query reformulation and relevance feedback by Excite users , 2000, Internet Res..