Towards Fine-Grained Adaptation of Exploration/Exploitation in Information Retrieval

Lookup and exploratory search tasks can be distinguished using individuals' information search behaviour. Previous work, however, has treated these search tasks as belonging to homogeneous categories, ignoring the specific information needs between users and even between search sessions for the same user. In this work, we avoid this dichotomy by considering each search task to exist on a spectrum between lookup and exploratory. In doing so, our approach aims to dynamically adapt exploration and exploitation in a manner commensurate with the user's individual requirements for each search session. We present a novel study design together with a regression model for predicting the optimal exploration rate based on simple metrics from the first iteration, such as clicks and reading time, that can be collected without special hardware. We perform model selection based on the data collected from a user study and show that predictions are consistent with user feedback.

[1]  Dorota Glowacka,et al.  Directing exploratory search: reinforcement learning from user interactions with keywords , 2013, IUI '13.

[2]  Kevin Li,et al.  Faceted metadata for image search and browsing , 2003, CHI '03.

[3]  P. Grambsch,et al.  A Package for Survival Analysis in S , 1994 .

[4]  Tovi Grossman,et al.  Citeology: visualizing paper genealogy , 2012, CHI EA '12.

[5]  Dorota Glowacka,et al.  Is exploratory search different? A comparison of information search behavior for exploratory and lookup tasks , 2016, J. Assoc. Inf. Sci. Technol..

[6]  Dorota Glowacka,et al.  Beyond Relevance: Adapting Exploration/Exploitation in Information Retrieval , 2016, IUI.

[7]  Stephen E. Robertson,et al.  A probabilistic model of information retrieval: development and comparative experiments - Part 2 , 2000, Inf. Process. Manag..

[8]  Peter Auer,et al.  Using Confidence Bounds for Exploitation-Exploration Trade-offs , 2003, J. Mach. Learn. Res..

[9]  Luanne Freund,et al.  Assigning search tasks designed to elicit exploratory search behaviors , 2012, HCIR '12.

[10]  Filip Radlinski,et al.  Learning diverse rankings with multi-armed bandits , 2008, ICML '08.

[11]  Dorota Glowacka,et al.  Balancing Exploration and Exploitation: Empirical Parameterization of Exploratory Search Systems , 2015, CIKM.

[12]  Ping Wang,et al.  PULP: A System for Exploratory Search of Scientific Literature , 2016, SIGIR.

[13]  Jun Wang,et al.  Interactive exploratory search for multi page search results , 2013, WWW.

[14]  Ben Shneiderman,et al.  From Keyword Search to Exploration: How Result Visualization Aids Discovery on the Web , 2008 .

[15]  Gary Marchionini,et al.  Exploratory search , 2006, Commun. ACM.

[16]  Peter Pirolli,et al.  Information Foraging , 2009, Encyclopedia of Database Systems.

[17]  Dorota Glowacka,et al.  Narrow or Broad?: Estimating Subjective Specificity in Exploratory Search , 2014, CIKM.

[18]  Dorota Glowacka,et al.  Improving Controllability and Predictability of Interactive Recommendation Interfaces for Exploratory Search , 2015, IUI.

[19]  Ryen W. White,et al.  Exploratory Search: Beyond the Query-Response Paradigm , 2009, Exploratory Search: Beyond the Query-Response Paradigm.

[20]  Xin Fu,et al.  Elicitation of term relevance feedback: an investigation of term source and context , 2006, SIGIR.