Revisiting IR Techniques for Collaborative Search Strategies

This paper revisits some of the established Information Retrieval (IR) techniques to investigate effective collaborative search strategies. We devised eight search strategies that divided labour and shared knowledge in teams using relevance feedback and clustering. We evaluated the performance of strategies with a user simulation enhanced by a query-pooling method. Our results show that relevance feedback is successful at formulating effective collaborative strategies while further effort is needed for clustering. We also measured the extent to which additional members improved the performance and an effect of search progress on the improvement.

[1]  Joemon M. Jose,et al.  Comparing collaborative and independent search in a recall-oriented task , 2008, IIiX.

[2]  Eric Horvitz,et al.  SearchTogether: an interface for collaborative web search , 2007, UIST.

[3]  Robert Villa,et al.  A study of awareness in multimedia search , 2008, JCDL '08.

[4]  Mark Magennis,et al.  The potential and actual effectiveness of interactive query expansion , 1997, SIGIR '97.

[5]  James Allan,et al.  Evaluation over thousands of queries , 2008, SIGIR '08.

[6]  Iadh Ounis,et al.  Research directions in Terrier: a search engine for advanced retrieval on the Web , 2007 .

[7]  Barry Smyth,et al.  A Live-User Evaluation of Collaborative Web Search , 2005, IJCAI.

[8]  Alan F. Smeaton,et al.  Collaborative video searching on a tabletop , 2007, Multimedia Systems.

[9]  Ryen W. White,et al.  A Simulated Study of Implicit Feedback Models , 2004, ECIR.

[10]  Ian Ruthven,et al.  Re-examining the potential effectiveness of interactive query expansion , 2003, SIGIR.

[11]  Oren Etzioni,et al.  Grouper: A Dynamic Clustering Interface to Web Search Results , 1999, Comput. Networks.

[12]  Chirag Shah,et al.  Algorithmic mediation for collaborative exploratory search , 2008, SIGIR '08.

[13]  Peter Ingwersen,et al.  Developing a Test Collection for the Evaluation of Integrated Search , 2010, ECIR.

[14]  James Allan,et al.  HARD Track Overview in TREC 2003: High Accuracy Retrieval from Documents , 2003, TREC.

[15]  W. Bruce Croft,et al.  Predicting query performance , 2002, SIGIR '02.

[16]  Robert Villa,et al.  The effectiveness of query-specific hierarchic clustering in information retrieval , 2002, Inf. Process. Manag..

[17]  Paul Dourish,et al.  Awareness and coordination in shared workspaces , 1992, CSCW '92.

[18]  Makoto Iwayama,et al.  Relevance feedback with a small number of relevance judgements: incremental relevance feedback vs. document clustering , 2000, SIGIR '00.

[19]  Preben Hansen,et al.  Collaborative Information Retrieval in an information-intensive domain , 2005, Inf. Process. Manag..