Integrating contextual factors into topic-centric retrieval models for finding similar experts

Expert finding has been addressed from multiple viewpoints, including expertise seeking and expert retrieval. The focus of expertise seeking has mostly been on descriptive or predictive models, for example to identify what factors affect human decisions on locating and selecting experts. In expert retrieval the focus has been on algorithms similar to document search, which identify topical matches based on the content of documents associated with experts. We report on a pilot study on an expert finding task in which we explore how contextual factors identified by expertise seeking models can be integrated with topic-centric retrieval algorithms and examine whether they can improve retrieval performance for this task. We focus on the task of similar expert finding: given a small number of example experts, find similar experts. Our main finding is that, while topical knowledge is the most important factor, human subjects also consider other factors, such as reliability, up-to-dateness, and organizational structure. We find that integrating these factors into topical retrieval models can significantly improve retrieval performance.

[1]  Bart van den Hooff,et al.  Inside the source selection process: Selection criteria for human information sources , 2008, Inf. Process. Manag..

[2]  Kate Ehrlich,et al.  Pick me!: link selection in expertise search results , 2008, CHI.

[3]  Kate Ehrlich,et al.  Searching for expertise , 2008, CHI.

[4]  Peter Bailey,et al.  The CSIRO enterprise search test collection , 2007, SIGF.

[5]  Kate Ehrlich,et al.  Searching for experts in the enterprise: combining text and social network analysis , 2007, GROUP.

[6]  Ling Xia,et al.  That's what friends are for: facilitating 'who knows what' across group boundaries , 2007, GROUP.

[7]  M. de Rijke,et al.  Finding similar experts , 2007, SIGIR.

[8]  M. de Rijke,et al.  Broad expertise retrieval in sparse data environments , 2007, SIGIR.

[9]  M. de Rijke,et al.  Formal models for expert finding in enterprise corpora , 2006, SIGIR.

[10]  David W. McDonald,et al.  Social matching: A framework and research agenda , 2005, TCHI.

[11]  Rob Cross,et al.  A Relational View of Information Seeking and Learning in Social Networks , 2003, Manag. Sci..

[12]  Jaana Kekäläinen,et al.  Cumulated gain-based evaluation of IR techniques , 2002, TOIS.

[13]  Mark S. Ackerman,et al.  Collaborative Support for Informal Information in Collective Memory Systems , 2000, Inf. Syst. Frontiers.

[14]  Wendy A. Kellogg,et al.  Social translucence: an approach to designing systems that support social processes , 2000, TCHI.

[15]  Enrico Motta,et al.  Person to person trust factors in word of mouth recommendation , 2006 .

[16]  Jonathan L. Herlocker,et al.  Evaluating collaborative filtering recommender systems , 2004, TOIS.

[17]  Edward A. Fox,et al.  Combination of Multiple Searches , 1993, TREC.