Contextual factors for finding similar experts

Expertise-seeking research studies how people search for expertise and choose whom to contact in the context of a specific task. An important outcome are models that identify factors that influence expert finding. Expertise retrieval addresses the same problem, expert finding, but from a system-centered perspective. The main focus has been on developing content-based algorithms similar to document search. These algorithms identify matching experts primarily on the basis of the textual content of documents with which experts are associated. Other factors, such as the ones identified by expertise-seeking models, are rarely taken into account. In this article, we extend content-based expert-finding approaches with contextual factors that have been found to influence human expert finding. We focus on a task of science communicators in a knowledge-intensive environment, the task of finding similar experts, given an example expert. Our approach combines expertise-seeking and retrieval research. First, we conduct a user study to identify contextual factors that may play a role in the studied task and environment. Then, we design expert retrieval models to capture these factors. We combine these with content-based retrieval models and evaluate them in a retrieval experiment. Our main finding is that while content-based features are the most important, human participants also take contextual factors into account, such as media experience and organizational structure. We develop two principled ways of modeling the identified factors and integrate them with content-based retrieval models. Our experiments show that models combining content-based and contextual factors can significantly outperform existing content-based models. © 2010 Wiley Periodicals, Inc. This is an expanded and revised version of Hofmann, Balog, Bogers, & de Rijke, [2008].

[1]  Bart van den Hooff,et al.  Inside the source selection process: Selection criteria for human information sources , 2008, Inf. Process. Manag..

[2]  David W. McDonald,et al.  Social matching: A framework and research agenda , 2005, TCHI.

[3]  Rob Cross,et al.  A Relational View of Information Seeking and Learning in Social Networks , 2003, Manag. Sci..

[4]  Kate Ehrlich,et al.  Pick me!: link selection in expertise search results , 2008, CHI.

[5]  Morten Hertzum,et al.  People as carriers of experience and sources of commitment: information seeking in a software design project , 2000 .

[6]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[7]  Peter Bailey,et al.  Overview of the TREC 2007 Enterprise Track , 2007, TREC.

[8]  Krisztian Balog,et al.  Integrating contextual factors into topic-centric retrieval models for finding similar experts , 2008 .

[9]  Nick Craswell,et al.  Overview of the TREC 2006 Enterprise Track , 2006, TREC.

[10]  Djoerd Hiemstra,et al.  Modeling multi-step relevance propagation for expert finding , 2008, CIKM '08.

[11]  Krisztian Balog,et al.  People search in the enterprise , 2007, SIGIR.

[12]  M. de Rijke,et al.  Finding similar experts , 2007, SIGIR.

[13]  Jeonghyun Kim Describing and predicting information-seeking behavior on the Web , 2009 .

[14]  Toine Bogers,et al.  Design and Evaluation of a University-Wide Expert Search Engine , 2009, ECIR.

[15]  M. de Rijke,et al.  A language modeling framework for expert finding , 2009, Inf. Process. Manag..

[16]  Jaana Kekäläinen,et al.  Cumulated gain-based evaluation of IR techniques , 2002, TOIS.

[17]  Amanda Spink,et al.  Issues of context in information retrieval (IR): an introduction to the special issue , 2002, Inf. Process. Manag..

[18]  Jano Moreira de Souza,et al.  Competence mining for team formation and virtual community recommendation , 2005, Proceedings of the Ninth International Conference on Computer Supported Cooperative Work in Design, 2005..

[19]  Edward A. Fox,et al.  Combination of Multiple Searches , 1993, TREC.

[20]  Peter Bailey,et al.  The CSIRO enterprise search test collection , 2007, SIGF.

[21]  Peter Ingwersen,et al.  The Turn - Integration of Information Seeking and Retrieval in Context , 2005, The Kluwer International Series on Information Retrieval.

[22]  Geneva G. Belford,et al.  Multi-aspect expertise matching for review assignment , 2008, CIKM '08.

[23]  M. de Rijke,et al.  Broad expertise retrieval in sparse data environments , 2007, SIGIR.

[24]  Pertti Vakkari,et al.  Changes in Search Tactics and Relevance Judgements when Preparing a Research Proposal A Summary of the Findings of a Longitudinal Study , 2001, Information Retrieval.

[25]  Thomas H. Davenport,et al.  Book review:Working knowledge: How organizations manage what they know. Thomas H. Davenport and Laurence Prusak. Harvard Business School Press, 1998. $29.95US. ISBN 0‐87584‐655‐6 , 1998 .

[26]  Kate Ehrlich,et al.  Searching for expertise , 2008, CHI.

[27]  S. Kiesler,et al.  The kindness of strangers: on the usefulness of electronic weak ties for technical advice , 1996 .

[28]  Jonathan L. Herlocker,et al.  Evaluating collaborative filtering recommender systems , 2004, TOIS.

[29]  Kate Ehrlich,et al.  Searching for experts in the enterprise: combining text and social network analysis , 2007, GROUP.

[30]  Alfred Kobsa,et al.  DEMOIR: a hybrid architecture for expertise modeling and recommender systems , 2000, Proceedings IEEE 9th International Workshops on Enabling Technologies: Infrastructure for Collaborative Enterprises (WET ICE 2000).

[31]  M. de Rijke,et al.  Combining Candidate and Document Models for Expert Search , 2008, TREC.

[32]  Ling Xia,et al.  That's what friends are for: facilitating 'who knows what' across group boundaries , 2007, GROUP.

[33]  Ryen W. White,et al.  Enhancing Expert Finding Using Organizational Hierarchies , 2009, ECIR.

[34]  K. Wiig Knowledge management: Where did it come from and where will it go? , 1997 .

[35]  Wendy A. Kellogg,et al.  Social translucence: an approach to designing systems that support social processes , 2000, TCHI.

[36]  M. de Rijke,et al.  Formal models for expert finding in enterprise corpora , 2006, SIGIR.

[37]  Victor Rosenberg Factors affecting the preferences of industrial personnel for information gathering methods , 1967, Inf. Storage Retr..

[38]  Peter Bailey,et al.  Overview of the TREC 2008 Enterprise Track , 2008, TREC.

[39]  Enrico Motta,et al.  Person to person trust factors in word of mouth recommendation , 2006 .

[40]  M. de Rijke,et al.  Credibility Improves Topical Blog Post Retrieval , 2008, ACL.

[41]  Diane Kelly Measuring online information seeking context, Part 1: Background and method , 2006 .

[42]  M. de Rijke,et al.  PodCred: a framework for analyzing podcast preference , 2008, WICOW '08.

[43]  Kalervo Järvelin,et al.  Task complexity affects information seeking and use , 1995 .

[44]  Miriam J. Metzger Making sense of credibility on the Web: Models for evaluating online information and recommendations for future research , 2007 .

[45]  Mark S. Ackerman,et al.  Collaborative Support for Informal Information in Collective Memory Systems , 2000, Inf. Syst. Frontiers.