Contextual factors for finding similar experts

Expertise-seeking research studies how people search for expertise and choose whom to contact in the context of a specific task. An important outcome are models that identify factors that influence expert finding. Expertise retrieval addresses the same problem, expert finding, but from a system-centered perspective. The main focus has been on developing content-based algorithms similar to document search. These algorithms identify matching experts primarily on the basis of the textual content of documents with which experts are associated. Other factors, such as the ones identified by expertise-seeking models, are rarely taken into account. In this article, we extend content-based expert-finding approaches with contextual factors that have been found to influence human expert finding. We focus on a task of science communicators in a knowledge-intensive environment, the task of finding similar experts, given an example expert. Our approach combines expertise-seeking and retrieval research. First, we conduct a user study to identify contextual factors that may play a role in the studied task and environment. Then, we design expert retrieval models to capture these factors. We combine these with content-based retrieval models and evaluate them in a retrieval experiment. Our main finding is that while content-based features are the most important, human participants also take contextual factors into account, such as media experience and organizational structure. We develop two principled ways of modeling the identified factors and integrate them with contentbased retrieval models. Our experiments show that models combining content-based and contextual factors can significantly outperform existing content-based models.

[1]  Kate Ehrlich,et al.  Searching for experts in the enterprise: combining text and social network analysis , 2007, GROUP.

[2]  Kalervo Järvelin,et al.  Task Complexity Affects Information Seeking and Use , 1995, Inf. Process. Manag..

[3]  Thomas H. Davenport,et al.  Book review:Working knowledge: How organizations manage what they know. Thomas H. Davenport and Laurence Prusak. Harvard Business School Press, 1998. $29.95US. ISBN 0‐87584‐655‐6 , 1998 .

[4]  K. Wiig Knowledge management: Where did it come from and where will it go? , 1997 .

[5]  Djoerd Hiemstra,et al.  Being Omnipresent To Be Almighty: The Importance of The Global Web Evidence for Organizational Expert Finding , 2008 .

[6]  Einat Amitay einat Finding People and Documents, Using Web 2.0 Data , 2008 .

[7]  Jeonghyun Kim Describing and predicting information-seeking behavior on the Web , 2009 .

[8]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[9]  Kate Ehrlich,et al.  Pick me!: link selection in expertise search results , 2008, CHI.

[10]  Morten Hertzum,et al.  People as carriers of experience and sources of commitment: information seeking in a software design project , 2000 .

[11]  Ling Xia,et al.  That's what friends are for: facilitating 'who knows what' across group boundaries , 2007, GROUP.

[12]  Miriam J. Metzger Making sense of credibility on the Web: Models for evaluating online information and recommendations for future research , 2007, J. Assoc. Inf. Sci. Technol..

[13]  Nick Craswell,et al.  Overview of the TREC 2006 Enterprise Track , 2006, TREC.

[14]  Krisztian Balog,et al.  Integrating contextual factors into topic-centric retrieval models for finding similar experts , 2008 .

[15]  Wendy A. Kellogg,et al.  Social translucence: an approach to designing systems that support social processes , 2000, TCHI.

[16]  Bart van den Hooff,et al.  Inside the source selection process: Selection criteria for human information sources , 2008, Inf. Process. Manag..

[17]  Alfred Kobsa,et al.  DEMOIR: a hybrid architecture for expertise modeling and recommender systems , 2000, Proceedings IEEE 9th International Workshops on Enabling Technologies: Infrastructure for Collaborative Enterprises (WET ICE 2000).

[18]  David W. McDonald,et al.  Social matching: A framework and research agenda , 2005, TCHI.

[19]  M. de Rijke,et al.  Combining Candidate and Document Models for Expert Search , 2008, TREC.

[20]  Donna Harman,et al.  The Second Text Retrieval Conference (TREC-2) , 1995, Inf. Process. Manag..

[21]  Toine Bogers,et al.  Design and Evaluation of a University-Wide Expert Search Engine , 2009, ECIR.

[22]  M. de Rijke,et al.  A language modeling framework for expert finding , 2009, Inf. Process. Manag..

[23]  Mark S. Ackerman,et al.  Collaborative Support for Informal Information in Collective Memory Systems , 2000, Inf. Syst. Frontiers.

[24]  Geneva G. Belford,et al.  Multi-aspect expertise matching for review assignment , 2008, CIKM '08.

[25]  M. de Rijke,et al.  Broad expertise retrieval in sparse data environments , 2007, SIGIR.

[26]  Pertti Vakkari,et al.  Changes in Search Tactics and Relevance Judgements when Preparing a Research Proposal A Summary of the Findings of a Longitudinal Study , 2001, Information Retrieval.

[27]  Kate Ehrlich,et al.  Searching for expertise , 2008, CHI.

[28]  S. Kiesler,et al.  The kindness of strangers: on the usefulness of electronic weak ties for technical advice , 1996 .

[29]  Diane Kelly,et al.  Measuring online information seeking context, Part 1: Background and method , 2006, J. Assoc. Inf. Sci. Technol..

[30]  Jaana Kekäläinen,et al.  Cumulated gain-based evaluation of IR techniques , 2002, TOIS.

[31]  Amanda Spink,et al.  Issues of context in information retrieval (IR): an introduction to the special issue , 2002, Inf. Process. Manag..

[32]  M. de Rijke,et al.  Formal models for expert finding in enterprise corpora , 2006, SIGIR.

[33]  Victor Rosenberg Factors affecting the preferences of industrial personnel for information gathering methods , 1967, Inf. Storage Retr..

[34]  Peter Bailey,et al.  Overview of the TREC 2008 Enterprise Track , 2008, TREC.

[35]  Enrico Motta,et al.  Person to person trust factors in word of mouth recommendation , 2006 .

[36]  Rob Cross,et al.  A Relational View of Information Seeking and Learning in Social Networks , 2003, Manag. Sci..

[37]  Edward A. Fox,et al.  Combination of Multiple Searches , 1993, TREC.

[38]  Jonathan L. Herlocker,et al.  Evaluating collaborative filtering recommender systems , 2004, TOIS.

[39]  Jiepu Jiang Expertise Retrieval Using Search Engine Results , 2008 .

[40]  Roger S. White,et al.  Working Knowledge: How Organizations Manage What They Know , 2001 .

[41]  Peter Bailey,et al.  The CSIRO enterprise search test collection , 2007, SIGF.

[42]  M. de Rijke,et al.  PodCred: a framework for analyzing podcast preference , 2008, WICOW '08.

[43]  Peter Ingwersen,et al.  The Turn - Integration of Information Seeking and Retrieval in Context , 2005, The Kluwer International Series on Information Retrieval.

[44]  M. de Rijke,et al.  Credibility Improves Topical Blog Post Retrieval , 2008, ACL.

[45]  Ryen W. White,et al.  Enhancing Expert Finding Using Organizational Hierarchies , 2009, ECIR.

[46]  Peter Bailey,et al.  Overview of the TREC 2007 Enterprise Track , 2007, TREC.

[47]  Djoerd Hiemstra,et al.  Modeling multi-step relevance propagation for expert finding , 2008, CIKM '08.

[48]  M. de Rijke,et al.  Finding similar experts , 2007, SIGIR.

[49]  Krisztian Balog,et al.  People search in the enterprise , 2007, SIGF.

[50]  Jano Moreira de Souza,et al.  Competence mining for team formation and virtual community recommendation , 2005, Proceedings of the Ninth International Conference on Computer Supported Cooperative Work in Design, 2005..