Expertise Retrieval

People have looked for experts since before the advent of computers. With advances in information retrieval technology and the large-scale availability of digital traces of knowledge-related activities, computer systems that can fully automate the process of locating expertise have become a reality. The past decade has witnessed tremendous interest, and a wealth of results, in expertise retrieval as an emerging subdiscipline in information retrieval. This survey highlights advances in models and algorithms relevant to this field. We draw connections among methods proposed in the literature and summarize them in five groups of basic approaches. These serve as the building blocks for more advanced models that arise when we consider a range of content-based factors that may impact the strength of association between a topic and a person. We also discuss practical aspects of building an expert search system and present applications of the technology in other domains, such as blog distillation and entity retrieval. The limitations of current approaches are also pointed out. We end our survey with a set of conjectures on what the future may hold for expertise retrieval research.

[1]  Craig MacDonald,et al.  High Quality Expertise Evidence for Expert Search , 2008, ECIR.

[2]  Djoerd Hiemstra,et al.  Structured Document Retrieval, Multimedia Retrieval, and Entity Ranking Using PF/Tijah , 2008, INEX.

[3]  Andrew McCallum,et al.  An Introduction to Conditional Random Fields for Relational Learning , 2007 .

[4]  Roi Blanco,et al.  Evaluating ad-hoc object retrieval , 2010, IWEST@ISWC.

[5]  Craig MacDonald,et al.  The influence of the document ranking in expert search , 2009, CIKM.

[6]  Upendra Dave,et al.  Applied Probability and Queues , 1987 .

[7]  W. Bruce Croft,et al.  Proximity-based document representation for named entity retrieval , 2007, CIKM '07.

[8]  Ryen W. White,et al.  Enhancing Expert Finding Using Organizational Hierarchies , 2009, ECIR.

[9]  Stefan M. Rüger,et al.  Integrating Document Features for Entity Ranking , 2008, INEX.

[10]  James A. Thom,et al.  Exploiting Locality of Wikipedia Links in Entity Ranking , 2008, ECIR.

[11]  Luo Si,et al.  Discriminative models of integrating document evidence and document-candidate associations for expert search , 2010, SIGIR '10.

[12]  M. de Rijke,et al.  Determining Expert Profiles (With an Application to Expert Finding) , 2007, IJCAI.

[13]  Paul P. Maglio,et al.  Expertise identification using email communications , 2003, CIKM '03.

[14]  Alfred V. Aho,et al.  Efficient string matching , 1975, Commun. ACM.

[15]  Peter Bailey,et al.  Overview of the TREC 2007 Enterprise Track , 2007, TREC.

[16]  David Hawking,et al.  Overview of the TREC 2003 Web Track , 2003, TREC.

[17]  Luo Si,et al.  Identifying similar people in professional social networks with discriminative probabilistic models , 2011, SIGIR.

[18]  Bart van den Hooff,et al.  Inside the source selection process: Selection criteria for human information sources , 2008, Inf. Process. Manag..

[19]  David W. McDonald,et al.  Social matching: A framework and research agenda , 2005, TCHI.

[20]  Jimeng Sun,et al.  Social influence analysis in large-scale networks , 2009, KDD.

[21]  Lada A. Adamic,et al.  Knowledge sharing and yahoo answers: everyone knows something , 2008, WWW.

[22]  Christoph Meinel,et al.  Telling experts from spammers: expertise ranking in folksonomies , 2009, SIGIR.

[23]  Yi Zhang,et al.  Graph-based ranking algorithms for e-mail expertise analysis , 2003, DMKD '03.

[24]  Jamie Callan,et al.  DISTRIBUTED INFORMATION RETRIEVAL , 2002 .

[25]  M. de Rijke,et al.  The University of Amsterdam at the TREC 2007 Enterprise Track , 2006 .

[26]  Julio Gonzalo,et al.  The SemEval-2007 WePS Evaluation: Establishing a benchmark for the Web People Search Task , 2007, Fourth International Workshop on Semantic Evaluations (SemEval-2007).

[27]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[28]  Joon Ho Lee,et al.  Combining multiple evidence from different properties of weighting schemes , 1995, SIGIR '95.

[29]  Krisztian Balog,et al.  Integrating contextual factors into topic-centric retrieval models for finding similar experts , 2008 .

[30]  Ramesh Nallapati,et al.  Discriminative models for information retrieval , 2004, SIGIR '04.

[31]  Philipp Cimiano,et al.  Finding the Right Expert - Discriminative Models for Expert Retrieval , 2011, KDIR.

[32]  Mark T. Maybury,et al.  Expert Finding Systems , 2006 .

[33]  M. de Rijke,et al.  Ranking related entities: components and analyses , 2010, CIKM.

[34]  M. de Rijke,et al.  Query modeling for entity search based on terms, categories, and examples , 2011, TOIS.

[35]  Kate Ehrlich,et al.  Pick me!: link selection in expertise search results , 2008, CHI.

[36]  Julio Gonzalo,et al.  A testbed for people searching strategies in the WWW , 2005, SIGIR '05.

[37]  Ian H. Witten,et al.  Learning to link with wikipedia , 2008, CIKM '08.

[38]  K. Wiig Knowledge management: Where did it come from and where will it go? , 1997 .

[39]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[40]  Morten Hertzum,et al.  People as carriers of experience and sources of commitment: information seeking in a software design project , 2000 .

[41]  Philipp Cimiano,et al.  Overview of the Cross-lingual Expert Search (CriES) Pilot Challenge , 2010, CLEF.

[42]  W. Bruce Croft,et al.  Finding experts in community-based question-answering services , 2005, CIKM '05.

[43]  Jiepu Jiang Expertise Retrieval Using Search Engine Results , 2008 .

[44]  Rajeev Motwani,et al.  The PageRank Citation Ranking : Bringing Order to the Web , 1999, WWW 1999.

[45]  Bo Wang,et al.  Expert2Bólè: From Expert Finding to Bólè Search , 2009 .

[46]  Mark S. Ackerman,et al.  Collaborative Support for Informal Information in Collective Memory Systems , 2000, Inf. Syst. Frontiers.

[47]  Mingrui Wu,et al.  Gradient descent optimization of smoothed information retrieval metrics , 2010, Information Retrieval.

[48]  Panagiotis G. Ipeirotis,et al.  Duplicate Record Detection: A Survey , 2007 .

[49]  Luo Si,et al.  Discriminative graphical models for faculty homepage discovery , 2010, Information Retrieval.

[50]  M. de Rijke,et al.  Entity Retrieval , 2007 .

[51]  Yiqun Liu,et al.  Finding Experts Using Social Network Analysis , 2007 .

[52]  Dan Roth,et al.  Citation Author Topic Model in Expert Search , 2010, COLING.

[53]  Wei Lu,et al.  CSIR at TREC 2007 Expert Search Task , 2007, TREC.

[54]  Gianluca Demartini,et al.  Overview of the INEX 2008 Entity Ranking Track , 2009, INEX.

[55]  M. de Rijke,et al.  Personal Name Resolution of Web People Search , 2008 .

[56]  Craig MacDonald,et al.  Blog track research at TREC , 2010, SIGF.

[57]  Enrico Motta,et al.  The Open University at TREC 2006 Enterprise Track Expert Search Task , 2006, TREC.

[58]  Ralf Herbrich,et al.  Large margin rank boundaries for ordinal regression , 2000 .

[59]  Michael F. Schwartz,et al.  Discovering shared interests using graph analysis , 1993, CACM.

[60]  Hongbo Deng,et al.  Enhancing expertise retrieval using community-aware strategies , 2009, CIKM.

[61]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[62]  Djoerd Hiemstra,et al.  University of Twente at the TREC 2008 Enterprise Track: Using the Global Web as an Expertise Evidence Source , 2008, TREC.

[63]  D. Opitz,et al.  Popular Ensemble Methods: An Empirical Study , 1999, J. Artif. Intell. Res..

[64]  Valentin Jijkoun,et al.  The Impact of Named Entity Normalization on Information Retrieval for Question Answering , 2008, ECIR.

[65]  Juan-Zi Li,et al.  Expert Finding in a Social Network , 2007, DASFAA.

[66]  Andreas Harth,et al.  The ExpertFinder Corpus 2007 for the Benchmarking and Development of ExpertFinding Systems , 2007 .

[67]  Craig MacDonald,et al.  Key blog distillation: ranking aggregates , 2008, CIKM '08.

[68]  Djoerd Hiemstra,et al.  Modeling multi-step relevance propagation for expert finding , 2008, CIKM '08.

[69]  Peter Mika,et al.  Entity Search Evaluation over Structured Web Data , 2011 .

[70]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[71]  M. de Rijke,et al.  Finding similar experts , 2007, SIGIR.

[72]  M. de Rijke,et al.  Mapping queries to the Linking Open Data cloud: A case study using DBpedia , 2011, J. Web Semant..

[73]  Peter Bruza,et al.  Towards context sensitive information inference , 2003, J. Assoc. Inf. Sci. Technol..

[74]  Ruoming Jin,et al.  Topic level expertise search over heterogeneous networks , 2010, Machine Learning.

[75]  Craig MacDonald,et al.  Voting for related entities , 2010, RIAO.

[76]  Krisztian Balog,et al.  People search in the enterprise , 2007, SIGF.

[77]  Tie-Yan Liu Learning to Rank for Information Retrieval , 2009, Found. Trends Inf. Retr..

[78]  Craig MacDonald,et al.  The voting model for people search , 2009, SIGF.

[79]  Mark S. Ackerman,et al.  Expertise recommender: a flexible recommendation system and architecture , 2000, CSCW '00.

[80]  Claudia Niederée,et al.  Finding experts on the semantic desktop , 2008 .

[81]  Bo Gao,et al.  On optimization of expertise matching with various constraints , 2012, Neurocomputing.

[82]  M. de Rijke,et al.  Learning Semantic Query Suggestions , 2009, SEMWEB.

[83]  Craig MacDonald,et al.  Using Relevance Feedback in Expert Search , 2007, ECIR.

[84]  Maarten de Rijke,et al.  Bloggers as experts: feed distillation using expert retrieval models , 2008, SIGIR '08.

[85]  Paul B. Kantor,et al.  A Study of Information Seeking and Retrieving. III. Searchers, Searches, and Overlap* , 1988 .

[86]  Kate Ehrlich,et al.  Searching for experts in the enterprise: combining text and social network analysis , 2007, GROUP.

[87]  Krisztian Balog,et al.  Overview of the TREC 2010 Entity Track , 2010, TREC.

[88]  Rada Mihalcea,et al.  Linking Documents to Encyclopedic Knowledge , 2008, IEEE Intelligent Systems.

[89]  M. de Rijke,et al.  Discovering missing links in Wikipedia , 2005, LinkKDD '05.

[90]  ChengXiang Zhai,et al.  Statistical Language Models for Information Retrieval: A Critical Review , 2008, Found. Trends Inf. Retr..

[91]  Stephen E. Robertson,et al.  Relevance weighting of search terms , 1976, J. Am. Soc. Inf. Sci..

[92]  Wolfgang Nejdl,et al.  Enhancing Expert Search Through Query Modeling , 2007, ECIR.

[93]  M. de Rijke,et al.  Credibility Improves Topical Blog Post Retrieval , 2008, ACL.

[94]  Craig MacDonald,et al.  Searching for Expertise: Experiments with the Voting Model , 2009, Comput. J..

[95]  William S. Cooper,et al.  Exploiting the maximum entropy principle to increase retrieval effectiveness , 1983, J. Am. Soc. Inf. Sci..

[96]  Christof Monz,et al.  Applying Maximum Entropy to Known-Item Email Retrieval , 2008, ECIR.

[97]  Gianluca Demartini,et al.  Overview of the INEX 2009 Entity Ranking Track , 2009, INEX.

[98]  Thomas L. Griffiths,et al.  The Author-Topic Model for Authors and Documents , 2004, UAI.

[99]  David Yarowsky,et al.  Unsupervised Personal Name Disambiguation , 2003, CoNLL.

[100]  Yunhao Liu,et al.  EOS: expertise oriented search using social networks , 2007, WWW '07.

[101]  Djoerd Hiemstra,et al.  Modeling Documents as Mixtures of Persons for Expert Finding , 2008, ECIR.

[102]  Dawei Song,et al.  Integrating multiple windows and document features for expert finding , 2009 .

[103]  Wei Lu,et al.  Adapting Language Modeling Methods for Expert Search to Rank Wikipedia Entities , 2008, INEX.

[104]  Irma Becerra-Fernandez,et al.  Searching for experts on the Web: A review of contemporary expertise locator systems , 2006, TOIT.

[105]  Krisztian Balog,et al.  On the Modeling of Entities for Ad-Hoc Entity Search in the Web of Data , 2012, ECIR.

[106]  Stefan M. Rüger,et al.  Integrating multiple windows and document features for expert finding , 2009, J. Assoc. Inf. Sci. Technol..

[107]  Elad Yom-Tov,et al.  Learning to estimate query difficulty: including applications to missing content detection and distributed information retrieval , 2005, SIGIR '05.

[108]  ChengXiang Zhai,et al.  Constrained multi-aspect expertise matching for committee review assignment , 2009, CIKM.

[109]  Xiangji Huang,et al.  Modeling document features for expert finding , 2008, CIKM '08.

[110]  Ryen W. White,et al.  Automatic People Tagging for Expertise Profiling in the Enterprise , 2011, ECIR.

[111]  Maarten de Rijke,et al.  Finding experts and their eetails in e-mail corpora , 2006, WWW '06.

[112]  Alfred Kobsa,et al.  Expert-Finding Systems for Organizations: Problem and Domain Analysis and the DEMOIR Approach , 2003, J. Organ. Comput. Electron. Commer..

[113]  CHENGXIANG ZHAI,et al.  A study of smoothing methods for language models applied to information retrieval , 2004, TOIS.

[114]  J. J. Rocchio,et al.  Relevance feedback in information retrieval , 1971 .

[115]  Rada Mihalcea,et al.  Wikify!: linking documents to encyclopedic knowledge , 2007, CIKM '07.

[116]  Rob Cross,et al.  A Relational View of Information Seeking and Learning in Social Networks , 2003, Manag. Sci..

[117]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[118]  Craig MacDonald,et al.  Expert Search Evaluation by Supporting Documents , 2008, ECIR.

[119]  Alon Y. Halevy,et al.  Semantic Integration Research in the Database Community : A Brief Survey , 2005 .

[120]  Craig MacDonald,et al.  Usefulness of click-through data in expert search , 2009, SIGIR.

[121]  Alfred Kobsa,et al.  DEMOIR: a hybrid architecture for expertise modeling and recommender systems , 2000, Proceedings IEEE 9th International Workshops on Enabling Technologies: Infrastructure for Collaborative Enterprises (WET ICE 2000).

[122]  Haiqiang Chen,et al.  Social Network Structure Behind the Mailing Lists: ICT-IIIS at TREC 2006 Expert Finding Track , 2006, TREC.

[123]  Craig MacDonald,et al.  Voting for candidates: adapting data fusion techniques for an expert search task , 2006, CIKM '06.

[124]  James Bennett,et al.  The Netflix Prize , 2007 .

[125]  Deng Cai,et al.  Co-Occurrence-Based Diffusion for Expert Search on the Web , 2013, IEEE Transactions on Knowledge and Data Engineering.

[126]  Qi He,et al.  TwitterRank: finding topic-sensitive influential twitterers , 2010, WSDM '10.

[127]  Grzegorz Kukla,et al.  SocLaKE: Social Latent Knowledge Explorator , 2012, Comput. J..

[128]  Mounia Lalmas,et al.  Overview of the INEX 2007 Entity Ranking Track , 2008, INEX.

[129]  Geneva G. Belford,et al.  Multi-aspect expertise matching for review assignment , 2008, CIKM '08.

[130]  M. de Rijke,et al.  Broad expertise retrieval in sparse data environments , 2007, SIGIR.

[131]  Jie Tang,et al.  Learning to Diversify Expert Finding with Subtopics , 2012, PAKDD.

[132]  Andrew McCallum,et al.  Expertise modeling for matching papers with reviewers , 2007, KDD '07.

[133]  Pável Calado,et al.  Learning to Rank for Expert Search in Digital Libraries of Academic Publications , 2011, EPIA.

[134]  Christopher D. Manning,et al.  Introduction to Information Retrieval , 2010, J. Assoc. Inf. Sci. Technol..

[135]  S. Robertson The probability ranking principle in IR , 1997 .

[136]  Wolfgang Nejdl,et al.  A Vector Space Model for Ranking Entities and Its Application to Expert Search , 2009, ECIR.

[137]  Craig MacDonald,et al.  Searching for expertise using the terrier platform , 2006, SIGIR '06.

[138]  Evangelos E. Milios,et al.  Finding expert users in community question answering , 2012, WWW.

[139]  Paul Thomas,et al.  Overview of the TREC 2009 Entity Track , 2009, TREC.

[140]  Nick Craswell,et al.  Overview of the TREC 2005 Enterprise Track , 2005, TREC.

[141]  M. de Rijke,et al.  Combining Candidate and Document Models for Expert Search , 2008, TREC.

[142]  Edward A. Fox,et al.  Combination of Multiple Searches , 1993, TREC.

[143]  Maarten de Rijke,et al.  Associating People and Documents , 2008, ECIR.

[144]  Jeffrey K. Liker,et al.  Toyota Talent: Developing Your People the Toyota Way , 2007 .

[145]  A. Mathur,et al.  Ranking Experts with Discriminative Probabilistic Models , 2009 .

[146]  W. Bruce Croft,et al.  Cluster-based retrieval using language models , 2004, SIGIR '04.

[147]  Joseph A. Konstan,et al.  Evolution of Experts in Question Answering Communities , 2012, ICWSM.

[148]  Thomas H. Davenport,et al.  Book review:Working knowledge: How organizations manage what they know. Thomas H. Davenport and Laurence Prusak. Harvard Business School Press, 1998. $29.95US. ISBN 0‐87584‐655‐6 , 1998 .

[149]  Djoerd Hiemstra,et al.  Being Omnipresent To Be Almighty: The Importance of The Global Web Evidence for Organizational Expert Finding , 2008 .

[150]  Hongbo Deng,et al.  Formal Models for Expert Finding on DBLP Bibliography Data , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[151]  M. de Rijke,et al.  Formal models for expert finding in enterprise corpora , 2006, SIGIR.

[152]  Victor Rosenberg Factors affecting the preferences of industrial personnel for information gathering methods , 1967, Inf. Storage Retr..

[153]  Kevin Dela Rosa,et al.  LADS : Rapid Development of a Learning-To-Rank Based Related Entity Finding System using Open Advancement , 2011 .

[154]  Peter Bailey,et al.  Overview of the TREC 2008 Enterprise Track , 2008, TREC.

[155]  Juan-Zi Li,et al.  A Mixture Model for Expert Finding , 2008, PAKDD.

[156]  Enrico Motta,et al.  Person to person trust factors in word of mouth recommendation , 2006 .

[157]  Jaap Kamps,et al.  Entity ranking using Wikipedia as a pivot , 2010, CIKM.

[158]  Maarten de Rijke,et al.  Non-local evidence for expert finding , 2008, CIKM '08.

[159]  Yiqun Liu,et al.  THUIR at TREC2008: Enterprise Track , 2008 .

[160]  Kate Ehrlich,et al.  Searching for expertise , 2008, CHI.

[161]  S. Kiesler,et al.  The kindness of strangers: on the usefulness of electronic weak ties for technical advice , 1996 .

[162]  Mounia Lalmas,et al.  Learning Aggregation Functions for Expert Search , 2010, ECAI.

[163]  Morten Hertzum,et al.  The information-seeking practices of engineers: searching for documents as well as for people , 2000, Inf. Process. Manag..

[164]  Luo Si,et al.  A probabilistic graphical model for joint answer ranking in question answering , 2007, SIGIR.

[165]  Jayant Madhavan,et al.  Reference reconciliation in complex information spaces , 2005, SIGMOD '05.

[166]  Peter Mika,et al.  Ad-hoc object retrieval in the web of data , 2010, WWW '10.

[167]  Jaap Kamps,et al.  Finding Entities in Wikipedia Using Links and Categories , 2008, INEX.

[168]  C. Lee Giles,et al.  Learning to Rank Homepages For Researcher-Name Queries , 2011 .

[169]  Audris Mockus,et al.  Expertise Browser: a quantitative approach to identifying expertise , 2002, Proceedings of the 24th International Conference on Software Engineering. ICSE 2002.

[170]  ChengXiang Zhai,et al.  Probabilistic Models for Expert Finding , 2007, ECIR.

[171]  Xiangji Huang,et al.  Integrating multiple document features in language models for expert finding , 2010, Knowledge and Information Systems.

[172]  Gerard Salton,et al.  A vector space model for automatic indexing , 1975, CACM.

[173]  M. de Rijke,et al.  Resolving Person Names in Web People Search , 2009, Weaving Services and People on the World Wide Web.

[174]  Jianhan Zhu,et al.  A study of the relationship between ad hoc retrieval and expert finding in enterprise environment , 2008, WIDM '08.

[175]  Toine Bogers,et al.  Design and Evaluation of a University-Wide Expert Search Engine , 2009, ECIR.

[176]  M. de Rijke,et al.  A language modeling framework for expert finding , 2009, Inf. Process. Manag..

[177]  Craig Boutilier,et al.  A Framework for Optimizing Paper Matching , 2011, UAI.

[178]  David Hawking,et al.  Panoptic Expert: Searching for experts not just for documents , 2001 .

[179]  M. de Rijke,et al.  On the Evaluation of Entity Profiles , 2010, CLEF.

[180]  Katja Hofmann,et al.  Contextual factors for finding similar experts , 2010 .

[181]  Luo Si,et al.  Discriminative probabilistic models for expert search in heterogeneous information sources , 2011, Information Retrieval.

[182]  Mark S. Ackerman,et al.  Searching for expertise in social networks: a simulation of potential strategies , 2005, GROUP.

[183]  M. de Rijke,et al.  Generating Pseudo Test Collections for Learning to Rank Scientific Articles , 2012, CLEF.

[184]  Michael I. Jordan,et al.  On Discriminative vs. Generative Classifiers: A comparison of logistic regression and naive Bayes , 2001, NIPS.

[185]  Luo Si,et al.  FacFinder: Search for Expertise in Academic Institutions* , 2008 .

[186]  Julio Gonzalo,et al.  WePS-3 Evaluation Campaign: Overview of the Web People Search Clustering and Attribute Extraction Tasks , 2010, CLEF.

[187]  Craig MacDonald,et al.  Expertise drift and query expansion in expert search , 2007, CIKM '07.

[188]  Milad Shokouhi,et al.  Federated Search , 2011, Found. Trends Inf. Retr..

[189]  Maarten de Rijke,et al.  Blog feed search with a post index , 2011, Information Retrieval.

[190]  M. de Rijke,et al.  Linking Archives Using Document Enrichment and Term Selection , 2011, TPDL.

[191]  Jon Kleinberg,et al.  Authoritative sources in a hyperlinked environment , 1999, SODA '98.

[192]  P. Baumard Tacit Knowledge in Organizations , 1999 .

[193]  W. Bruce Croft,et al.  Hierarchical Language Models for Expert Finding in Enterprise Corpora , 2006, 2006 18th IEEE International Conference on Tools with Artificial Intelligence (ICTAI'06).

[194]  Ludmila I. Kuncheva,et al.  Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy , 2003, Machine Learning.

[195]  Meredith Ringel Morris,et al.  A Comparison of Information Seeking Using Search Engines and Social Networks , 2010, ICWSM.

[196]  M. de Rijke,et al.  A few examples go a long way: constructing query models from elaborate query formulations , 2008, SIGIR '08.

[197]  Craig MacDonald,et al.  Learning Models for Ranking Aggregates , 2011, ECIR.

[198]  A. W. Kemp,et al.  Applied Probability and Queues , 1989 .

[199]  John E. Dennis,et al.  Numerical methods for unconstrained optimization and nonlinear equations , 1983, Prentice Hall series in computational mathematics.

[200]  Krisztian Balog,et al.  A User-Oriented Model for Expert Finding , 2011, ECIR.

[201]  David Hawking,et al.  Overview of the TREC-2002 Web Track , 2002, TREC.

[202]  Josef Kittler,et al.  Combining multiple classifiers by averaging or by multiplying? , 2000, Pattern Recognit..

[203]  Mark S. Ackerman,et al.  Expertise networks in online communities: structure and algorithms , 2007, WWW '07.

[204]  John D. Lafferty,et al.  Model-based feedback in the language modeling approach to information retrieval , 2001, CIKM '01.

[205]  Ryen W. White,et al.  Supporting synchronous social q&a throughout the question lifecycle , 2011, WWW.

[206]  Silviu Cucerzan,et al.  Large-Scale Named Entity Disambiguation Based on Wikipedia Data , 2007, EMNLP.

[207]  Shenghua Bao,et al.  Research on Expert Search at Enterprise Track of TREC 2006 , 2005, TREC.

[208]  Maarten de Rijke,et al.  Query and Document Models for Enterprise Search , 2007, TREC.

[209]  Jie Tang,et al.  ArnetMiner: extraction and mining of academic social networks , 2008, KDD.

[210]  William E. Winkler,et al.  The State of Record Linkage and Current Research Problems , 1999 .

[211]  W. Bruce Croft,et al.  Evaluation of an inference network-based retrieval model , 1991, TOIS.

[212]  Stephen E. Robertson,et al.  Relevance weighting for query independent evidence , 2005, SIGIR '05.

[213]  Tara Matthews,et al.  Asking the right person: supporting expertise selection in the enterprise , 2012, CHI.

[214]  Mark Sanderson,et al.  Test Collection Based Evaluation of Information Retrieval Systems , 2010, Found. Trends Inf. Retr..

[215]  Julio Gonzalo,et al.  WePS 2 Evaluation Campaign: Overview of the Web People Search Clustering Task , 2009 .

[216]  Damon Horowitz,et al.  The anatomy of a large-scale social search engine , 2010, WWW '10.

[217]  Luo Si,et al.  Analysis of an expert search query log , 2011, SIGIR.

[218]  Nick Craswell,et al.  Overview of the TREC 2006 Enterprise Track , 2006, TREC.

[219]  Peter Bailey,et al.  The CSIRO enterprise search test collection , 2007, SIGF.

[220]  Maarten de Rijke,et al.  Result Disambiguation in Web People Search , 2012, ECIR.

[221]  Yang Song,et al.  Efficient topic-based unsupervised name disambiguation , 2007, JCDL '07.

[222]  David W. McDonald,et al.  Evaluating expertise recommendations , 2001, GROUP.

[223]  Gianni Amati,et al.  Probability models for information retrieval based on divergence from randomness , 2003 .

[224]  Theodoros Lappas,et al.  Finding a team of experts in social networks , 2009, KDD.

[225]  M. de Rijke,et al.  Adding semantics to microblog posts , 2012, WSDM '12.

[226]  Curt Burgess,et al.  Explorations in context space: Words, sentences, discourse , 1998 .

[227]  Yong Yu,et al.  Research on Enterprise Track of TREC 2007 at SJTU APEX Lab , 2007, TREC.

[228]  Ling Xia,et al.  That's what friends are for: facilitating 'who knows what' across group boundaries , 2007, GROUP.

[229]  Craig MacDonald,et al.  Mimicking Web search engines for expert search , 2011, Inf. Process. Manag..

[230]  Valentin Jijkoun,et al.  Named entity normalization in user generated content , 2008, AND '08.

[231]  Irma Becerra-Fernandez The role of artificial intelligence technologies in the implementation of People-Finder knowledge management systems , 2000, Knowl. Based Syst..