Search for expertise : going beyond direct evidence

The automatic search for knowledgeable people in the scope of an organization is a key function which makes modern Enterprise search systems commercially successful and socially demanded. A number of effective approaches to expert finding were recently proposed in academic publications. Although, most of them use reasonably defined measures of personal expertise, they often limit themselves to rather unrealistic and sometimes oversimplified principles. In this thesis, we explore several ways to go beyond state-of-the-art assumptions used in research on expert finding and propose several novel solutions for this and related tasks. First, we describe measures of expertise that do not assume independent occurrence of terms and persons in a document what makes them perform better than the measures based on independence of all entities in a document. One of these measures makes persons central to the process of terms generation in a document. Another one assumes that the position of the person’s mention in a document with respect to the positions of query terms indicates the relation of the person to the document’s relevant content. Second, we find the ways to use not only direct expertise evidence for a person concentrated within the document space of the person’s current employer and only within those organizational documents that mention the person. We successfully utilize the predicting potential of additional indirect expertise evidence publicly available on the Web and in the organizational documents implicitly related to a person. Finally, besides the expert finding methods we proposed, we also demonstrate solutions for the tasks from related domains. In one case, we use several algorithms of multi-step relevance propagation to search for typed entities in Wikipedia. In another case, we suggest generic methods for placing photos uploaded to Flickr on the World map using language models of locations built entirely on the annotations provided by users with a few task specific extensions.

[1]  Mor Naaman,et al.  From Where to What: Metadata Sharing for Digital Photographs with Geographic Coordinates , 2003, OTM.

[2]  Djoerd Hiemstra,et al.  Modeling expert finding as an absorbing random walk , 2008, SIGIR '08.

[3]  Andrew Y. Ng,et al.  Learning random walk models for inducing word dependency distributions , 2004, ICML.

[4]  Djoerd Hiemstra,et al.  The Right Expert at the Right Time and Place , 2008, PAKM.

[5]  Geneva G. Belford,et al.  Multi-aspect expertise matching for review assignment , 2008, CIKM '08.

[6]  Judit Bar-Ilan,et al.  Which h-index? — A comparison of WoS, Scopus and Google Scholar , 2008, Scientometrics.

[7]  Shlomo Moran,et al.  SALSA: the stochastic approach for link-structure analysis , 2001, TOIS.

[8]  M. de Rijke,et al.  Broad expertise retrieval in sparse data environments , 2007, SIGIR.

[9]  Cai-Nicolas Ziegler,et al.  Towards Automated Reputation and Brand Monitoring on the Web , 2006, 2006 IEEE/WIC/ACM International Conference on Web Intelligence (WI 2006 Main Conference Proceedings)(WI'06).

[10]  Tao Qin,et al.  Supervised rank aggregation , 2007, WWW '07.

[11]  Neerincx,et al.  Human-computer interaction and presence in virtual reality exposure therapy , 2003 .

[12]  Michael J. Pazzani,et al.  Mining for proposal reviewers: lessons learned at the national science foundation , 2006, KDD '06.

[13]  Peter Bailey,et al.  The CSIRO enterprise search test collection , 2007, SIGF.

[14]  Steven Skiena,et al.  Newspapers vs. Blogs: Who Gets the Scoop? , 2006, AAAI Spring Symposium: Computational Approaches to Analyzing Weblogs.

[15]  A. de Moor,et al.  Empowering communities: A method for the legitimate user-driven specification of network information systems , 1999 .

[16]  Djoerd Hiemstra,et al.  Modeling Documents as Mixtures of Persons for Expert Finding , 2008, ECIR.

[17]  Henk Ernst Blok Database Optimization Aspects for Information Retrieval , 2002 .

[18]  S. J. Karlsson Scalable distributed data structures for database management , 2000 .

[19]  Michael I. Jordan,et al.  Stable algorithms for link analysis , 2001, SIGIR '01.

[20]  Trung Huu Bui,et al.  Toward affective dialogue management using partially observable Markov decision processes , 2008 .

[21]  StashNatalia Incorporating cognitive/learning styles in a general-purpose adaptive hypermedia system , 2007 .

[22]  C. Lee Giles,et al.  Modeling and visualizing geo-sensitive queries based on user clicks , 2008, LocWeb.

[23]  Chong Wang,et al.  Mining geographic knowledge using location aware topic model , 2007, GIR '07.

[24]  Luis Gravano,et al.  Computing Geographical Scopes of Web Resources , 2000, VLDB.

[25]  Craig MacDonald,et al.  University of Glasgow at TREC 2008: Experiments in Blog, Enterprise, and Relevance Feedback Tracks with Terrier , 2008, TREC.

[26]  Fabio Crestani,et al.  Application of Spreading Activation Techniques in Information Retrieval , 1997, Artificial Intelligence Review.

[27]  Gilad Mishne,et al.  Finding high-quality content in social media , 2008, WSDM '08.

[28]  Philip S. Yu,et al.  Identifying the influential bloggers in a community , 2008, WSDM '08.

[29]  Daniel Gruhl,et al.  The web beyond popularity: a really simple system for web scale RSS , 2006, WWW '06.

[30]  Rajeev Motwani,et al.  The PageRank Citation Ranking : Bringing Order to the Web , 1999, WWW 1999.

[31]  Boris Shishkov,et al.  Software Specification Based on Re-usable Business Components , 2005 .

[32]  M. de Rijke,et al.  Formal models for expert finding in enterprise corpora , 2006, SIGIR.

[33]  Roelof van Zwol,et al.  Flickr tag recommendation based on collective knowledge , 2008, WWW.

[34]  Oren Kurland,et al.  Respect my authority!: HITS without hyperlinks, utilizing cluster-based language models , 2006, SIGIR.

[35]  Johan van den Akker,et al.  DEGAS: an active, temporal database of autonomous objects , 1998 .

[36]  Claudia Niederée,et al.  Finding experts on the semantic desktop , 2008 .

[37]  Ronald Poppe,et al.  Discriminative vision-based recovery and recognition of human motion , 2009 .

[38]  Koen V. Hindriks,et al.  Agent programming languages: programming with mental models , 2001 .

[39]  C.M.T. Metselaar,et al.  Sociaal-organisatorische gevolgen van kennistechnologie : een procesbenadering en actorperspectief , 2000 .

[40]  Craig MacDonald,et al.  Using Relevance Feedback in Expert Search , 2007, ECIR.

[41]  Dianne M. Bennett,et al.  Unethical practices in authorship of scientific papers. , 2003, Emergency medicine.

[42]  Katalin Boer-Sorban Agent-Based Simulation of Financial Markets: A Modular, Continuous-time Approach , 2008 .

[43]  Azadeh Shakery,et al.  A probabilistic relevance propagation model for hypertext retrieval , 2006, CIKM '06.

[44]  Lai Xu Monitoring multi-party contracts for E-business , 2004 .

[45]  Yi Zhang,et al.  Personalized interactive faceted search , 2008, WWW.

[46]  E. G. Boltjes,et al.  Voorbeeldig onderwijs : voorbeeldgestuurd onderwijs, een opstap naar abstract denken, vooral voor meisjes , 2004 .

[47]  Sanda M. Harabagiu,et al.  Answering complex questions with random walk models , 2006, SIGIR '06.

[48]  David Hawking,et al.  Challenges in Enterprise Search , 2004, ADC.

[49]  Jurriaan van Diggelen,et al.  Achieving semantic interoperability in multi-agent systems: A dialogue-based approach , 2007 .

[50]  Giuseppe Attardi,et al.  Ranking very many typed entities on wikipedia , 2007, CIKM '07.

[51]  Nick Craswell,et al.  Methods for Distributed Information Retrieval , 2000 .

[52]  Justin Zobel,et al.  Collection Selection via Lexicon Inspection , 1997 .

[53]  Jennifer Widom,et al.  Scaling personalized web search , 2003, WWW '03.

[54]  L. H. Christoph The role of metacognitive skills in learning to solve problems , 2006 .

[55]  Adele E. Howe,et al.  Experiences with selecting search engines using metasearch , 1997, TOIS.

[56]  P.A.T. van Eck,et al.  A Compositional Semantic Structure for Multi-Agent Systems Dynamics , 2001 .

[57]  W. Bruce Croft,et al.  Cluster-based language models for distributed retrieval , 1999, SIGIR '99.

[58]  Yun Chi,et al.  Identifying opinion leaders in the blogosphere , 2007, CIKM '07.

[59]  Sergey Chernov Task detection for activity-based desktop search , 2008, SIGIR '08.

[60]  van Joeri Ruth Flattening queries over nested data types , 2006 .

[61]  Marko Smiljanic,et al.  XML schema matching : balancing efficiency and effectiveness by means of clustering , 2006 .

[62]  Andreas Harth,et al.  The ExpertFinder Corpus 2007 for the Benchmarking and Development of ExpertFinding Systems , 2007 .

[63]  R. Arendsen,et al.  Geen bericht, goed bericht : een onderzoek naar de effecten van de introductie van elektronisch berichtenverkeer met de overheid op de administratieve lasten van bedrijven , 2008 .

[64]  Jon M. Kleinberg,et al.  The link-prediction problem for social networks , 2007, J. Assoc. Inf. Sci. Technol..

[65]  Frederick Knabe,et al.  Enterprise Information Access and the User Experience , 2007, IT Professional.

[66]  Mor Naaman,et al.  Why we tag: motivations for annotation in mobile and online media , 2007, CHI.

[67]  Mark T. Maybury,et al.  Expert Finding Systems , 2006 .

[68]  Milad Shokouhi,et al.  RMIT University at the TREC 2007 Enterprise Track , 2007, TREC.

[69]  Mor Naaman,et al.  Context data in geo-referenced digital photo collections , 2004, MULTIMEDIA '04.

[70]  Djoerd Hiemstra,et al.  Structured Document Retrieval, Multimedia Retrieval, and Entity Ranking Using PF/Tijah , 2008, INEX.

[71]  Marti A. Hearst Clustering versus faceted categories for information exploration , 2006, Commun. ACM.

[72]  Roelof van Zwol,et al.  Classifying tags using open content resources , 2009, WSDM '09.

[73]  Djoerd Hiemstra,et al.  University of Twente at the TREC 2007 Enterprise Track: Modeling Relevance Propagation for the Expert Search Task , 2007, TREC.

[74]  Bob van der Vecht,et al.  Adjustable Autonomy: Controling Influences on Decision Making , 2009 .

[75]  Djoerd Hiemstra,et al.  Exploiting sequential dependencies for expert finding , 2008, SIGIR '08.

[76]  James Ze Wang,et al.  Image retrieval: Ideas, influences, and trends of the new age , 2008, CSUR.

[77]  Mark S. Ackerman,et al.  Expertise networks in online communities: structure and algorithms , 2007, WWW '07.

[78]  John D. Lafferty,et al.  Model-based feedback in the language modeling approach to information retrieval , 2001, CIKM '01.

[79]  Roelof van Zwol Modelling and searching web-based document collections , 2002 .

[80]  Shenghua Bao,et al.  Research on Expert Search at Enterprise Track of TREC 2006 , 2005, TREC.

[81]  W.C.A. Wijngaards,et al.  Agent-Based Modelling of Dynamics: Biological and Organisational Applications , 2002 .

[82]  Peter Boncz,et al.  UvA-DARE ( Digital Academic Repository ) Monet ; a next-Generation DBMS Kernel For Query-Intensive Applications , 2007 .

[83]  Jon M. Kleinberg,et al.  Spatial variation in search engine queries , 2008, WWW.

[84]  W. Bruce Croft,et al.  Proximity-based document representation for named entity retrieval , 2007, CIKM '07.

[85]  W. Bruce Croft,et al.  Latent concept expansion using markov random fields , 2007, SIGIR.

[86]  Djoerd Hiemstra,et al.  Using language models for information retrieval , 2001 .

[87]  Lada A. Adamic,et al.  Knowledge sharing and yahoo answers: everyone knows something , 2008, WWW.

[88]  Djoerd Hiemstra,et al.  Generative modeling of persons and documents for expert search , 2007, SIGIR.

[89]  Chris Sherman Google Power: Unleash the Full Potential of Google , 2005 .

[90]  Dragomir R. Radev,et al.  LexRank: Graph-based Lexical Centrality as Salience in Text Summarization , 2004, J. Artif. Intell. Res..

[91]  Pavel Serdyukov,et al.  Placing flickr photos on a map , 2009, SIGIR.

[92]  Fabio Crestani,et al.  “Is this document relevant?…probably”: a survey of probabilistic models in information retrieval , 1998, CSUR.

[93]  Nick Craswell,et al.  Random walks on the click graph , 2007, SIGIR.

[94]  Djoerd Hiemstra,et al.  Modeling multi-step relevance propagation for expert finding , 2008, CIKM '08.

[95]  Gianluca Demartini,et al.  Finding Experts Using Wikipedia , 2007, FEWS.

[96]  P. Groot,et al.  A Theoretical and Empirical Analysis of Approximation in Symbolic Problem Solving , 2004 .

[97]  David Hawking,et al.  Panoptic Expert: Searching for experts not just for documents , 2001 .

[98]  Dennis Reidsma,et al.  Annotations and subjective machines of annotators, embodied agents, users, and other humans , 2008 .

[99]  Ching-Yung Lin,et al.  Personalized recommendation driven by information flow , 2006, SIGIR.

[100]  Xin Li,et al.  Identifying regional sensitive queries in web search , 2008, WWW.

[101]  H. Stuckenschmidt,et al.  Ontology-Based Information Sharing in Weakly Structured Environments , 2003 .

[102]  Mor Naaman,et al.  Generating diverse and representative image search results for landmarks , 2008, WWW.

[103]  Michael L. Nelson,et al.  Agreeing to disagree: search engines and their public interfaces , 2007, JCDL '07.

[104]  S. Bocconi,et al.  Vox Populi : generating video documentaries from semantically annotated media repositories , 2006 .

[105]  Alexei A. Efros,et al.  IM2GPS: estimating geographic information from a single image , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[106]  L. A. Streeter,et al.  An expert/expert-locating system based on automatic representation of semantic structure , 1988, [1988] Proceedings. The Fourth Conference on Artificial Intelligence Applications.

[107]  Nes UvA-DARE ( Digital Academic Repository ) Image database management systems design considerations algorithms and architecture , 2007 .

[108]  P. Baumard Tacit Knowledge in Organizations , 1999 .

[109]  Thijs Westerveld,et al.  Correlating Topic Rankings and Person Rankings to Find Experts , 2006, TREC.

[110]  Georg Gartner,et al.  Applications of location–based services: a selected review , 2007, J. Locat. Based Serv..

[111]  Kilian Q. Weinberger,et al.  Resolving tag ambiguity , 2008, ACM Multimedia.

[112]  M. de Rijke,et al.  Finding similar experts , 2007, SIGIR.

[113]  Jaime G. Carbonell,et al.  Retrieval and feedback models for blog feed search , 2008, SIGIR '08.

[114]  Thomas H. Davenport,et al.  Ten principles of knowledge management and four case studies , 1997 .

[115]  Maarten de Rijke,et al.  Finding experts and their eetails in e-mail corpora , 2006, WWW '06.

[116]  Stephen E. Robertson,et al.  Window-based Enterprise Expert Search , 2006, TREC.

[117]  John D. Lafferty,et al.  Two-stage language models for information retrieval , 2002, SIGIR '02.

[118]  Ethan A. Kolek,et al.  Online Disclosure: An Empirical Examination of Undergraduate Facebook Profiles , 2008 .

[119]  Mounia Lalmas,et al.  Overview of the INEX 2007 Entity Ranking Track , 2008, INEX.

[120]  Matthew Richardson,et al.  The Intelligent surfer: Probabilistic Combination of Link and Content Information in PageRank , 2001, NIPS.

[121]  W. H. van Atteveldt,et al.  Semantic Network Analysis: Techniques for Extracting, Representing, and Querying Media Content , 2008 .

[122]  Stefan M. Rüger,et al.  The Open University at TREC 2007 Enterprise Track , 2007, TREC.

[123]  Douglas W. Oard,et al.  Indexing emails and email threads for retrieval , 2005, SIGIR '05.

[124]  Peter Van Rosmalen,et al.  Supporting the tutor in the design and support of adaptive e-learning , 2008 .

[125]  Ans A. G. Steuten A contribution to the linguistic analysis of business conversations within the language/action perspective , 1998 .

[126]  Mike Thelwall,et al.  Blog search engines , 2007, Online Inf. Rev..

[127]  Jan Broersen Modal Action Logics for Reasoning about Reactive Systems , 2003 .

[128]  W. Teepe Reconciling Information Exchange and Confidentiality, A Formal Approach , 2007 .

[129]  Stephen E. Robertson,et al.  Relevance weighting for query independent evidence , 2005, SIGIR '05.

[130]  Jochen L. Leidner Toponym resolution in text: annotation, evaluation and applications of spatial grounding , 2007, SIGF.

[131]  Eugene Agichtein,et al.  Discovering authorities in question answer communities by using link analysis , 2007, CIKM '07.

[132]  W. Bruce Croft,et al.  Searching distributed collections with inference networks , 1995, SIGIR '95.

[133]  V. Bessa Machado Supporting the Construction of Qualitative Knowledge models , 2004 .

[134]  Craig MacDonald,et al.  High Quality Expertise Evidence for Expert Search , 2008, ECIR.

[135]  Christopher G. Atkeson,et al.  Predicting human interruptibility with sensors , 2005, TCHI.

[136]  M. de Rijke,et al.  Determining Expert Profiles (With an Application to Expert Finding) , 2007, IJCAI.

[137]  Thijs Westerveld,et al.  Using generative probabilistic models for multimedia retrieval , 2005, SIGF.

[138]  Marina Velikova,et al.  Monotone models for prediction in data mining , 2006 .

[139]  Chao Liu,et al.  A probabilistic approach to spatiotemporal theme pattern mining on weblogs , 2006, WWW '06.

[140]  William W. Cohen,et al.  Ranking Users for Intelligent Message Addressing , 2008, ECIR.

[141]  Iryna Gurevych,et al.  Analysis of the Wikipedia Category Graph for NLP Applications , 2007 .

[142]  Djoerd Hiemstra,et al.  Being Omnipresent To Be Almighty: The Importance of The Global Web Evidence for Organizational Expert Finding , 2008 .

[143]  Haiqiang Chen,et al.  Social Network Structure Behind the Mailing Lists: ICT-IIIS at TREC 2006 Expert Finding Track , 2006, TREC.

[144]  Craig MacDonald,et al.  Voting for candidates: adapting data fusion techniques for an expert search task , 2006, CIKM '06.

[145]  Henning Rode,et al.  From Document to Entity Retrieval: Improving Precision and Performance of Focused Text Search , 2008 .

[146]  Nick Craswell,et al.  Overview of the TREC 2005 Enterprise Track , 2005, TREC.

[147]  M. de Rijke,et al.  Combining Candidate and Document Models for Expert Search , 2008, TREC.

[148]  Kevyn Collins-Thompson,et al.  Query expansion using random walk models , 2005, CIKM '05.

[149]  R. V. D. Pol Knowledge-based query formulation in information retrieval , 2000 .

[150]  Filip Radlinski,et al.  A support vector method for optimizing average precision , 2007, SIGIR.

[151]  Paul P. Maglio,et al.  Expertise identification using email communications , 2003, CIKM '03.

[152]  Irma Becerra-Fernandez Facilitating the Online Search of Experts at NASA using Expert Seeker People-Finder , 2000, PAKM.

[153]  Mor Naaman,et al.  World explorer: visualizing aggregate data from unstructured text in geo-referenced collections , 2007, JCDL '07.

[154]  Juan Roberto Castelo Valdueza,et al.  The Discrete Acyclic Digraph Markov Model in Data Mining , 2002 .

[155]  Jacob Lenting Informed gambling : conception and analysis of a multi-agent mechanism for discrete reallocation , 1999 .

[156]  Luis Gravano,et al.  Querying multiple document collections across the internet , 1998 .

[157]  Ronald Fagin,et al.  Comparing top k lists , 2003, SODA '03.

[158]  W. Bruce Croft,et al.  Finding experts in community-based question-answering services , 2005, CIKM '05.

[159]  Daniel S. Weld,et al.  Information extraction from Wikipedia: moving down the long tail , 2008, KDD.

[160]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[161]  Craig MacDonald,et al.  Expertise drift and query expansion in expert search , 2007, CIKM '07.

[162]  Volker Wulf,et al.  Sharing Expertise: Beyond Knowledge Management , 2002 .

[163]  Jakob Nielsen,et al.  Automating the assignment of submitted manuscripts to reviewers , 1992, SIGIR '92.

[164]  Jaap Gordijn,et al.  Value-based requirements engineering: exploring innovative e-commerce ideas , 2003, Requirements Engineering.

[165]  A. J. Lehmann Causation in artificial intelligence and law : a modelling approach , 2003 .

[166]  Kevin Chen-Chuan Chang,et al.  EntityRank: Searching Entities Directly and Holistically , 2007, VLDB.

[167]  Ron Sivan,et al.  Web-a-where: geotagging web content , 2004, SIGIR '04.

[168]  Oren Etzioni,et al.  Multi-Service Search and Comparison Using the MetaCrawler , 1995 .

[169]  Rik Eshuis,et al.  Semantics and Verification of UML Activity Diagrams for Workflow Modelling , 2002 .

[170]  Ellen M. Voorhees,et al.  Learning collection fusion strategies , 1995, SIGIR '95.

[171]  Wolfgang Nejdl,et al.  Enhancing Expert Search Through Query Modeling , 2007, ECIR.

[172]  Stefan Manegold,et al.  Understanding, modeling, and improving main-memory database performance , 2002 .

[173]  Tom M. Mitchell,et al.  Improving Text Classification by Shrinkage in a Hierarchy of Classes , 1998, ICML.

[174]  ACADEMISCH PROEFSCHRIFT,et al.  On Computer-Aided Methods for Modeling and Analysis of Organizations , 2007 .

[175]  Jennifer Widom,et al.  SimRank: a measure of structural-context similarity , 2002, KDD.

[176]  Jonathan Grudin,et al.  Crossing Boundaries: A Case Study of Employee Blogging , 2007, 2007 40th Annual Hawaii International Conference on System Sciences (HICSS'07).

[177]  Rinke Hoekstra,et al.  Ontology Representation - Design Patterns and Ontologies that Make Sense , 2009, Frontiers in Artificial Intelligence and Applications.

[178]  Andreas Martin Thomas Lincke,et al.  Electronic business negotiation: some experimental studies on the interaction between medium, innovation context, and culture , 2003 .

[179]  Djoerd Hiemstra,et al.  PFTijah: text search in an XML database system , 2006 .

[180]  G. Jonker Efficient and Equitable Exchange in Air Traffic Management Plan Repair using Spender-signed Currency , 2008 .

[181]  Gerhard Weikum,et al.  Database Selection and Result Merging in P2P Web Search , 2005, DBISP2P.

[182]  Byron Dom,et al.  A Bayesian Technique for Estimating the Credibility of question Answerers , 2008, SDM.

[183]  Ryen W. White,et al.  Mining the search trails of surfing crowds: identifying relevant websites from user activity , 2008, WWW.

[184]  M. de Rijke,et al.  The University of Amsterdam at TREC 2008: Blog, Enterprise, and Relevance Feedback , 2008 .

[185]  Djoerd Hiemstra,et al.  University of Twente at the TREC 2008 Enterprise Track: Using the Global Web as an Expertise Evidence Source , 2008, TREC.

[186]  Stacey Fusae Nagat User Assistance for Multitasking with Interruptions on a Mobile Device , 2006 .

[187]  Krisztian Balog,et al.  Integrating contextual factors into topic-centric retrieval models for finding similar experts , 2008 .

[188]  Mor Naaman,et al.  Towards automatic extraction of event and place semantics from flickr tags , 2007, SIGIR.

[189]  Rainer Malik CONAN : Text Mining in the Biomedical Domain , 2006 .

[190]  M. B. van Riemsdijk,et al.  Cognitive agent programming : A semantic approach , 2006 .

[191]  Martin Wigbertus Antonius Caminada For the sake of the Argument : explorations into argument-based reasoning , 1997 .

[192]  Wouter Weerkamp,et al.  Bloggers as experts , 2008 .

[193]  Kentaro Toyama,et al.  Geographic location tags on digital images , 2003, ACM Multimedia.

[194]  W. Bruce Croft,et al.  Blog site search using resource selection , 2008, CIKM '08.

[195]  Stephen E. Robertson,et al.  On Collection Size and Retrieval Effectiveness , 2004, Information Retrieval.

[196]  C. van Nimwegen,et al.  The paradox of the guided user: assistance can be counter-effective , 2008 .

[197]  Javed A. Aslam,et al.  Models for metasearch , 2001, SIGIR '01.

[198]  van Boris Wessel Schooten,et al.  Development and Specification of Virtual Environments , 2003 .

[199]  A. J. Hommersom,et al.  On the Application of Formal Methods to Clinical Guidelines, an Artificial Intelligence Perspective , 2008 .

[200]  Stephen E. Robertson,et al.  Experimentation as a way of life: Okapi at TREC , 2000, Inf. Process. Manag..

[201]  Rachel K. E. Bellamy,et al.  BlogCentral: the role of internal blogs at work , 2007, CHI Extended Abstracts.

[202]  Padhraic Smyth,et al.  A general probabilistic framework for clustering individuals and objects , 2000, KDD '00.

[203]  Djoerd Hiemstra,et al.  The Importance of Prior Probabilities for Entry Page Search , 2002, SIGIR '02.

[204]  W. Bruce Croft,et al.  Hierarchical Language Models for Expert Finding in Enterprise Corpora , 2006, 2006 18th IEEE International Conference on Tools with Artificial Intelligence (ICTAI'06).

[205]  H.H.L.M. Donkers,et al.  NOSCE HOSTEM: Searching with Opponent Models , 1997 .

[206]  Johan Bollen,et al.  Co-authorship networks in the digital library research community , 2005, Inf. Process. Manag..

[207]  Marijn Huijbregts,et al.  Segmentation, diarization and speech transcription : surprise data unraveled , 2008 .

[208]  Bart Willem Schermer,et al.  Software Agents, Surveillance and the right to privacy , 2007 .

[209]  Laura Hollink,et al.  Semantic annotation for retrieval of visual resources , 2006 .

[210]  Marc Najork,et al.  Hits on the web: how does it compare? , 2007, SIGIR.

[211]  Natasa Jovanovic,et al.  To whom it may concern : adressee identification in face-to-face meetings , 2007 .

[212]  Craig MacDonald,et al.  On the TREC Blog Track , 2021, ICWSM.

[213]  Jianfeng Gao,et al.  Resolving query translation ambiguity using a decaying co-occurrence model and syntactic dependence relations , 2002, SIGIR '02.

[214]  Ryen W. White,et al.  Enhancing web search by promoting multiple search engine use , 2008, SIGIR '08.

[215]  Yong Yu,et al.  Research on Enterprise Track of TREC 2007 at SJTU APEX Lab , 2007, TREC.

[216]  Ying Li,et al.  Personal name classification in web queries , 2008, WSDM '08.

[217]  Dan Wu,et al.  On assigning place names to geography related web pages , 2005, Proceedings of the 5th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL '05).

[218]  Maarten de Rijke,et al.  Non-local evidence for expert finding , 2008, CIKM '08.

[219]  Stephen E. Robertson,et al.  Selecting good expansion terms for pseudo-relevance feedback , 2008, SIGIR '08.

[220]  Bela Mutschler,et al.  Modeling and simulating causal dependencies on process-aware information systems from a cost perspective , 2008 .

[221]  Morten Hertzum,et al.  The information-seeking practices of engineers: searching for documents as well as for people , 2000, Inf. Process. Manag..