论文信息 - MapReduce for Experimental Search

MapReduce for Experimental Search

This report presents preliminary results for the TREC 2010 ad-hoc web search task. We ran our MIREX system on 0.5 billion web documents from the ClueWeb09 crawl. On average, the system retrieves at least 3 relevant documents on the first result page containing 10 results, using a simple index consisting of anchor texts, page titles, and spam removal.

Djoerd Hiemstra | Claudia Hauff

[1] Stephen E. Robertson,et al. Microsoft Research at TREC 2009: Web and Relevance Feedback Track , 2009, TREC.

[2] Michael Isard,et al. DryadLINQ: A System for General-Purpose Distributed Data-Parallel Computing Using a High-Level Language , 2008, OSDI.

[3] Tom White,et al. Hadoop: The Definitive Guide , 2009 .

[4] Sanjay Ghemawat,et al. MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[5] Charles L. A. Clarke,et al. Efficient and effective spam filtering and re-ranking for large web datasets , 2010, Information Retrieval.

[6] Jeffrey Dean,et al. Challenges in building large-scale information retrieval systems: invited talk , 2009, WSDM '09.

[7] Djoerd Hiemstra,et al. MapReduce for Information Retrieval Evaluation: "Let's Quickly Test This on 12 TB of Data" , 2010, CLEF.