Geographic Information Retrieval Track Overview

GeoCLEF ran as a regular track for the second time within the Cross Language Evaluation Forum (CLEF) 2007. The purpose of GeoCLEF is to test and evaluate cross-language geographic information retrieval (GIR): retrieval for topics with a geographic specification. GeoCLEF 2007 consisted of two sub tasks. A search task ran for the third time and a query classification task was organized for the first. For the GeoCLEF 2007 search task, twenty-five search topics were defined by the organizing groups for searching English, German, Portuguese and Spanish document collections. All topics were translated into English, Indonesian, Portuguese, Spanish and German. Several topics in 2007 were geographically challenging. Thirteen groups submitted 108 runs. The groups used a variety of approaches. For the classification task, a query log from a search engine was provided and the groups needed to identify the queries with a geographic scope and the geographic components within the local queries.

[1]  Justin Zobel,et al.  How reliable are the results of large-scale information retrieval experiments? , 1998, SIGIR '98.

[2]  Eckhard Bick,et al.  Providing Internet Access to Portuguese Corpora: the AC/DC Project , 2000, LREC.

[3]  Michael Kluck,et al.  Inside the Evaluation Process of the Cross-Language Evaluation Forum (CLEF): Issues of Multilingual Topic Creation and Multilingual Relevance Assessment , 2002, LREC.

[4]  Diana Santos,et al.  The Key to the First CLEF with Portuguese: Topics, Questions and Answers in CHAVE , 2004, CLEF.

[5]  Carol Peters,et al.  Cross-Language Evaluation Forum: Objectives, Results, Achievements , 2004, Information Retrieval.

[6]  Ellen M. Voorhees,et al.  Retrieval System Evaluation , 2005 .

[7]  Mark Sanderson,et al.  Information retrieval system evaluation: effort, sensitivity, and reliability , 2005, SIGIR '05.

[8]  Stefan Evert.  The CQP Query Language Tu-torial , 2005 .

[9]  Giorgio Maria Di Nunzio,et al.  DIRECT: A System for Evaluating Information Access Components of Digital Libraries , 2005, ECDL.

[10]  Fredric C. Gey,et al.  GeoCLEF: the CLEF 2005 Cross-Language Geographic Information Retrieval Track , 2005, CLEF.

[11]  Fredric C. Gey,et al.  GeoCLEF 2008: the CLEF 2008 Cross-Language Geographic Information Retrieval Track Overview , 2008, Conference and Labs of the Evaluation Forum.

[12]  Diana Santos,et al.  The place of place in geographical IR , 2006, GIR.

[13]  Xing Xie,et al.  Query Parsing Task for GeoCLEF2007 Report , 2007, CLEF.