CLEF: Ongoing Activities and Plans for the Future

Multilingual information access and crosslanguage search and retrieval are key issues for digital libraries. For this reason, DELOS has continued to support the activities of the Cross-Language Evaluation Forum (CLEF), which has the promotion of research in multilingual information retrieval system development as its main goal. This paper describes the evolution of CLEF over the last seven years, illustrates the main results, and provides some recommendations for future work in this area.

[1]  Ryen W. White,et al.  Overview of the CLEF-2006 Cross-Language Speech Retrieval Track , 2006, CLEF.

[2]  R. Frost,et al.  From data to wisdom: pathways to successful data management for Australian science. Report of the working group on Data for Science to the Prime Minister's Science, Engineering and Innovation Council (PMSEIC) , 2006 .

[3]  Fredric C. Gey,et al.  GeoCLEF 2008: the CLEF 2008 Cross-Language Geographic Information Retrieval Track Overview , 2008, Conference and Labs of the Evaluation Forum.

[4]  Hans-Jörg Schek,et al.  Digital library information-technology infrastructures , 2005, International Journal on Digital Libraries.

[5]  Thomas Deselaers,et al.  Overview of the ImageCLEF 2006 Photographic Retrieval and Object Annotation Tasks , 2006, CLEF.

[6]  Giorgio Maria Di Nunzio,et al.  Scientific Evaluation of a DLMS: A Service for Evaluating Information Access Components , 2006, ECDL.

[7]  Fredric C. Gey,et al.  GeoCLEF 2008: the CLEF 2008 Cross-Language Geographic Information Retrieval Track Overview , 2008, CLEF.

[8]  Valentin Jijkoun,et al.  Overview of the CLEF 2006 Multilingual Question Answering Track , 2006, CLEF.

[9]  Giorgio Maria Di Nunzio,et al.  The Importance of Scientific Data Curation for Evaluation Campaigns , 2007, DELOS.

[10]  Julio Gonzalo,et al.  iCLEF 2006 Overview: Searching the Flickr WWW Photo-Sharing Repository , 2006, CLEF.

[11]  Eugene Kim,et al.  Overview of the ImageCLEFmed 2006 Medical Retrieval and Annotation Tasks , 2006, CLEF.

[12]  Carol Peters,et al.  Cross-Language Evaluation Forum: Objectives, Results, Achievements , 2004, Information Retrieval.

[13]  Jennifer Widom,et al.  The Lowell database research self-assessment , 2003, CACM.

[14]  Giorgio Maria Di Nunzio,et al.  DIRECT: A System for Evaluating Information Access Components of Digital Libraries , 2005, ECDL.

[15]  Cyril Cleverdon,et al.  The Cranfield tests on index language devices , 1997 .

[16]  Giorgio Maria Di Nunzio,et al.  Scientific Data of an Evaluation Campaign: Do We Properly Deal With Them? , 2006, CLEF.

[17]  Giorgio Maria Di Nunzio,et al.  A Proposal to Extend and Enrich the Scientific Data Curation of Evaluation Campaigns , 2007, EVIA@NTCIR.