A proposal for the CLEF Cross-Language Image Retrieval Track 2004

In this paper we describe our proposal for a cross language image retrieval task called ImageCLEF 1 being run as part of the Cross Language Evaluation Forum (CLEF2). A pilot experiment was organised for 2003 in which participants performed an ad hoc bilingual image retrieval task on a collection of historic photographs to simulate the situation in which users express their search request in natural language but require visual documents in return. For 2004 we plan to extend the tasks to include a medical image retrieval task and user-centred evaluation.

[1]  Carol Peters,et al.  European research letter: Cross-language system evaluation: The CLEF campaigns , 2001, J. Assoc. Inf. Sci. Technol..

[2]  Sharon Flank.  Cross-Language Multimedia Information Retrieval , 2000, ANLP.

[3]  Mark D. Dunlop,et al.  Image retrieval by hypertext links , 1997, SIGIR '97.

[4]  Thierry Pun,et al.  Performance evaluation in content-based image retrieval: overview and proposals , 2001, Pattern Recognit. Lett..

[5]  Cyril Cleverdon,et al.  The Cranfield tests on index language devices , 1997 .

[6]  Hsin-Hsi Chen,et al.  Overview of CLIR Task at the Third NTCIR Workshop , 2002, NTCIR.

[7]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Abby Goodrum,et al.  Image Information Retrieval: An Overview of Current Research , 2000, Informing Sci. Int. J. an Emerg. Transdiscipl..

[9]  Mark D. Dunlop.  Reflections on Mira: Interactive evaluation in information retrieval , 2000, J. Am. Soc. Inf. Sci..

[10]  Ingemar J. Cox,et al.  Target testing and the PicHunter Bayesian multimedia retrieval system , 1996, Proceedings of the Third Forum on Research and Technology Advances in Digital Libraries,.

[11]  Fran ine Chena,et al.  Multi-Modal Browsing of Images in Web Do uments , 1999 .

[12]  John Tait,et al.  Evaluating a content based image retrieval system , 2001, SIGIR '01.

[13]  M. Markkula,et al.  Searching for Photos - Journalists' Practices in Pictorial IR , 1998 .

[14]  Thomas Martin Deserno,et al.  The CLEF 2005 Cross-Language Image Retrieval Track , 2003, CLEF.

[15]  Peter G. B. Enser,et al.  Analysis of user need in image archives , 1997, J. Inf. Sci..

[16]  Joshua R. Smith,et al.  Image retrieval evaluation , 1998, Proceedings. IEEE Workshop on Content-Based Access of Image and Video Libraries (Cat. No.98EX173).

[17]  David A. Forsyth,et al.  Benchmarks for storage and retrieval in multimedia databases , 2001, IS&T/SPIE Electronic Imaging.

[18]  Gregory Grefenstette,et al.  Cross-Language Information Retrieval , 1998, The Springer International Series on Information Retrieval.

[19]  Ellen M. Voorhees,et al.  Overview of TREC 2001 , 2001, TREC.

[20]  Hinrich Schütze,et al.  Multimodal browsing of images in Web documents , 1999, Electronic Imaging.