Overview of the ImageCLEF 2012 Flickr Photo Annotation and Retrieval Task

ImageCLEF's Flickr Photo Annotation and Retrieval task aims to advance the state of the art in multimedia research by providing a chal- lenging benchmark for visual concept detection, annotation and retrieval in the context of a diverse collection of Flickr photos. The benchmark con- sisted of two separate but closely connected subtasks, where the objective of the first subtask was to accurately detect a wide range of semantic con- cepts for the purpose of automatic image annotation, while the objective of second subtask was to correctly retrieve relevant images for concept- oriented queries inspired by what people actually search for on the inter- net. This paper presents an overview of the benchmark, summarizes the annotation and retrieval techniques proposed by the participating teams and evaluates their performance.

[1]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[2]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[3]  Michael Isard,et al.  Object retrieval with large vocabularies and fast spatial matching , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Marc Najork,et al.  Computing Information Retrieval Performance Measures Efficiently in the Presence of Tied Scores , 2008, ECIR.

[5]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[6]  Mark J. Huiskes,et al.  The MIR flickr retrieval evaluation , 2008, MIR '08.

[7]  Gertjan J. Burghouts,et al.  Performance evaluation of local colour invariants , 2009, Comput. Vis. Image Underst..

[8]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[9]  Bart Thomee,et al.  TOP-SURF: a visual words toolkit , 2010, ACM Multimedia.

[10]  Koen E. A. van de Sande,et al.  Evaluating Color Descriptors for Object and Scene Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Emmanuel Dellandréa,et al.  LIRIS-Imagine at ImageCLEF 2011 Photo Annotation Task , 2011, CLEF.

[12]  Roberto Paredes,et al.  Overview of the ImageCLEF 2012 Scalable Web Image Annotation Task , 2012, CLEF.

[13]  Wei Wu,et al.  IMU @ ImageCLEF 2012 , 2012, CLEF.

[14]  Padmini Srinivasan,et al.  Quality through flow and immersion: gamifying crowdsourced relevance assessments , 2012, SIGIR '12.

[15]  Marcelo G. Manzato.  The participation of IntermidiaLab at the ImageCLEF 2012 Photo Annotation Task , 2012, CLEF.

[16]  Lei Huang,et al.  BUAA AUDR at ImageCLEF 2012 Photo Annotation Task , 2012, CLEF.

[17]  Maher Ben Jemaa,et al.  Applying LDA in Contextual Image Retrieval - ReDCAD participation at ImageCLEF Flickr Photo Retrieval 2012 , 2012, CLEF.

[18]  András A. Benczúr,et al.  DMS-SZTAKI @ ImageCLEF 2012 Photo Annotation , 2012, CLEF.

[19]  Been-Chian Chien,et al.  KIDS-NUTN at ImageCLEF 2012 Photo Annotation and Retrieval Task , 2012, CLEF.

[20]  Adrian Popescu,et al.  CEA LIST's Participation to the Concept Annotation Task of ImageCLEF 2012 , 2012, CLEF.

[21]  Yiannis Kompatsiaris,et al.  CERTH's Participation at the Photo Annotation Task of ImageCLEF 2012 , 2012, CLEF.

[22]  Roberto Tronci,et al.  The PRA and AmILAB at ImageCLEF 2012 Photo Flickr Annotation Task , 2012, CLEF.

[23]  Adrian Iftene,et al.  UAIC Participation at ImageCLEF 2012 Photo Annotation Task , 2012, CLEF.

[24]  Matthieu Cord,et al.  BossaNova at ImageCLEF 2012 Flickr Photo Annotation Task , 2012, CLEF.

[25]  Tatsuya Harada,et al.  ISI at ImageCLEF 2012: Scalable System for Image Annotation , 2012, CLEF.

[26]  Stefan Conrad,et al.  DBRIS at ImageCLEF 2012 Photo Annotation Task , 2012, CLEF.

[27]  Juan José Pantrigo,et al.  URJC&UNED at ImageCLEF 2013 Photo Annotation Task , 2013, CLEF.