Quaero at TRECVID 2010: Semantic Indexing

The Quaero group is a consortium of French organization working on Multimedia Indexing and Retrieval 1 . UJF-LIG and KIT participated to the semantic indexing task and UJF-LIG participated to the organization of this task. This paper describes these participations. For the semantic indexing task, a classical approach based on feature extraction, classification and hierarchical late fusion was used. Four runs were submitted corresponding to the use or not of genetic algorithmbased fusion and of two distinct fusion optimization methods. Both led to a small performance improvement and our best run has an infAP of 0.0485 (33/101). UJF-LIG also co-organized the task with the support of the Quaero programme while taking care of avoiding conflict between participation and organization. We defined a new version of the previous HLF detection task, now called semantic indexing. Two versions of the task were proposed with dierent numbers of concept to detect: 10 for the “light” version and 130 for the “full” version. We organized as in 2007-2009 the collaborative annotation for this task using an active learning approach. An improvement was made this year by the use of relations between concepts during the annotation process. We also assessed 30 additional concepts for the evaluations. 10 of them were included in the ocial TRECVID 2010 evaluation and 20 more were delivered later.

[1]  Emine Yilmaz,et al.  A simple and efficient sampling method for estimating AP and NDCG , 2008, SIGIR '08.

[2]  John R. Smith,et al.  Large-scale concept ontology for multimedia , 2006, IEEE MultiMedia.

[3]  Harry Wechsler,et al.  The FERET database and evaluation procedure for face-recognition algorithms , 1998, Image Vis. Comput..

[4]  Stéphane Ayache,et al.  Video Corpus Annotation Using Active Learning , 2008, ECIR.

[5]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[6]  Stéphane Ayache,et al.  Using Topic Concepts for Semantic Video Shots Classification , 2006, CIVR.

[7]  Karl Ricanek,et al.  MORPH: a longitudinal image database of normal adult age-progression , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[8]  Georges Quénot,et al.  CLIPS at TRECVID : Shot Boundary Detection and Feature Detection , 2003, TRECVID.

[9]  Hyeonjoon Moon,et al.  The FERET evaluation methodology for face-recognition algorithms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Koen E. A. van de Sande,et al.  A comparison of color features for visual concept classification , 2008, CIVR '08.

[11]  Christian Küblbeck,et al.  Face detection and tracking in video sequences using the modifiedcensus transformation , 2006, Image Vis. Comput..

[12]  Hazim Kemal Ekenel,et al.  A robust face recognition algorithm for real-world applications , 2009 .