The explosive growth of image data on the web leads to the research and development of visual information retrieval systems. How- ever, these visual contents do not allow user to query images using seman- tic meanings. To resolve this problem, automatically annotating images with a list of semantic concepts is an essential and benecial task. In this paper, we describe our approach for annotating images with con- trolled semantic concepts, which is a scalable concept image annotation subtask in the Photo Annotation and Retrieval task of the ImageCLEF 2013. We label training images with semantic concepts. After that, given a test image, the most k similar images are retrieved from the training image set. And nally, we extract and aggregate the concepts of the k matched training images, and choose the top n concepts as annotation. In our proposed method, the textual concepts of the training images are weighted by introducing BM25. Then, we utilizes some combination of visual features vectors, which are constructed from global descriptor such as color histogram, gist as well as local descriptor including SIFT and some variations of SIFT. The visual feature vectors are used to measure the similarity between two images by employing cosine similarity or in- verse distance similarity (IDsim) that we introduce here. For a given test image, we nd the k-nearest neighbors (kNN ) from the training image set based on the image similarity values. Furthermore, we aggregate the concepts of the kNN images, and choose top n concepts as annotation. We evaluate our methods by estimating F -measure and mean average precision (MAP). The result turns out that our system achieves the av- erage performance in this subtask.
[1]
Jonathan Goldstein,et al.
When Is ''Nearest Neighbor'' Meaningful?
,
1999,
ICDT.
[2]
Stephen E. Robertson,et al.
Okapi at TREC-7: Automatic Ad Hoc, Filtering, VLC and Interactive
,
1998,
TREC.
[3]
Stephen E. Robertson,et al.
A probabilistic model of information retrieval: development and comparative experiments - Part 1
,
2000,
Inf. Process. Manag..
[4]
Otis Gospodnetic,et al.
Lucene in Action
,
2004
.
[5]
B. Thomee,et al.
Overview of the ImageCLEF 2013 Scalable Concept Image Annotation Subtask
,
2013,
CLEF.
[6]
Miguel Cazorla,et al.
ImageCLEF 2013: The Vision, the Data and the Open Challenges
,
2013,
CLEF.
[7]
Stephen E. Robertson,et al.
A probabilistic model of information retrieval: development and comparative experiments - Part 2
,
2000,
Inf. Process. Manag..