KDEVIR at ImageCLEF 2014 Scalable Concept Image Annotation Task: Ontology based Automatic Image Annotation

y Abstract. In this paper, we describe our participation in the Image- CLEF 2014 Scalable Concept Image Annotation task. In this partici- pation, we propose a novel approach of automatic image annotation by using ontology at several steps of supervised learning. In this regard, we construct tree-like ontology for each annotating concept of images using WordNet and Wikipedia as primary source of knowledge. The con- structed ontologies are used throughout the proposed framework includ- ing several phases of training and testing of one-vs-all SVMs classier. Experimental results clearly demonstrate the effectiveness of the pro- posed framework.

[1]  Raphaël Marée,et al.  Fast Multi-class Image Annotation with Random Subwindows and Multiple Output Randomized Trees , 2009, VISAPP.

[2]  Xiaojun Qi,et al.  Incorporating multiple SVMs for automatic image annotation , 2007, Pattern Recognit..

[3]  Jon Atle Gulla,et al.  Sentiment Learning on Product Reviews via Sentiment Ontology Tree , 2010, ACL.

[4]  Dieter Fensel,et al.  Knowledge Engineering: Principles and Methods , 1998, Data Knowl. Eng..

[5]  Jason Weston,et al.  Large scale image annotation: learning to rank with joint word-image embeddings , 2010, Machine Learning.

[6]  Maozhen Li,et al.  Parallelizing multiclass Support Vector Machines for scalable image annotation , 2011, FSKD.

[7]  Wei-Ying Ma,et al.  Hierarchical clustering of WWW image search results using visual, textual and link information , 2004, MULTIMEDIA '04.

[8]  George A. Miller,et al.  WordNet: A Lexical Database for English , 1995, HLT.

[9]  Thomas R. Gruber,et al.  Toward principles for the design of ontologies used for knowledge sharing? , 1995, Int. J. Hum. Comput. Stud..

[10]  R. Manmatha,et al.  Automatic Image Annotation and Retrieval using CrossMedia Relevance Models , 2003 .

[11]  Hichem Sahbi,et al.  Context-Dependent Kernels for Object Classification , 2011, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Mette Skov,et al.  CLEF 2013 Evaluation Labs and Workshop, Online Working Notes , 2013 .

[13]  Md. Monirul Islam,et al.  A review on automatic image annotation techniques , 2012, Pattern Recognit..

[14]  Yangqing Jia,et al.  Deep Convolutional Ranking for Multilabel Image Annotation , 2013, ICLR.

[15]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[16]  R GruberThomas.  Toward principles for the design of ontologies used for knowledge sharing , 1995 .

[17]  Farshad Fotouhi,et al.  Image content annotation using Bayesian framework and complement components analysis , 2005, IEEE International Conference on Image Processing 2005.

[18]  Maya R. Gupta,et al.  Training highly multiclass classifiers , 2014, J. Mach. Learn. Res..

[19]  Hichem Sahbi,et al.  CNRS - TELECOM ParisTech at ImageCLEF 2013 Scalable Concept Image Annotation Task: Winning Annotations with Context Dependent SVMs , 2013, CLEF.

[20]  Jae Won Lee,et al.  Content-based image classification using a neural network , 2004, Pattern Recognit. Lett..

[21]  Roberto Paredes,et al.  Overview of the ImageCLEF 2016 Scalable Concept Image Annotation Task , 2016, CLEF.

[22]  Tat-Seng Chua,et al.  A Novel Approach to Auto Image Annotation Based on Pairwise Constrained Clustering and Semi-Naïve Bayesian Model , 2005, 11th International Multimedia Modelling Conference.

[23]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[24]  Miguel Cazorla,et al.  ImageCLEF 2014: Overview and Analysis of the Results , 2014, CLEF.

[25]  Stephen E. Robertson,et al.  Okapi at TREC-7: Automatic Ad Hoc, Filtering, VLC and Interactive , 1998, TREC.

[26]  Wei-Ying Ma,et al.  AnnoSearch: Image Auto-Annotation by Search , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).