Adding semantics to the reliable object annotated image databases

Abstract Semantically enriched multimedia information is crucial for equipping the kind of multimedia search potentials that professional searchers need. But the semantic interpretation of multimedia is obsolete without some mechanism for understanding semantic content that is not explicitly available. Manual annotation is the only source to overwhelming this, which is not only time consuming and costly but also lacks semantic enrichment in terms of concept diversity and concept enrichability. In this paper, we present semantically enhanced information extraction model that calculate the semantic intensity (SI) of each object in the image and then enhance the tagged concept with the assistance of lexical and conceptual knowledgebases .i.e. WordNet and ConceptNet. Noises, redundant and unusual words are then filtered out by means of various techniques like semantic similarity, stopwords and words unification. The experiment has been carried out on the LabelMe datasets. Results demonstrate the substantial improvement in terms of concept diversity, concept enrichment and retrieval performance.

[1]  Edward Y. Chang,et al.  CBSA: content-based soft annotation for multimodal image retrieval using Bayes point machines , 2003, IEEE Trans. Circuits Syst. Video Technol..

[2]  Latifur Khan,et al.  Knowledge Based Image Annotation Refinement , 2009, J. Signal Process. Syst..

[3]  Amr Ahmed,et al.  Video databases annotation enhancing using commonsense knowledgebases for indexing and retrieval , 2009 .

[4]  R. Manmatha,et al.  Automatic image annotation and retrieval using cross-media relevance models , 2003, SIGIR.

[5]  David A. Forsyth,et al.  Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary , 2002, ECCV.

[6]  Rong Jin,et al.  Regularizing translation models for better automatic image annotation , 2004, CIKM '04.

[7]  Stefan R ping.  SVM Classifier Estimation from Group Probabilities , 2010, ICML 2010.

[8]  Gustavo Carneiro,et al.  Formulating semantic image annotation as a supervised learning problem , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  R. Manmatha,et al.  Statistical models for automatic video annotation and retrieval , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[10]  Christos Faloutsos,et al.  Automatic multimedia cross-modal correlation discovery , 2004, KDD.

[11]  Daniel Gatica-Perez,et al.  Tagging and retrieving images with co-occurrence models: from corel to flickr , 2009, LS-MMRM '09.

[12]  Jianping Fan,et al.  Automatic image annotation by incorporating feature hierarchy and boosting to scale up SVM classifiers , 2006, MM '06.

[13]  Gvs Raj Kumar,et al.  IMAGE SEGMENTATION BY USING FINITE BIVARIATE DOUBLY TRUNCATED GAUSSIAN MIXTURE MODEL , 2010 .

[14]  B. Chandra Mohan,et al.  Content Based Image Retrieval Using Exact Legendre Moments and Support Vector Machine , 2010, ArXiv.