An Integrative Semantic Framework for Image Annotation and Retrieval

Most public image retrieval engines utilise free-text search mechanisms, which often return inaccurate matches as they in principle rely on statistical analysis of query keyword recurrence in the image annotation or surrounding text. In this paper we present a semantically-enabled image annotation and retrieval engine that relies on methodically structured ontologies for image annotation, thus allowing for more intelligent reasoning about the image content and subsequently obtaining a more accurate set of results and a richer set of alternatives matchmaking the original query. Our semantic retrieval technology is designed to satisfy the requirements of the commercial image collections market in terms of both accuracy and efficiency of the retrieval process. We also present our efforts in further improving the recall of our retrieval technology by deploying an efficient query expansion technique.

[1]  Ellen M. Voorhees,et al.  Query expansion using lexical-semantic relations , 1994, SIGIR '94.

[2]  Christiane Fellbaum,et al.  Book Reviews: WordNet: An Electronic Lexical Database , 1999, CL.

[3]  David Al-Dabass,et al.  Semantic-Driven Matchmaking of Web Services Using Case-Based Reasoning , 2006, 2006 IEEE International Conference on Web Services (ICWS'06).

[4]  Alan L. Rector,et al.  Modularisation of domain ontologies implemented in description logics and related formalisms including OWL , 2003, K-CAP '03.

[5]  Hiroshi Ishikawa,et al.  Semantic Image Retrieval based on Ontology and Relevance Model - A Preliminary Study , 2005, J. Digit. Inf. Manag..

[6]  A. T. Schreiber,et al.  Semantic Annotation of Image Collections , 2003 .

[7]  P. Smith,et al.  A review of ontology based query expansion , 2007, Inf. Process. Manag..

[8]  Hsinchun Chen Machine learning for information retrieval: neural networks, symbolic learning, and genetic algorithms , 1995 .

[9]  Jonathon S. Hare,et al.  Mind the gap: another look at the problem of the semantic gap in image retrieval , 2006, Electronic Imaging.

[10]  Samson W. Tu,et al.  Protégé-2000: An Open-Source Ontology-Development and Knowledge-Acquisition Environment: AMIA 2003 Open Source Expo , 2003, AMIA.

[11]  Rahul Singh,et al.  Semantically Relevant Image Retrieval by Combining Image and Linguistic Analysis , 2006, ISVC.

[12]  Paola Velardi,et al.  Learning Domain Ontologies from Document Warehouses and Dedicated Web Sites , 2004, CL.

[13]  Wei-Ying Ma,et al.  Probabilistic query expansion using query logs , 2002, WWW '02.

[14]  Paola Velardi,et al.  A Taxonomy Learning Method and Its Application to Characterize a Scientific Web Community , 2007, IEEE Transactions on Knowledge and Data Engineering.

[15]  J. Carroll,et al.  Jena: implementing the semantic web recommendations , 2004, WWW Alt. '04.

[16]  Liang-Tien Chia,et al.  Does ontology help in image retrieval?: a comparison between keyword, text ontology and multi-modality ontology approaches , 2006, MM '06.

[17]  Mark Fischetti,et al.  Weaving the web - the original design and ultimate destiny of the World Wide Web by its inventor , 1999 .

[18]  Terje Brasethvik,et al.  Semantic enrichment for improving systems interoperability , 2004, SAC '04.

[19]  W. Bruce Croft,et al.  Improving the effectiveness of information retrieval with local context analysis , 2000, TOIS.

[20]  Eli Hustad,et al.  Knowledge networking in global organizations: the transfer of knowledge , 2004, SIGMIS CPR '04.

[21]  Fred Stentiford,et al.  Recent Trends in Video Analysis: A Taxonomy of Video Classification Problems , 2002, IMSA.