M-OntoMat-Annotizer: Image Annotation Linking Ontologies and Multimedia Low-Level Features

Annotations of multimedia documents typically have been pursued in two different directions. Either previous approaches have focused on low level descriptors, such as dominant color, or they have focused on the content dimension and corresponding annotations, such as person or vehicle. In this paper, we present a software environment to bridge between the two directions. M-OntoMat-Annotizer allows for linking low level MPEG-7 visual descriptions to conventional Semantic Web ontologies and annotations. We use M-OntoMat-Annotizer in order to construct ontologies that include prototypical instances of high-level domain concepts together with a formal specification of corresponding visual descriptors. Thus, we formalize the interrelationship of high- and low-level multimedia concept descriptions allowing for new kinds of multimedia content analysis, reasoning and retrieval.

[1]  Masahito Hirakawa,et al.  Knowledge-assisted content-based retrieval for multimedia databases , 1994, 1994 Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[2]  JainRamesh,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000 .

[3]  A. T. Schreiber,et al.  Semantic Annotation of Image Collections , 2003 .

[4]  R. Brunelli,et al.  A Survey on Video Indexing , 1996 .

[5]  Yiannis Kompatsiaris,et al.  Using a Multimedia Ontology Infrastructure for Semantic Annotation of Multimedia Content , 2005, SemAnnot@ISWC.

[6]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Monique Thonnat,et al.  Ontology based object learning and recognition: application to image retrieval , 2004, 16th IEEE International Conference on Tools with Artificial Intelligence.

[8]  Jane Hunter,et al.  Realizing the hydrogen economy through Semantic Web technologies , 2004, IEEE Intelligent Systems.

[9]  Steffen Staab,et al.  CREAM: CREAting Metadata for the Semantic Web , 2003, Comput. Networks.

[10]  Thierry Declerck,et al.  The Automatic Generation of Formal Annotations in a Multimedia Indexing and Searching Environment , 2001, HTLKM@ACL.

[11]  Michael G. Strintzis,et al.  Multimedia Content Indexing and Retrieval Using an Object Ontology , 2005, Multimedia Content and the Semantic Web.

[12]  Shih-Fu Chang,et al.  Overview of the MPEG-7 standard , 2001, IEEE Trans. Circuits Syst. Video Technol..

[13]  R. Brunelli,et al.  A Survey on the Automatic Indexing of Video Data, , 1999, J. Vis. Commun. Image Represent..

[14]  Steffen Staab,et al.  Semantic Annotation of Images and Videos for Multimedia Analysis , 2005, ESWC.

[15]  Robert Tansley,et al.  Automating the linking of content and concept , 2000, ACM Multimedia.

[16]  Bob J. Wielinga,et al.  Ontology-Based Photo Annotation , 2001, IEEE Intell. Syst..