Enquiring MPEG-7 based multimedia ontologies

Machine understandable metadata forms the main prerequisite for the intelligent services envisaged in a Web, which going beyond mere data exchange and provides for effective content access, sharing and reuse. MPEG-7, despite providing a comprehensive set of tools for the standardised description of audiovisual content, is largely compromised by the use of XML that leaves the largest part of the intended semantics implicit. Aspiring to formalise MPEG-7 descriptions and enhance multimedia metadata interoperability, a number of multimedia ontologies have been proposed. Though sharing a common vision, the developed ontologies are characterised by substantial conceptual differences, reflected both in the modelling of MPEG-7 description tools as well as in the linking with domain ontologies. Delving into the principles underlying their engineering, we present a systematic survey of the state of the art MPEG-7 based multimedia ontologies, and highlight issues that hinder interoperability as well as possible directions towards their harmonisation.

[1]  L. Stein,et al.  OWL Web Ontology Language - Reference , 2004 .

[2]  Steffen Staab,et al.  Introducing Context and Reasoning in Visual Content Analysis: An Ontology-Based Framework , 2008 .

[3]  James A. Hendler,et al.  The Semantic Web" in Scientific American , 2001 .

[4]  Ermanno Bencivenga.  That Obscure Object of Desire , 1988 .

[5]  Huajun Chen,et al.  The Semantic Web , 2011, Lecture Notes in Computer Science.

[6]  José María Martínez Sanchez.  MPEG-7: Overview of MPEG-7 Description Tools, Part 2 , 2002, IEEE Multim..

[7]  Nicola Guarino,et al.  Sweetening Ontologies with DOLCE , 2002, EKAW.

[8]  Jane Hunter,et al.  Evaluating the application of semantic inferencing rules to image annotation , 2005, K-CAP '05.

[9]  Steffen Staab,et al.  An Ontology Infrastructure for Multimedia Reasoning , 2005, VLBV.

[10]  Steffen Staab,et al.  Knowledge representation and semantic annotation of multimedia content , 2006 .

[11]  Georgios Paliouras,et al.  A BOOTSTRAPPING APPROACH TO KNOWLEDGE ACQUISITION FROM MULTIMEDIA CONTENT WITH ONTOLOGY EVOLUTION , 2005 .

[12]  Chrisa Tsinaraki,et al.  Integration of OWL Ontologies in MPEG-7 and TV-Anytime Compliant Semantic Indexing , 2004, CAiSE.

[13]  Susanne Boll,et al.  Multimedia Vocabularies on the Semantic Web , 2007 .

[14]  Chrisa Tsinaraki,et al.  Interoperability of XML Schema Applications with OWL Domain Knowledge and Semantic Web Tools , 2007, OTM Conferences.

[15]  Steffen Staab,et al.  Knowledge Representation for Semantic Multimedia Content Analysis and Reasoning , 2004, EWIMT.

[16]  Ian Horrocks,et al.  OWL Web Ontology Language Reference-W3C Recommen-dation , 2004 .

[17]  Michael Sintek,et al.  Towards Bridging the Semantic Gap in Multimedia Annotation and Retrieval , 2006 .

[18]  Chrisa Tsinaraki,et al.  Interoperability Support between MPEG-7/21 and OWL in DS-MIRF , 2007, IEEE Transactions on Knowledge and Data Engineering.

[19]  G Stix,et al.  The mice that warred. , 2001, Scientific American.

[20]  Anupriya Ankolekar,et al.  DOLCE ergo SUMO: On foundational and domain models in the SmartWeb Integrated Ontology (SWIntO) , 2007, J. Web Semant..

[21]  Steffen Staab,et al.  COMM: Designing a Well-Founded Multimedia Ontology for the Web , 2007, ISWC/ASWC.

[22]  Jane Hunter,et al.  Adding Multimedia to the Semantic Web: Building an MPEG-7 ontology , 2001, SWWS.

[23]  J. Albert Bowden.  DC Dublin Core META Tags - DCMI Dublin Core Metadata Initiative , 2008 .

[24]  Paul Buitelaar,et al.  Modeling Linguistic Facets of Multimedia Content for Semantic Annotation , 2007, SAMT.

[25]  Raphaël Troncy,et al.  MPEG-7 based Multimedia Ontologies: Interoperability Support or Interoperability Issue? , 2007 .

[26]  Dan Brickley,et al.  Rdf vocabulary description language 1.0 : Rdf schema , 2004 .

[27]  Aldo Gangemi,et al.  Ontology Design Patterns for Semantic Web Content , 2005, SEMWEB.

[28]  P. Beek,et al.  Text of 15938-5 FCD Information Technology-Multimedia Content Description Interface-Pard 5 Multimedia Description Schemes , 2001 .

[29]  Rosa Gil,et al.  Facilitating Business Interoperability from the Semantic Web , 2007, BIS.

[30]  Lynda Hardman,et al.  That Obscure Object of Desire: Multimedia Metadata on the Web, Part 1 , 2004, IEEE Multim..

[31]  Janko Calic,et al.  European Workshop on the Integration of Knowledge, Semantics and Digital Media Technology , 2004 .

[32]  Chrisa Tsinaraki,et al.  MPEG-7 and the Semantic Web , 2007 .

[33]  José M. Martínez.  Standards - MPEG-7 overview of MPEG-7 description tools, part 2 , 2002 .

[34]  Yiannis Kompatsiaris,et al.  Semantic Multimedia and Ontologies: Theory and Applications , 2008 .

[35]  Roberto García,et al.  Semantic Integration and Retrieval of Multimedia Metadata , 2005, SemAnnot@ISWC.

[36]  Jane Hunter,et al.  Realizing the hydrogen economy through Semantic Web technologies , 2004, IEEE Intelligent Systems.

[37]  Jane Hunter,et al.  Rules-By-Example - A Novel Approach to Semantic Indexing and Querying of Images , 2004, SEMWEB.

[38]  Rosa Gil,et al.  A web ontologies framework for digital rights management , 2007, Artificial Intelligence and Law.

[39]  Jane Hunter,et al.  The ABC Ontology and Model , 2001, J. Digit. Inf..

[40]  Michael G. Strintzis,et al.  Capturing MPEG-7 Semantics , 2007, MTSR.

[41]  Adam Pease,et al.  Towards a standard upper ontology , 2001, FOIS.