Enabling Multimedia Metadata Interoperability by Defining Formal Semantics of MPEG-7 Profiles

MPEG-7 can be used to create complex and comprehensive metadata descriptions of multimedia content. Since MPEG-7 is defined in terms of an XML schema, the semantics of its elements have no formal grounding. In addition, certain features can be described in multiple ways. MPEG-7 profiles are subsets of the standard that apply to specific application areas, which can be used to reduce this syntactic variability, but they still lack formal semantics. In this paper, we propose an approach for expressing semantics explicitly by formalizing the semantic constraints of a profile using ontologies and rules, thus enabling interoperability and automatic use for MPEG-7 based applications. We demonstrate the feasibility of the approach by implementing a validation service for a subset of the semantic constraints of the Detailed Audiovisual Profile (DAVP).

[1]  E. R. Allred,et al.  Language Reference , 1997 .

[2]  Werner Bailer,et al.  MPEG-7-based description infrastructure for an audiovisual content analysis and retrieval system , 2005, IS&T/SPIE Electronic Imaging.

[3]  Francesco M. Donini,et al.  AL-log: Integrating Datalog and Description Logics , 1998, Journal of Intelligent Information Systems.

[4]  Raphaël Troncy,et al.  Integrating Structure and Semantics into Audio-visual Documents , 2003, SEMWEB.

[5]  Ian Horrocks,et al.  Description logic programs: combining logic programs with description logic , 2003, WWW '03.

[6]  Raphaël Troncy,et al.  A reduced yet extensible audio-visual description language , 2004, DocEng '04.

[7]  Alon Y. Halevy,et al.  Combining Horn Rules and Description Logics in CARIN , 1998, Artif. Intell..

[8]  Zhang Hai-ling.  Semantic Integration and Retrieval of Multimedia Metadata , 2007 .

[9]  Jane Hunter,et al.  Adding Multimedia to the Semantic Web: Building an MPEG-7 ontology , 2001, SWWS.

[10]  Ermanno Bencivenga.  That Obscure Object of Desire , 1988 .

[11]  P. Beek,et al.  Text of 15938-5 FCD Information Technology-Multimedia Content Description Interface-Pard 5 Multimedia Description Schemes , 2001 .

[12]  Lynda Hardman,et al.  That Obscure Object of Desire: Multimedia Metadata on the Web, Part 1 , 2004, IEEE Multim..

[13]  Ian Horrocks,et al.  OWL rules: A proposal and prototype implementation , 2005, J. Web Semant..

[14]  Werner Bailer,et al.  Detailed audiovisual profile: enabling interoperability between MPEG-7 based systems , 2006, 2006 12th International Multi-Media Modelling Conference.

[15]  Ian Horrocks,et al.  Combining logic programs with description logics , 2003, The Web Conference.

[16]  C. Tsinaraki,et al.  Interoperability Support for Ontology-Based Video Retrieval Applications , 2004, CIVR.

[17]  Ian Horrocks,et al.  From SHIQ and RDF to OWL: the making of a Web Ontology Language , 2003, J. Web Semant..

[18]  Jane Hunter,et al.  An overview of the MPEG-7 Description Definition Language (DDL) proposals , 2000, Signal Process. Image Commun..

[19]  H. Lan,et al.  SWRL : A semantic Web rule language combining OWL and ruleML , 2004 .

[20]  Jane Hunter,et al.  Combining RDF and XML schemas to enhance interoperability between metadata application profiles , 2001, WWW '01.