An Ontology-Driven Framework for the Management of Semantic Metadata Describing Audiovisual Information

In this paper, we describe a framework for the management of semantic metadata that describe audiovisual content. The main objectives of this work are to provide a framework allowing enhanced retrieval performance and better user interfaces for audiovisual data, based on extensions of the well accepted international standards for the digital media, digital broadcasting and TV-Anytime domains like TV-Anytime and MPEG-7, as well as to provide an interoperability framework between TV-Anytime and MPEG-7 for the rapidly expanding set of interoperating digital library and interactive TV applications. The framework was developed in the context of the UP-TV project, which investigates TV-Anytime architectures and services. Our approach is ontology-driven, in the sense that we provide ontology based domain-specific extensions of the standards for describing multimedia content. Several aspects of the framework are based on the existence of ontologies. Our framework allows the creation of more efficient user interfaces for accessing content, better retrieval performance and better support in the indexing phase. It also provides compatibility in indexing between the two standards and interoperability for TV-Anytime and digital library applications supported by TV-Anytime servers. We have developed a domain-specific ontology (football games) to test our framework ideas and implementation. The developed ontology uses as primitive modelling elements those provided by the MPEG-7 metadata model. The mapping of the ontology to TV-Anytime metadata primitives is straightforward. We show in detail the concrete implementation of the framework on top of relational databases and its interfaces with the other system components.

[1]  S. Christodoulakis,et al.  Development of a Stream Service in a Heterogeneous Client Environment , 2004 .

[2]  Anastasia Analyti,et al.  MULTIMEDIA OBJECT MODELLING AND CONTENT-BASED QUERYING , 2005 .

[3]  Klaus Meyer,et al.  The SICMA Multimedia Server and Virtual Museum Application , 1998, ECMAST.

[4]  Jim Gemmell,et al.  Delay-Sensitive Multimedia on Disks , 1994, IEEE MultiMedia.

[5]  Chrisa Tsinaraki,et al.  Towards a two-layered video metadata model , 2001, 12th International Workshop on Database and Expert Systems Applications.

[6]  Fumiko Satoh,et al.  Learning personalized video highlights from detailed MPEG-7 metadata , 2002, Proceedings. International Conference on Image Processing.

[7]  Chrisa Tsinaraki,et al.  The KYDONIA Multimedia Information Server , 1997, ECMAST.

[8]  Ahmed K. Elmagarmid,et al.  WVTDB - A Semantic Content-Based Video Database System on the World Wide Web , 1998, IEEE Trans. Knowl. Data Eng..

[9]  Chrisa Tsinaraki,et al.  A Video Metadata Model supporting Personalization & Recommendation in Video-based Services , 2001 .

[10]  Mohand-Said Hacid,et al.  A Database Approach for Modeling and Querying Video Data , 2000, IEEE Trans. Knowl. Data Eng..

[11]  Arif Ghafoor,et al.  Semantic Modeling and Knowledge Representation in Multimedia Databases , 1999, IEEE Trans. Knowl. Data Eng..

[12]  Stavros Christodoulakis,et al.  Design and Development of a Stream Service in a Heterogenous Client Environment , 2000, VLDB.

[13]  Franciska de Jong,et al.  MUMIS: Multimedia Indexing and Searching , 2001 .

[14]  William I. Grosky,et al.  Managing multimedia information in database systems , 1997, CACM.

[15]  Mohand-Said Hacid,et al.  A database approach for modeling and querying video data , 1999, Proceedings 15th International Conference on Data Engineering (Cat. No.99CB36337).