Domain Knowledge Based Queries for Multimedia Data Retrieval

This paper describes an approach for semantic description and retrieval of multimedia data described by means of MPEG-7. This standard uses XML schema to define the descriptions. Therefore, it lacks ability to represent the data semantics in a formal and concise way and it does not allow integration and use of domain specific knowledge. Moreover, inference mechanisms are not provided and hence the extraction of implicit information is not (always) possible. To address these issues, we propose to add a conceptual layer on top of MPEG-7 metadata layer, where the domain knowledge is represented using a formal language. A set of mapping rules is proposed. They serve as a bridge between the two layers. Querying MPEG-7 descriptions using XML query languages such as XPath or XQuery requires to know MPEG-7 syntax and documents structure. To provide a flexible query formulation, we exploit the conceptual layer vocabulary to express user queries. A user query, making reference to terms specified at the conceptual level, is rewritten into an XQuery expression over MPEG-7 descriptions.

[1]  Peiya Liu.  Queries of Digital Content Descriptions in MPEG-7 and MPEG-21 XML documents , 2002 .

[2]  Omar Abou Khaled,et al.  An XQuery Adaptation for MPEG-7 Documents Retrieval , 2003 .

[3]  Alon Y. Halevy,et al.  Combining Horn Rules and Description Logics in CARIN , 1998, Artif. Intell..

[4]  Zhang Hai-ling.  Semantic Integration and Retrieval of Multimedia Metadata , 2007 .

[5]  Diego Calvanese,et al.  The Description Logic Handbook: Theory, Implementation, and Applications , 2003, Description Logic Handbook.

[6]  Shih-Fu Chang,et al.  MPEG-7 MDS Content Description Tools and Applications , 2001, CAIP.

[7]  Thomas R. Gruber,et al.  A translation approach to portable ontology specifications , 1993, Knowl. Acquis..

[8]  Jane Hunter,et al.  Adding Multimedia to the Semantic Web: Building an MPEG-7 ontology , 2001, SWWS.

[9]  Chrisa Tsinaraki,et al.  Integration of OWL Ontologies in MPEG-7 and TV-Anytime Compliant Semantic Indexing , 2004, CAiSE.

[10]  Chutiporn Anutariya,et al.  A Schema Language for MPEG-7 , 2002, ICADL.

[11]  Ji-Hoon Kang,et al.  An XQuery engine for digital library systems , 2003, 2003 Joint Conference on Digital Libraries, 2003. Proceedings..

[12]  Mounia Lalmas,et al.  Video retrieval using an MPEG-7 based inference network , 2002, SIGIR '02.

[13]  Raphaël Troncy.  Formalisation des connaissances documentaires et des connaissances conceptuelles à l'aide d'ontologies : application à la description de documents audiovisuels. (Formalization of documentary knowledge and conceptual knowledge with ontologies: applying to the description of audio-visual documents) , 2004 .