Towards a Semantic Multi-modalities Description of Audiovisual Documents

The description of an audiovisual document represents a major challenge for multimedia retrieval. Indeed, the lack of descriptive metadata extraction makes these proliferated resources underused in the querying process. To overcome these difficulties, the extraction of the semantic metadata of the content and the different structures of an audiovisual document is required. In this paper, we present a method that enables an automatic description of audiovisual documents. This automatic process is mainly based on the use of a multitude of modalities for the description and modeling of audiovisual documents, the standardization of these descriptions in the MPEG-7 standard through its description definition language (DDL) and on the use of semantic web language to link between the audiovisual resources.

[1]  John S. Boreczky,et al.  Indexes for user access to large video databases , 1994, Electronic Imaging.

[2]  Mohamed Ben Ahmed,et al.  An approach of a semantic annotation and thematisation of AV documents , 2010, 2010 10th International Conference on Intelligent Systems Design and Applications.

[3]  Yannick Prié,et al.  Advene as a tailorable hypervideo authoring tool: a case study , 2012, DocEng '12.

[4]  Georges Quénot,et al.  Une Approche Conceptuelle pour la Modlisation et la Structuration Smantique des Documents Vidos , 2005 .

[5]  Antoine Isaac.  Conception et utilisation d'ontologies pour l'indexation de documents audovisuels , 2005 .

[6]  Raphaël Troncy.  Formalisation des connaissances documentaires et des connaissances conceptuelles à l'aide d'ontologies : application à la description de documents audiovisuels. (Formalization of documentary knowledge and conceptual knowledge with ontologies: applying to the description of audio-visual documents) , 2004 .

[7]  Gwendal Auffret.  Structuration de documents audiovisuels et publication électronique : Constitution d'une chaîne éditoriale numérique pour la mise en ligne de collections audiovisuelles , 2000 .

[8]  Minh Phung Bui Thi.  La structuration sémantique des contenus des documents audiovisuels selon les points de vue de la production , 2003 .

[9]  Slim Essid,et al.  Smooth Nonnegative Matrix Factorization for Unsupervised Audiovisual Document Structuring , 2013, IEEE Transactions on Multimedia.

[10]  Faïez Gargouri,et al.  Automatic Audiovisual Documents Genre Description , 2014, KDIR.

[11]  Yannick Prié,et al.  A graph based audio-visual document annotation and browsing system , 2000, RIAO.

[12]  Katsumi Tanaka,et al.  OVID: Design and Implementation of a Video-Object Database System , 1993, IEEE Trans. Knowl. Data Eng..

[13]  Youssef Chahir,et al.  Détection et extraction automatique de texte dans une vidéo: une approche par morphologie mathématique , 2002 .

[14]  Tinne Tuytelaars,et al.  Content-based analysis for accessing audiovisual archives: Alternatives for concept-based indexing and search , 2012, 2012 13th International Workshop on Image Analysis for Multimedia Interactive Services.

[15]  Rafael Lozano Espinosa.  Intégration de données vidéo dans un SGBD à objets , 2000 .