Semantic video content indexing and retrieval using conceptual graphs

This paper proposes a model for the indexing and retrieval of semantic video content using conceptual graphs. Conceptual graph based indexing is even better since not only nonambiguous concepts are used but also relations between these concepts are indexed. The proposed model allows video content representation both at the semantic and at the signal levels. The signal based representation is done via the perceptive view using classical signal descriptors. The representation by conceptual graph allows a more precise description of the content and it also allows the linking between the involved concepts and the sub Medias of the video documents. The various concepts and relations involved in the model can be taken from general and/or domain specific ontologies and completed by lists of instances. the correspondence between the query and any document is searched as a projection of the graph representing the query on the graph representing the document. This projection is done using the substitution rules permitted by the ontology.

[1]  Ulrich Thiel,et al.  Designing for Semantic Access: A Video Browsing System , 2004, Multimedia Tools and Applications.

[2]  Bruno Bachimont,et al.  Une ontologie pour éditer des schémas de description audiovisuels, extension pour l'inférence sur les descriptions , 2000 .

[3]  John F. Sowa,et al.  Conceptual Structures: Information Processing in Mind and Machine , 1983 .

[4]  Ulrich Thiel,et al.  Designing for Semantic Access: A Video Browsing System , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[5]  N. F. Noy,et al.  Ontology Development 101: A Guide to Creating Your First Ontology , 2001 .

[6]  Jianping Fan,et al.  Hierarchical video content description and summarization using unified semantic and visual similarity , 2003, Multimedia Systems.

[7]  Shih-Fu Chang,et al.  Spatio-temporal video search using the object based video representation , 1997, Proceedings of International Conference on Image Processing.

[8]  Philippe Mulhem,et al.  A Conceptual Graph Approach for Video Data Representation and Retrieval , 1999, IDA.

[9]  Alberto Del Bimbo,et al.  Efficient Matching and Indexing of Graph Models in Content-Based Retrieval , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Willem Jonker,et al.  A Framework for Video Modeling , 2000 .

[11]  Forouzan Golshani,et al.  Retrieval and delivery of information in multimedia database systems , 1994, Inf. Softw. Technol..

[12]  Natalya F. Noy,et al.  A Guide to Creating Your First Ontology , 2002 .

[13]  Mourad Mechkour,et al.  EMIR2: An Extended Model for Image Representation and Retrieval , 1995, DEXA.

[14]  W. Jonker,et al.  A FRAMEWORK FOR VIDEO MODELLING , 2000 .

[15]  Pasquale Savino,et al.  An Approach to a Content-Based Retrieval of Multimedia Data , 1998, Multimedia Tools and Applications.

[16]  John R. Smith,et al.  VideoAnnEx: IBM MPEG-7 Annotation Tool for Multimedia Indexing and Concept Learning , 2003 .

[17]  Rune Hjelsvold,et al.  Modelling and Querying Video Data , 1994, VLDB.