USING CONTEXT AND FUZZY RELATIONS TO INTERPRET MULTIMEDIA CONTENT

Object detection techniques are coming closer to the automatic detection and identification of objects in multimedia documents. Still, this is not sufficient for the understanding of multimedia content, mainly because a simple object may be related to multiple topics, few of which are indeed related to a given document. In this paper we determine the thematic categories that are related to a document based on the objects that have been automatically detected in it. Our approach relies on stored knowledge and a fuzzy hierarchical clustering algorithm; this algorithm uses a similarity measure that is based on the notion of context. The context is extracted using fuzzy ontological relations.

[1]  George J. Klir,et al.  Fuzzy sets and fuzzy logic , 1995 .

[2]  George J. Klir,et al.  Fuzzy sets and fuzzy logic - theory and applications , 1995 .

[3]  Franco Casalino,et al.  MPEG-4: A Multimedia Standard for the Third Millennium, Part 1 , 1999, IEEE Multim..

[4]  Franco Casalino,et al.  MPEG-4: A Multimedia Standard for the Third Millennium, Part 2 , 2000, IEEE Multim..

[5]  Frank Nack,et al.  Everything You Wanted to Know About MPEG-7: Part 1 , 1999, IEEE Multim..

[6]  Frank Nack,et al.  Everything You Wanted to Know About MPEG-7: Part 2 , 1999, IEEE Multim..

[7]  Raimondo Schettini,et al.  A relevance feedback mechanism for content-based image retrieval , 1999, Inf. Process. Manag..

[8]  Siegfried Gottwald,et al.  Fuzzy Sets and Fuzzy Logic , 1993 .

[9]  Sergios Theodoridis,et al.  Pattern Recognition , 1998, IEEE Trans. Neural Networks.

[10]  Giorgos Stamou,et al.  Knowledge – Assisted Video Analysis and Object Detection , 2002 .

[11]  Giorgos Stamou,et al.  Context-sensitive semantic query expansion , 2002, Proceedings 2002 IEEE International Conference on Artificial Intelligence Systems (ICAIS 2002).

[12]  Francesco M. Donini,et al.  A Logic for SVG Documents Query and Retrieval , 2004, Multimedia Tools and Applications.