Automatic Thematic Categorization of Multimedia Documents using Ontological Information and Fuzzy Algebra

The semantic gap is the main problem of content based multimedia retrieval. This refers to the extraction of the semantic content of multimedia documents, the understanding of user information needs and requests, as well as to the matching between the two. In this chapter we focus on the analysis of multimedia documents for the extraction of their semantic content. Our approach is based on fuzzy algebra, as well as fuzzy ontological information. We start by outlining the methodologies that may lead to the creation of a semantic index; these methodologies are integrated in a video annotating environment. Based on the semantic index, we then explain how multimedia content may be analyzed for the extraction of semantic information in the form of thematic categorization. The latter relies on stored knowledge and a fuzzy hierarchical clustering algorithm that uses a similarity measure that is based on the notion of context.

[1]  Kostas Karpouzis,et al.  The Electronic Road: Personalized Content Browsing , 2003, IEEE Multim..

[2]  Yiming Yang,et al.  An Evaluation of Statistical Approaches to Text Categorization , 1999, Information Retrieval.

[3]  B. Ripley,et al.  Pattern Recognition , 1968, Nature.

[4]  John R. Smith,et al.  MPEG-7 multimedia description schemes , 2001, IEEE Trans. Circuits Syst. Video Technol..

[5]  Shih-Fu Chang,et al.  VISMap: an interactive image/video retrieval system using visualization and concept maps , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[6]  Stefanos D. Kollias,et al.  Context - Sensitive Query Expansion Based on Fuzzy Clustering of Index Terms , 2002, FQAS.

[7]  Peter B. Danzig,et al.  Scalable Internet resource discovery: research problems and approaches , 1994, CACM.

[8]  George J. Klir,et al.  Fuzzy sets and fuzzy logic - theory and applications , 1995 .

[9]  Yannis Avrithis,et al.  Intelligent Semantic Access to Audiovisual Content , 2002, SETN.

[10]  Donald H. Kraft,et al.  Information retrieval systems: where is the fuzz? , 1998, 1998 IEEE International Conference on Fuzzy Systems Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36228).

[11]  Didier Dubois,et al.  The three semantics of fuzzy sets , 1997, Fuzzy Sets Syst..

[12]  Manolis Wallace,et al.  A MEDIATOR SYSTEM FOR HETERO-LINGUAL AUDIOVISUAL CONTENT , 2004 .

[13]  Simone Santini,et al.  Exploratory Image Databases: Content-Based Retrieval , 2001 .

[14]  William I. Grosky,et al.  Narrowing the semantic gap - improved text-based web document retrieval using visual features , 2002, IEEE Trans. Multim..

[15]  Peter G. B. Enser,et al.  Visual image retrieval , 2008, Annu. Rev. Inf. Sci. Technol..

[16]  Yannis Avrithis,et al.  An Intelligent System for Retrieval and Mining of Audiovisual Material Based on the MPEG-7 Description Schemes , 2001 .

[17]  Sadaaki Miyamoto,et al.  Fuzzy Sets in Information Retrieval and Cluster Analysis , 1990, Theory and Decision Library.

[18]  P. Beek,et al.  Text of 15938-5 FCD Information Technology-Multimedia Content Description Interface-Pard 5 Multimedia Description Schemes , 2001 .

[19]  Raimondo Schettini,et al.  A relevance feedback mechanism for content-based image retrieval , 1999, Inf. Process. Manag..

[20]  Michael McGill,et al.  Introduction to Modern Information Retrieval , 1983 .

[21]  Yannis Avrithis,et al.  Knowledge-Based Multimedia Content Indexing and Retrieval , 2005, Multimedia Content and the Semantic Web.

[22]  Giorgos Stamou,et al.  Knowledge – Assisted Video Analysis and Object Detection , 2002 .

[23]  Giorgos Stamou,et al.  Context-sensitive semantic query expansion , 2002, Proceedings 2002 IEEE International Conference on Artificial Intelligence Systems (ICAIS 2002).

[24]  Peter B. Danzig,et al.  Scalable Internet resource discovery : research problems and approaches : Internet technology , 1994 .

[25]  Peter G. B. Enser,et al.  Activity theory and information seeking , 2008 .

[26]  Dimitar P. Filev,et al.  Fuzzy SETS AND FUZZY LOGIC , 1996 .

[27]  Yueting Zhuang,et al.  Accommodating hybrid retrieval in a comprehensive video database management system , 2002, IEEE Trans. Multim..