Correlation-Based Video Semantic Concept Detection Using Multiple Correspondence Analysis

Semantic concept detection has emerged as an intriguing topic in multimedia research recently. The ability to interpret high-level semantics from low-level features has been the long desired goal of many researchers. In this paper, we propose a novel framework that utilizes the ability of multiple correspondence analysis (MCA) to explore the correlation between different items (feature-value pairs) and classes (concepts) to bridge the gap between the extracted low-level features and high-level semantic concepts. Using the concepts and benchmark data identified and provided by the TRECVID project, we have shown that our proposed framework demonstrates promising results and performs better than the decision tree (DT),support vector machine (SVM), and naive Bayesian (NB) classifiers that are commonly applied to the TRECVID datasets.

[1]  Mei-Ling Shyu,et al.  Effective Feature Space Reduction with Imbalanced Data for Semantic Concept Detection , 2008, 2008 IEEE International Conference on Sensor Networks, Ubiquitous, and Trustworthy Computing (sutc 2008).

[2]  Neil Salkind Encyclopedia of Measurement and Statistics , 2006 .

[3]  Min Chen,et al.  A multimodal data mining framework for soccer goal detection based on decision tree logic , 2006, Int. J. Comput. Appl. Technol..

[4]  Yannis Avrithis,et al.  High-Level Concept Detection Based on Mid-Level Semantic Information and Contextual Adaptation , 2007, Second International Workshop on Semantic Media Adaptation and Personalization (SMAP 2007).

[5]  Stéphane Ayache,et al.  Context-Based Conceptual Image Indexing , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[6]  Anastasia Mavridou,et al.  Reputation Metadata for Recommending Personalized e-Learning Resources , 2007 .

[7]  Tao Mei,et al.  Building a comprehensive ontology to refine video concept detection , 2007, MIR '07.

[8]  Marcel Worring,et al.  The challenge problem for automated detection of 101 semantic concepts in multimedia , 2006, MM '06.

[9]  Christos Faloutsos,et al.  VideoCube: A Novel Tool for Video Mining and Classification , 2002, ICADL.

[10]  Usama M. Fayyad,et al.  On the Handling of Continuous-Valued Attributes in Decision Tree Generation , 1992, Machine Learning.

[11]  Shu-Ching Chen,et al.  Video Semantic Concept Discovery using Multimodal-Based Association Classification , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[12]  Milind R. Naphade,et al.  Learning the semantics of multimedia queries and concepts from a small number of examples , 2005, MULTIMEDIA '05.