Leveraging Concept Association Network for Multimedia Rare Concept Mining and Retrieval

Automatic high-level semantic concept detection is a crucial step for multimedia data management, indexing, and retrieval. It is well-acknowledged that semantic gap poses a great challenge in multimedia content-based research. It becomes even more challenging when the concept of interest is extremely rare in the training data sets because of the poor modeling for the positive instances. In this paper, a Concept Association Network (CAN) is trained by selecting significant links to capture the strong associations among different concepts using association rule mining (ARM). By taking into account of the correlations and credibilities of reference concept nodes, the advantages of the reference nodes are utilized. Experimental results using TRECVID 2010 data sets show that by utilizing the proposed framework, the Mean Average Precision (MAP) values of all the concepts are improved, and the significant improvement of the MAP values of the rare concepts further attests the promising results.

[1]  Chao Chen,et al.  Utilization of Co-occurrence Relationships between Semantic Concepts in Re-ranking for Information Retrieval , 2011, 2011 IEEE International Symposium on Multimedia.

[2]  Shih-Fu Chang,et al.  CU-VIREO 374 : Fusing Columbia 374 and VIREO 374 for Large Scale Semantic Concept Detection , 2008 .

[3]  Min Chen,et al.  Video Semantic Event/Concept Detection Using a Subspace-Based Multimedia Data Mining Framework , 2008, IEEE Transactions on Multimedia.

[4]  Mubarak Shah,et al.  Improving Semantic Concept Detection and Retrieval using Contextual Estimates , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[5]  Ming-Syan Chen,et al.  Association and Temporal Rule Mining for Post-Filtering of Semantic Concept Detection in Video , 2008, IEEE Transactions on Multimedia.

[6]  Alberto Del Bimbo,et al.  Video Annotation and Retrieval Using Ontologies and Rule Learning , 2010, IEEE MultiMedia.

[7]  Mei-Ling Shyu,et al.  Weighted Association Rule Mining for Video Semantic Detection , 2010, Int. J. Multim. Data Eng. Manag..

[8]  Benoit Huet,et al.  An ontology-based evidential framework for video indexing using high-level multimodal fusion , 2011, Multimedia Tools and Applications.

[9]  Antonio Torralba,et al.  A Tree-Based Context Model for Object Recognition , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Michel Verleysen,et al.  Assessment of probability density estimation methods: Parzen window and finite Gaussian mixtures , 2006, 2006 IEEE International Symposium on Circuits and Systems.

[11]  Songyang Lao,et al.  Video semantic concept detection using ontology , 2011, ICIMCS '11.

[12]  Ramakrishnan Srikant,et al.  Fast algorithms for mining association rules , 1998, VLDB 1998.

[13]  Paul Over,et al.  Evaluation campaigns and TRECVid , 2006, MIR '06.

[14]  John R. Smith,et al.  Multimedia semantic indexing using model vectors , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).