Correlation-Based Ranking for Large-Scale Video Concept Retrieval

Motivated by the growing use of multimedia services and the explosion of multimedia collections, efficient retrieval from large-scale multimedia data has become very important in multimedia content analysis and management. In this paper, a novel ranking algorithm is proposed for video retrieval. First, video content is represented by the global and local features and second, multiple correspondence analysis MCA is applied to capture the correlation between video content and semantic concepts. Next, video segments are scored by considering the features with high correlations and the transaction weights converted from correlations. Finally, a user interface is implemented in a video retrieval system that allows the user to enter his/her interested concept, searches videos based on the target concept, ranks the retrieved video segments using the proposed ranking algorithm, and then displays the top-ranked video segments to the user. Experimental results on 30 concepts from the TRECVID high-level feature extraction task have demonstrated that the presented video retrieval system assisted by the proposed ranking algorithm is able to retrieve more video segments belonging to the target concepts and to display more relevant results to the users.

[1]  Shih-Fu Chang,et al.  Cross-domain learning methods for high-level visual concept classification , 2008, 2008 15th IEEE International Conference on Image Processing.

[2]  Kimiaki Shirahama,et al.  Query-based video event definition using rough set theory , 2009, EiMM '09.

[3]  Mahito Fujii,et al.  Video Face Tracking and Recognition with Skin Region Extraction and Deformable Template Matching , 2012, Int. J. Multim. Data Eng. Manag..

[4]  Neil Salkind Encyclopedia of Measurement and Statistics , 2006 .

[5]  Ian Witten,et al.  Data Mining , 2000 .

[6]  Xin Luo,et al.  Encyclopedia of Multimedia Technology and Networking , 2008 .

[7]  Paul Over,et al.  Evaluation campaigns and TRECVid , 2006, MIR '06.

[8]  Chong-Wah Ngo,et al.  Semantic context transfer across heterogeneous sources for domain adaptive video search , 2009, ACM Multimedia.

[9]  Rong Yan,et al.  Semantic concept-based query expansion and re-ranking for multimedia retrieval , 2007, ACM Multimedia.

[10]  Mei-Ling Shyu,et al.  Weighted Association Rule Mining for Video Semantic Detection , 2010, Int. J. Multim. Data Eng. Manag..

[11]  Tao Mei,et al.  Multigraph-Based Query-Independent Learning for Video Search , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Shih-Fu Chang,et al.  Columbia University’s Baseline Detectors for 374 LSCOM Semantic Visual Concepts , 2007 .

[13]  Chong-Wah Ngo,et al.  Representations of Keypoint-Based Semantic Concept Detection: A Comprehensive Study , 2010, IEEE Transactions on Multimedia.

[14]  Ismail Khalil,et al.  Handbook of Research on Mobile Multimedia , 2006 .

[15]  Marcel Worring,et al.  Concept-Based Video Retrieval , 2009, Found. Trends Inf. Retr..

[16]  Shu-Ching Chen,et al.  Feature Selection Using Correlation and Reliability Based Scoring Metric for Video Semantic Detection , 2010, 2010 IEEE Fourth International Conference on Semantic Computing.

[17]  Xian-Sheng Hua,et al.  Bayesian video search reranking , 2008, ACM Multimedia.

[18]  Rong Yan,et al.  Imbalanced RankBoost for efficiently ranking large-scale image/video collections , 2009, CVPR.

[19]  Chong-Wah Ngo,et al.  Exploring inter-concept relationship with context space for semantic video indexing , 2009, CIVR '09.

[20]  Yongdong Zhang,et al.  Distribution-based concept selection for concept-based video retrieval , 2009, ACM Multimedia.

[21]  Shu-Ching Chen,et al.  Enhancing Concept Detection by Pruning Data with MCA-Based Transaction Weights , 2009, 2009 11th IEEE International Symposium on Multimedia.

[22]  Jiebo Luo,et al.  Utilizing semantic word similarity measures for video retrieval , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Yi-Hsuan Yang,et al.  Video search reranking via online ordinal reranking , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[24]  Ajay Divakaran Multimedia Content Analysis , 2009 .

[25]  Shu-Ching Chen,et al.  Multimedia Databases and Data Management: A Survey , 2010, Int. J. Multim. Data Eng. Manag..

[26]  Ajay Divakaran Multimedia Content Analysis: Theory and Applications , 2008 .

[27]  Kevin C. Almeroth,et al.  Fast Caption Alignment for Automatic Indexing of Audio , 2010, Int. J. Multim. Data Eng. Manag..

[28]  Mounir Mokhtari,et al.  Context Awareness for Pervasicve Assistive Environment , 2006 .

[29]  Craig Standing,et al.  From Communities to Mobile Communities of Values , 2005 .