Adaptive association rule mining for web video event classification

Due to the popularity and development of social networks and web video sites, we have witnessed an exponential growth in the volumes of web videos in the last decade. This prompts an urgent demand for efficiently grasping the major events. Nevertheless, the insufficient and noisy text information has made it difficult and challenging to mine the events based on the initial keywords and visual features. In this paper, we propose an adaptive semantic association rule mining method in the NDK (Near-Duplicate Keyframes) level to enrich the keyword information and to remove the words without any semantic relationship. Moreover, both textual and visual information are employed for event classification, targeting for bridging the gap between NDKs and the high-level semantic concepts. Experimental results on large scale web videos from YouTube demonstrate that our proposed method achieves good performance and outperforms the selected baseline methods.

[1]  Hector Garcia-Molina,et al.  Overview of multidatabase transaction management , 2005, The VLDB Journal.

[2]  David A. Forsyth,et al.  Towards auto-documentary: tracking the evolution of news stories , 2004, MULTIMEDIA '04.

[3]  Hiep Xuan Huynh,et al.  Finding the Most Interesting Association Rules by Aggregating Objective Interestingness Measures , 2009, PKAW.

[4]  Yan Ke,et al.  Efficient Near-duplicate Detection and Sub-image Retrieval , 2004 .

[5]  Rangasami L. Kashyap,et al.  Generalized Affinity-Based Association Rule Mining for Multimedia Database Queries , 2001, Knowledge and Information Systems.

[6]  Richard Sproat,et al.  Mining correlated bursty topic patterns from coordinated text streams , 2007, KDD '07.

[7]  Shu-Ching Chen,et al.  Association rule mining with a correlation-based interestingness measure for video semantic concept detection , 2012, Int. J. Inf. Decis. Sci..

[8]  Chong-Wah Ngo,et al.  Multimodal News Story Clustering With Pairwise Visual Near-Duplicate Constraint , 2008, IEEE Transactions on Multimedia.

[9]  Chong-Wah Ngo,et al.  Fast tracking of near-duplicate keyframes in broadcast domain with transitivity propagation , 2006, MM '06.

[10]  Shu-Ching Chen,et al.  Correlation-Based Video Semantic Concept Detection Using Multiple Correspondence Analysis , 2008, 2008 Tenth IEEE International Symposium on Multimedia.

[11]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[12]  Shih-Fu Chang,et al.  Topic Tracking Across Broadcast News Videos with Visual Duplicates and Semantic Concepts , 2006, 2006 International Conference on Image Processing.

[13]  Kuan-Yu Chen,et al.  Hot Topic Extraction Based on Timeline Analysis and Multidimensional Sentence Modeling , 2007, IEEE Transactions on Knowledge and Data Engineering.

[14]  Sergio A. Alvarez,et al.  Collaborative Recommendation via Adaptive Association Rule Mining , 2000 .

[15]  Philip S. Yu,et al.  Parameter Free Bursty Events Detection in Text Streams , 2005, VLDB.

[16]  Ee-Peng Lim,et al.  Analyzing feature trajectories for event detection , 2007, SIGIR.

[17]  Wynne Hsu,et al.  Analyzing the Subjective Interestingness of Association Rules , 2000, IEEE Intell. Syst..

[18]  Lifeng Sun,et al.  Web video topic discovery and tracking via bipartite graph reinforcement model , 2008, WWW.

[19]  Shih-Fu Chang,et al.  Detecting image near-duplicate by stochastic attributed relational graph matching with learning , 2004, MULTIMEDIA '04.

[20]  Topical summarization of web videos by visual-text time-dependent alignment , 2010, ACM Multimedia.

[21]  Wei-Ying Ma,et al.  Video summarization based on user log enhanced link analysis , 2003, ACM Multimedia.

[22]  Chong-Wah Ngo,et al.  Threading and autodocumenting news videos: a promising solution to rapidly browse news topics , 2006, IEEE Signal Processing Magazine.

[23]  Howard J. Hamilton,et al.  Interestingness measures for data mining: A survey , 2006, CSUR.

[24]  Das Amrita,et al.  Mining Association Rules between Sets of Items in Large Databases , 2013 .

[25]  Caihui Liu,et al.  Multi-dimension association rule mining based on Adaptive Genetic Algorithm , 2011, 2011 International Conference on Uncertainty Reasoning and Knowledge Engineering.

[26]  John R. Kender,et al.  Clustering web images using association rules, interestingness measures, and hypergraph partitions , 2006, ICWE '06.

[27]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[28]  Yongdong Zhang,et al.  Tracking Web Video Topics: Discovery, Visualization, and Monitoring , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[29]  C. S. Kanimozhi Selvi,et al.  Association Rule Mining with Dynamic Adaptive Support Thresholds for Associative Classification , 2007, International Conference on Computational Intelligence and Multimedia Applications (ICCIMA 2007).

[30]  Chong-Wah Ngo,et al.  Near-duplicate keyframe retrieval with visual keywords and semantic context , 2007, CIVR '07.

[31]  Chong-Wah Ngo,et al.  On the Annotation of Web Videos by Efficient Near-Duplicate Search , 2010, IEEE Transactions on Multimedia.

[32]  Chao Chen,et al.  Within and Between Shot Information Utilisation in Video Key Frame Extraction , 2011, J. Inf. Knowl. Manag..

[33]  Junjie Yao,et al.  Bursty event detection from collaborative tags , 2011, World Wide Web.

[34]  Mubarak Shah,et al.  Tracking news stories across different sources , 2005, MULTIMEDIA '05.

[35]  Chong-Wah Ngo,et al.  Mining Event Structures from Web Videos , 2011, IEEE MultiMedia.

[36]  Philip S. Yu,et al.  Time-dependent event hierarchy construction , 2007, KDD '07.