Near-Duplicate Segments based news web video event mining

News web videos uploaded by general users usually include lots of post-processing effects (editing, inserted logo, etc.), which bring noise and affect the similarity comparison for news web video event mining. In this paper, a framework based on the concept of Near-Duplicate Segments (NDSs) which effectively integrates spatial and temporal information is proposed. After each video being divided into segments, those segments from different videos but sharing similar visual content are clustered into groups. Each group is named as an NDS, which infers the latent content relations among videos. The spatial-temporal local features are extracted and used to represent each video segment, which could effectively capture the main content of news web videos and omit the noise such as the disturbance/influence from video editing. Finally, the visual information is integrated with the textual information. The experiment demonstrates that our proposed framework is more effective than several existing methods with a significant improvement. HighlightsNDS which effectively integrates spatial and temporal information is proposed.A framework based on the concept of NDS is proposed.The AARM method is proposed to enhance the robustness of terms in MCA.

[1]  Xiao Wu,et al.  Adaptive association rule mining for web video event classification , 2013, 2013 IEEE 14th International Conference on Information Reuse & Integration (IRI).

[2]  Cordelia Schmid,et al.  Evaluation of Local Spatio-temporal Features for Action Recognition , 2009, BMVC.

[3]  Chao Chen,et al.  Web media semantic concept retrieval via tag removal and model fusion , 2013, ACM Trans. Intell. Syst. Technol..

[4]  Chong-Wah Ngo,et al.  Mining Event Structures from Web Videos , 2011, IEEE MultiMedia.

[5]  Yongdong Zhang,et al.  Tracking Web Video Topics: Discovery, Visualization, and Monitoring , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Li Chen,et al.  Video copy detection: a comparative study , 2007, CIVR '07.

[7]  Ivor W. Tsang,et al.  Visual Event Recognition in Videos by Learning from Web Data , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Vu Lam,et al.  Multimedia Event Detection Using Segment-Based Approach for Motion Feature , 2014, J. Signal Process. Syst..

[9]  Shih-Fu Chang,et al.  Detecting image near-duplicate by stochastic attributed relational graph matching with learning , 2004, MULTIMEDIA '04.

[10]  Hung-Khoon Tan,et al.  Real-Time Near-Duplicate Elimination for Web Video Search With Content and Context , 2009, IEEE Transactions on Multimedia.

[11]  Zi Huang,et al.  Near-duplicate video retrieval: Current research and future trends , 2013, CSUR.

[12]  Shu-Ching Chen,et al.  Correlation-Based Video Semantic Concept Detection Using Multiple Correspondence Analysis , 2008, 2008 Tenth IEEE International Symposium on Multimedia.

[13]  Shu-Ching Chen,et al.  Enhancing Concept Detection by Pruning Data with MCA-Based Transaction Weights , 2009, 2009 11th IEEE International Symposium on Multimedia.

[14]  Cordelia Schmid,et al.  Learning realistic human actions from movies , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Tomás Aluja,et al.  Book review: Multiple correspondence analysis and related methods. Greenacre, M. and Blasius, J. Chapman & Hall/CRC, 2006. , 2006 .

[16]  Yan Ke,et al.  Efficient Near-duplicate Detection and Sub-image Retrieval , 2004 .

[17]  Zi Huang,et al.  Correlation-based retrieval for heavily changed near-duplicate videos , 2011, TOIS.

[18]  Yan Ke,et al.  An efficient parts-based near-duplicate and sub-image retrieval system , 2004, MULTIMEDIA '04.

[19]  Ivan Laptev,et al.  On Space-Time Interest Points , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[20]  Rangasami L. Kashyap,et al.  Generalized Affinity-Based Association Rule Mining for Multimedia Database Queries , 2001, Knowledge and Information Systems.

[21]  Fei-Fei Li,et al.  Learning latent temporal structure for complex event detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Chong-Wah Ngo,et al.  Video event detection using motion relativity and visual relatedness , 2008, ACM Multimedia.

[23]  Mei-Ling Shyu,et al.  Semantic Motion Concept Retrieval in Non-Static Background Utilizing Spatial-Temporal Visual Information , 2013, Int. J. Semantic Comput..

[24]  Lifeng Sun,et al.  Web video topic discovery and tracking via bipartite graph reinforcement model , 2008, WWW.

[25]  M. Greenacre,et al.  Multiple Correspondence Analysis and Related Methods , 2006 .

[26]  Chong-Wah Ngo,et al.  Practical elimination of near-duplicates from web video search , 2007, ACM Multimedia.

[27]  Ee-Peng Lim,et al.  Analyzing feature trajectories for event detection , 2007, SIGIR.

[28]  Chong-Wah Ngo,et al.  Near-Duplicate Web Video Detection , 2013 .

[29]  Shu-Ching Chen,et al.  Video Semantic Concept Discovery using Multimodal-Based Association Classification , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[30]  David A. Forsyth,et al.  Towards auto-documentary: tracking the evolution of news stories , 2004, MULTIMEDIA '04.

[31]  Fei Wang,et al.  Real-time large scale near-duplicate web video retrieval , 2010, ACM Multimedia.

[32]  Chong-Wah Ngo,et al.  On the Annotation of Web Videos by Efficient Near-Duplicate Search , 2010, IEEE Transactions on Multimedia.

[33]  Junjie Yao,et al.  Bursty event detection from collaborative tags , 2011, World Wide Web.

[34]  Shu-Ching Chen,et al.  Association rule mining with a correlation-based interestingness measure for video semantic concept detection , 2012, Int. J. Inf. Decis. Sci..

[35]  Chong-Wah Ngo,et al.  Fast tracking of near-duplicate keyframes in broadcast domain with transitivity propagation , 2006, MM '06.

[36]  Xiao Wu,et al.  A Novel Web Video Event Mining Framework with the Integration of Correlation and Co-Occurrence Information , 2013, Journal of Computer Science and Technology.