Event Detection on Online Videos Using Crowdsourced Time-Sync Comment

In recent years, more and more people are like to watch videos online because of its convenience and social features. Due to the limit of entertainment time, there is a new requirement that people prefer to watch some hot video segments rather than an entire video. However, it is a quite time-consuming work to extract the highlight segments in videos manually because the number of videos uploaded to the internet is huge. In this paper, we propose a model of event detection on videos using Time-Sync comments provided by online users. In the model, three features of Time-Sync comments are extracted firstly. Then, user behavior relevance in time series are analyzed to find the video shots that people are interested in most. Metric and its optimization to score video shots for event detection are introduced lastly. Experiments on several movies shows that the events detected by our method coincide with the highlights in the movies. Experiments on movies show that the events detected by our method coincide with the highlights in the movies.

[1]  Alan F. Smeaton Techniques used and open challenges to the analysis, indexing and retrieval of digital video , 2007, Inf. Syst..

[2]  Chenxi Zhang,et al.  Video Highlight Shot Extraction with Time-Sync Comment , 2015, HOTPOST@MobiHoc.

[3]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[4]  Eisuke Ito,et al.  Correlation Analysis between User's Emotional Comments and Popularity Measures , 2014, 2014 IIAI 3rd International Conference on Advanced Applied Informatics.

[5]  Mark Sanderson,et al.  Content redundancy in YouTube and its application to video tagging , 2011, TOIS.

[6]  C. Faloutsos,et al.  EVENT DETECTION IN TIME SERIES OF MOBILE COMMUNICATION GRAPHS , 2010 .

[7]  Markus Koch,et al.  Learning automatic concept detectors from online video , 2010, Comput. Vis. Image Underst..

[8]  Mark Sanderson,et al.  Automatic video tagging using content redundancy , 2009, SIGIR.

[9]  Topical summarization of web videos by visual-text time-dependent alignment , 2010, ACM Multimedia.

[10]  Qiang Yang,et al.  Crowdsourced time-sync video tagging using temporal and personalized topic modeling , 2014, KDD.

[11]  Hideaki Takeda,et al.  Network Analysis of an Emergent Massively Collaborative Creation Community: How Can People Create Videos Collaboratively without Collaboration? , 2009, ICWSM.

[12]  Masataka Goto,et al.  MusicCommentator: Generating Comments Synchronized with Musical Audio Signals by a Joint Probabilistic Model of Acoustic and Textual Features , 2009, ICEC.

[13]  Xiaoming Chen,et al.  Performance analysis of using wavelet transform in content based video retrieval system , 2007 .

[14]  이주연,et al.  Latent Dirichlet Allocation (LDA) 모델 기반의 인공지능(A.I.) 기술 관련 연구 활동 및 동향 분석 , 2018 .

[15]  Chong-Wah Ngo,et al.  Annotation for free: video tagging by mining user search behavior , 2013, ACM Multimedia.

[16]  Yi Yang,et al.  Effective transfer tagging from image to video , 2013, TOMCCAP.