Video Highlight Shot Extraction with Time-Sync Comment

Benefit from abundance of mobile applications, portability of large-screen mobile devices and accessibility of media resources, users nowadays much more prefer to watch videos on their mobiles no matter whether they are at home or on the way. However, constrained by available time and network flow, users may only choose to watch some hot video segments that are manually annotated by video editors. In this paper, we aim to automatically extract video highlight shot with the help of video sentimental feature of time-sync comments. First, analyzing statistical feature of real data. After, we simulate the generation process of time-sync comment after. Then, we propose a shot boundary detection method to extract highlight shot, which is proved to be more effective than traditional methods based on comment density. This experiment attests the time-sync comment is particularly suitable for sentiment-based video segment extraction for 2 reasons. 1) Text-based similarity calculation of is much faster than image-based process depending on every frame of video; 2) Time-sync comment reflects user subjective emotion therefore is useful in personalised video recommendation.

[1]  Masataka Goto,et al.  MusicCommentator: Generating Comments Synchronized with Musical Audio Signals by a Joint Probabilistic Model of Acoustic and Textual Features , 2009, ICEC.

[2]  Hideaki Takeda,et al.  Network Analysis of an Emergent Massively Collaborative Creation Community: How Can People Create Videos Collaboratively without Collaboration? , 2009, ICWSM.

[3]  Xiaoming Chen,et al.  Performance analysis of using wavelet transform in content based video retrieval system , 2007 .

[4]  Qiang Yang,et al.  Crowdsourced time-sync video tagging using temporal and personalized topic modeling , 2014, KDD.

[5]  Steven Skiena,et al.  Large-Scale Sentiment Analysis for News and Blogs (system demonstration) , 2007, ICWSM.

[6]  Jiebo Luo,et al.  Utilizing semantic word similarity measures for video retrieval , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Gene H. Golub,et al.  Singular value decomposition and least squares solutions , 1970, Milestones in Matrix Computation.

[8]  Li Li,et al.  A Survey on Visual Content-Based Video Indexing and Retrieval , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[9]  Bo Pang,et al.  A Sentimental Education: Sentiment Analysis Using Subjectivity Summarization Based on Minimum Cuts , 2004, ACL.

[10]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[11]  Gregor Heinrich Parameter estimation for text analysis , 2009 .

[12]  Alan F. Smeaton Techniques used and open challenges to the analysis, indexing and retrieval of digital video , 2007, Inf. Syst..