An Approach for Video Summarization Using Graph-Based Clustering Algorithm

There has been immense increase in amount of video content over the past few years. This massive growth in the content of video leads to the uncertain outcomes. Processing of these huge chunks of data is demanding plenty of resources, like time, manpower, as well as hardware storage. Video summarization acquires an important remark in this ambiance. It supports in providing efficient storage, fast browsing, and retrieval of huge video data without losing important factors. In this work, video summarization technique has been proposed using graph-based clustering algorithm in three different steps. The presented work has split the video into frames of a predefined time period and computed the similarity between consecutive frames. Based on the similarity values, the frames are grouped into scenes, and the scenes are partitioned separately using video tracks and audio tracks with the help of clustering algorithm. Then the combined clusters of scenes are further analyzed to determine the summary of a video file. This work considers just the video file at hand and attempts to develop a summary file without using any external knowledge from similar videos. As per the authors’ knowledge, no previous research work related to video summarization has been conducted in this field. The quality of the summarized video is a measure to express the effectiveness of the proposed methodology.

[1]  Steven Bird,et al.  NLTK: The Natural Language Toolkit , 2002, ACL 2006.

[2]  Chong-Wah Ngo,et al.  Video summarization and scene detection by graph modeling , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Jiby J Puthiyidam,et al.  A Survey on Video Summarization Techniques , 2015 .

[4]  Ali Borji,et al.  Quantitative Analysis of Human-Model Agreement in Visual Saliency Modeling: A Comparative Study , 2013, IEEE Transactions on Image Processing.

[5]  Martin Rosvall,et al.  Maps of random walks on complex networks reveal community structure , 2007, Proceedings of the National Academy of Sciences.

[6]  Lie Lu,et al.  A generic framework of user attention model and its application in video summarization , 2005, IEEE Trans. Multim..

[7]  Youness Tabii,et al.  Video Summarization: Techniques and Applications , 2015 .

[8]  Anoop Gupta,et al.  Auto-summarization of audio-video presentations , 1999, MULTIMEDIA '99.

[9]  Alexander C. Loui,et al.  Automatic consumer video summarization by audio and visual analysis , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[10]  Zygmunt Pizlo,et al.  Automated video program summarization using speech transcripts , 2006, IEEE Transactions on Multimedia.

[11]  Mohan S. Kankanhalli,et al.  Content-based representative frame extraction for digital video , 1998, Proceedings. IEEE International Conference on Multimedia Computing and Systems (Cat. No.98TB100241).

[12]  Steven Bird,et al.  NLTK: The Natural Language Toolkit , 2002, ACL.

[13]  Takeo Kanade,et al.  Video skimming and characterization through the combination of image and language understanding , 1998, Proceedings 1998 IEEE International Workshop on Content-Based Access of Image and Video Database.