VSUMM: An Approach for Automatic Video Summarization and Quantitative Evaluation

In this paper, we propose an approach for video summarization (VSUMM). The video summaries are generated based on visual features. A factorial experiment is designed to analyze the relative impact of the attributes. We demonstrate the validity of the VSUMM approach by testing it on a collection of videos from Open Video Project. We provide a comparison among results of the proposed summarization technique with Open Video storyboard. A subjective evaluation showed that the summaries are produced with good quality.

[1]  Yelena Yesha,et al.  Keyframe-based video summarization using Delaunay clustering , 2006, International Journal on Digital Libraries.

[2]  Yueting Zhuang,et al.  Adaptive key frame extraction using unsupervised clustering , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[3]  Riad I. Hammoud.  Interactive video : algorithms and technologies , 2006 .

[4]  Benoit Huet,et al.  Automatic video summarization , 2006 .

[5]  David S. Doermann,et al.  Video summarization by curve simplification , 1998, MULTIMEDIA '98.

[6]  Patrick Pérez,et al.  Rapid Summarisation and Browsing of Video Sequences , 2002, BMVC.

[7]  Ray Jain,et al.  The art of computer systems performance analysis - techniques for experimental design, measurement, simulation, and modeling , 1991, Wiley professional computing.

[8]  Tie-Yan Liu,et al.  Dynamic selection and effective compression of key frames for video abstraction , 2003, Pattern Recognit. Lett..

[9]  Frédéric Dufaux,et al.  Key Frame Selection to Represent a Video , 2000, ICIP.

[10]  Aggelos K. Katsaggelos,et al.  MINMAX optimal video summarization , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Andreas Girgensohn,et al.  Keyframe-Based User Interfaces for Digital Video , 2001, Computer.

[12]  Alan Hanjalic,et al.  Shot-boundary detection: unraveled and resolved? , 2002, IEEE Trans. Circuits Syst. Video Technol..

[13]  S. de Avila,et al.  VSUMM: A simple and efficient approach for automatic video summarization , 2008, 2008 15th International Conference on Systems, Signals and Image Processing.

[14]  Qi Tian,et al.  Semantic retrieval of video - review of research on video retrieval in meetings, movies and broadcast news, and sports , 2006, IEEE Signal Processing Magazine.

[15]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[16]  Xin Liu,et al.  Video summarization with minimal visual content redundancies , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[17]  Janko Calic,et al.  Efficient Layout of Comic-Like Video Summaries , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Mark S. Drew,et al.  Video keyframe production by efficient clustering of compressed chromaticity signatures (poster session) , 2000, ACM Multimedia.

[19]  Sansanee Auephanwiriyakul,et al.  On fuzzy clustering and content based access to networked video databases , 1998, Proceedings Eighth International Workshop on Research Issues in Data Engineering. Continuous-Media Databases and Applications.

[20]  Shingo Uchihashi,et al.  Video Manga: generating semantically meaningful video summaries , 1999, MULTIMEDIA '99.

[21]  Chia-Hung Yeh,et al.  Techniques for movie content analysis and skimming: tutorial and overview on video abstraction techniques , 2006, IEEE Signal Processing Magazine.

[22]  Shrikanth Narayanan,et al.  Movie Content Analysis, Indexing and Skimming Via Multimodal Information , 2003 .

[23]  Tao Mei,et al.  Video collage , 2007, ACM Multimedia.

[24]  Boon-Lock Yeo,et al.  Video visualization for compact presentation and fast browsing of pictorial content , 1997, IEEE Trans. Circuits Syst. Video Technol..

[25]  I-Cheng Chang,et al.  Content-Selection Based Video Summarization , 2007, 2007 Digest of Technical Papers International Conference on Consumer Electronics.

[26]  Alan Hanjalic,et al.  A New Method for Key Frame Based Video Content Representation , 1998, Image Databases and Multi-Media Search.

[27]  Ba Tu Truong,et al.  Video abstraction: A systematic review and classification , 2007, TOMCCAP.

[28]  S. de Avila,et al.  VSUMM: A simple and efficient approach for automatic video summarization , 2008, IWSSIP 2008.

[29]  Ying Li,et al.  An Overview of Video Abstraction Techniques , 2001 .

[30]  Qi Tian,et al.  Multilevel video representation with application to keyframe extraction , 2004, 10th International Multimedia Modelling Conference, 2004. Proceedings..

[31]  Arnold W. M. Smeulders,et al.  Image Databases and Multi-Media Search , 1998, Image Databases and Multi-Media Search.

[32]  Gary Marchionini,et al.  Open video: A framework for a test collection , 2000, J. Netw. Comput. Appl..

[33]  Rainer Lienhart,et al.  Reliable Transition Detection in Videos: A Survey and Practitioner's Guide , 2001, Int. J. Image Graph..

[34]  Gary Marchionini,et al.  The Open Video Digital Library , 2002, D Lib Mag..