Key Frame Extraction Based on Sub-Shot Segmentation and Entropy Computing

A key frame extraction algorithm based on sub-shot segmentation and entropy computing is proposed. Firstly the reconstructed matrix of each frame in shots is computed through sub-space projection. Secondly sub-shot segmentation is processed according to the difference of singular value between frame and its reconstructed matrix, as well as difference of histogram feature between frame and mean value of its previous N frames. Finally two adjacent frames with the largest cross-entropy in sub-shot are obtained, in which the frame with the larger image entropy is selected as a key frame. The experimental results demonstrate that key frames extracted by the algorithm can describe shot contents efficiently.

[1]  Shie Mannor,et al.  A Tutorial on the Cross-Entropy Method , 2005, Ann. Oper. Res..

[2]  George Economou,et al.  Key frame extraction in video sequences: a vantage points approach , 2007, 2007 IEEE 9th Workshop on Multimedia Signal Processing.

[3]  Akio Nagasaka,et al.  Automatic Video Indexing and Full-Video Search for Object Appearances , 1991, VDB.

[4]  Yannis Avrithis,et al.  Keyframe Extraction Using Local Visual Semantics in the Form of a Region Thesaurus , 2007, Second International Workshop on Semantic Media Adaptation and Personalization (SMAP 2007).

[5]  Raimondo Schettini,et al.  Erratum to: An innovative algorithm for key frame extraction in video summarization , 2006, Journal of Real-Time Image Processing.

[6]  Yu-Jin Zhang,et al.  Video segmentation and key frame extraction with parametric model , 2008, 2008 3rd International Symposium on Communications, Control and Signal Processing.

[7]  Ying Li,et al.  An Overview of Video Abstraction Techniques , 2001 .

[8]  Wayne H. Wolf,et al.  Key frame selection by motion analysis , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[9]  Oleg Starostenko,et al.  CONTENT BASED VISUAL INFORMATION RETRIEVAL FOR MANAGEMENT INFORMATION SYSTEMS , 2007 .

[10]  Yueting Zhuang,et al.  Adaptive key frame extraction using unsupervised clustering , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[11]  Zhi Min.  Key frame extraction from scenery video , 2007, 2007 International Conference on Wavelet Analysis and Pattern Recognition.

[12]  Ki Park,et al.  Key Frame Extraction Based on Shot Coverage and Distortion , 2005, PCM.

[13]  Karin Coninx,et al.  Runtime Personalization of Multi-Device User Interfaces: Enhanced Accessibility for Media Consumption in Heterogeneous Environments by User Interface Adaptation , 2007 .

[14]  Alan Hanjalic,et al.  An integrated scheme for automated video abstraction based on unsupervised cluster-validity analysis , 1999, IEEE Trans. Circuits Syst. Video Technol..

[15]  Stephen W. Smoliar,et al.  An integrated system for content-based video retrieval and browsing , 1997, Pattern Recognit..