Video Summarization Based on Camera Motion and a Subjective Evaluation Method

We propose an original method of video summarization based on camera motion. It consists in selecting frames according to the succession and the magnitude of camera motions. The method is based on rules to avoid temporal redundancy between the selected frames. We also develop a new subjective method to evaluate the proposed summary and to compare different summaries more generally. Subjects were asked to watch a video and to create a summary manually. From the summaries of the different subjects, an "optimal" one is built automatically and is compared to the summaries obtained by different methods. Experimental results show the efficiency of our camera motion-based summary.

[1]  Benoit Huet,et al.  Automatic video summarization , 2006 .

[2]  Wolfgang Effelsberg,et al.  Automatic generation of video summaries for historical films , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[3]  Raimondo Schettini,et al.  Dynamic key-frame extraction for video summarization , 2005, IS&T/SPIE Electronic Imaging.

[4]  Daniel DeMenthon,et al.  Automatic Performance Evaluation for Video Summarization , 2004 .

[5]  Mourad Cherfaoui,et al.  Two-stage strategy for indexing and presenting video , 1994, Electronic Imaging.

[6]  Patrick Gros,et al.  A Geometrical Key-Frame Selection Method Exploiting Dominant Motion Estimation in Video , 2004, CIVR.

[7]  HongJiang Zhang,et al.  Video Snapshot: A Bird View of Video Sequence , 2005, 11th International Multimedia Modelling Conference.

[8]  Denis Pellerin,et al.  Camera motion classification based on Transferable Belief Model , 2006, 2006 14th European Signal Processing Conference.

[9]  Mohan S. Kankanhalli,et al.  A new approach to automatic music video summarization , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[10]  Chong-Wah Ngo,et al.  Automatic video summarization by graph modeling , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[11]  A. Murat Tekalp,et al.  Two-stage hierarchical video summary extraction to match low-level user browsing preferences , 2003, IEEE Trans. Multim..

[12]  Ajay Divakaran,et al.  An extended framework for adaptive playback-based video summarization , 2003, SPIE ITCom.

[13]  Majid Mirmehdi,et al.  A shortest path representation for video summarisation , 2003, 12th International Conference on Image Analysis and Processing, 2003.Proceedings..

[14]  Denis Pellerin,et al.  Video classification based on low-level feature fusion model , 2005, 2005 13th European Signal Processing Conference.

[15]  Michael R. Lyu,et al.  Video summarization by spatial-temporal graph optimization , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).

[16]  Ahmed K. Elmagarmid,et al.  InsightVideo: toward hierarchical video content organization for efficient browsing, summarization and retrieval , 2005, IEEE Transactions on Multimedia.

[17]  André Kaup,et al.  Video analysis for universal multimedia messaging , 2002, Proceedings Fifth IEEE Southwest Symposium on Image Analysis and Interpretation.

[18]  Raimondo Schettini,et al.  Video summarization using a neurodynamical model of visual attention , 2004, IEEE 6th Workshop on Multimedia Signal Processing, 2004..