Hierarchical Video Summarization Based on Video Structure and Highlight

Video summarization is a significant scheme to organize massive video data, and implement a meaningful rapid navigation of video. In this paper, we propose a hierarchical video summarization approach based on video structure and highlight. We extract video structure unit, and measure the unit (frame, shot and scene) importance rank based on visual and audio attention models. According to the unit importance rank, the skim ratio and key frame ratio are assigned to the different video units. Thus we achieve a hierarchical video summary. Experimental results show the excellent performance of the approach.

[1]  Thomas S. Huang,et al.  Constructing table-of-content for videos , 1999, Multimedia Systems.

[2]  HongJiang Zhang,et al.  Video Snapshot: A Bird View of Video Sequence , 2005, 11th International Multimedia Modelling Conference.

[3]  Xinbo Gao,et al.  A Unified Framework for Shot Boundary Detection , 2005, CIS.

[4]  Shogo Muramatsu,et al.  Constructing storyboards based on hierarchical clustering analysis , 2005, Visual Communications and Image Processing.

[5]  Lie Lu,et al.  A robust audio classification and segmentation method , 2001, MULTIMEDIA '01.

[6]  Chia-Hung Yeh,et al.  Video skimming based on story units via general tempo analysis , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[7]  Yung-Chang Chen,et al.  Advances in Multimedia Information Processing — PCM 2002: Third IEEE Pacific Rim Conference on Multimedia Hsinchu, Taiwan, December 16–18, 2002 Proceedings , 2002, IEEE Pacific Rim Conference on Multimedia.

[8]  Noboru Babaguchi,et al.  Personalized abstraction of broadcasted American football video by highlight selection , 2004, IEEE Transactions on Multimedia.

[9]  De Xu,et al.  Effective Video Scene Detection Approach Based on Cinematic Rules , 2005, KES.

[10]  Michael R. Lyu,et al.  Video summarization by video structure analysis and graph optimization , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[11]  Jianping Fan,et al.  Qualitative Camera Motion Classification for Content-Based Video Indexing , 2002, IEEE Pacific Rim Conference on Multimedia.

[12]  Yannis Avrithis,et al.  Spatiotemporal visual attention architecture for video analysis , 2004, IEEE 6th Workshop on Multimedia Signal Processing, 2004..

[13]  Jens-Rainer Ohm.  Multimedia Communication Technology: Representation,Transmission and Identification of Multimedia Signals , 2004 .

[14]  Lakhmi C. Jain,et al.  Knowledge-Based Intelligent Information and Engineering Systems , 2004, Lecture Notes in Computer Science.

[15]  Yi-Ping Phoebe Chen,et al.  Classification of self-consumable highlights for soccer video summaries , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[16]  Xu De.  A Unified Framework for Shot Boundary Detection , 2005 .