Effective Video Scene Detection Approach Based on Cinematic Rules

Scene detection is an essential step to organize the video data properly for content-based video analysis and its application. In this paper, an effective scene detection approach is proposed, which exploits the cinematic rules used by filmmakers as guideline to compute shot similarities and identify the video scenes in narrative film. First, a clustering method with time constraint is used to group the shots into scene slices. Then dialog scene's alternative structure and audio correlation are used to identify dialog scene. Finally, motion and audio correlation guided by cinematic rules are used to further detect action scene. Experimental results show that the proposed method works well and can deal with complex scene.

[1]  Ba Tu Truong,et al.  Scene extraction in motion pictures , 2003, IEEE Trans. Circuits Syst. Video Technol..

[2]  Xue Xiang Qualitative Analysis of Dominant Motion for Compressed Video Stream , 2002 .

[3]  Yap-Peng Tan,et al.  An efficient graph theoretic approach to video scene clustering , 2003, Fourth International Conference on Information, Communications and Signal Processing, 2003 and the Fourth Pacific Rim Conference on Multimedia. Proceedings of the 2003 Joint.

[4]  Xinbo Gao,et al.  A Unified Framework for Shot Boundary Detection , 2005, CIS.

[5]  Lang Congyan An Efficient Method for Video Scene Detection , 2004 .

[6]  Zhu Liu,et al.  Multimedia content analysis-using both audio and visual clues , 2000, IEEE Signal Process. Mag..

[7]  Chengcui Zhang,et al.  Scene change detection by audio and video clues , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[8]  D. Arijon,et al.  Grammar of Film Language , 1976 .

[9]  Xu De A Unified Framework for Shot Boundary Detection , 2005 .

[10]  Xu De,et al.  EFFICIENT KEY FRAMES EXTRACTION BASED ON HIERARCHICAL CLUSTERING , 2004 .

[11]  Yingying Zhu,et al.  Scene change detection based on multimodal integration , 2003, International Symposium on Multispectral Image Processing and Pattern Recognition.

[12]  Wallapak Tavanapong,et al.  Shot clustering techniques for story browsing , 2004, IEEE Transactions on Multimedia.

[13]  Lie Lu,et al.  A robust audio classification and segmentation method , 2001, MULTIMEDIA '01.