Video Scene Extraction Using Mosaic Technique

Scene extraction is the first step toward semantic understanding of the video. This paper presents an effective approach to video scene extraction based on the analysis of background images. Our approach exploits the fact that shots belonging to one particular scene often have similar background. Although part of the video frame is covered by foreground objects, background scene still can be reconstructed by mosaic technique. The proposed scene extraction algorithm consists of two main components: the determination of shot similarity measure and shot grouping process. In our approach, several low-level visual features are integrated to compute the similarity measure between two shots. On the other hand, high-level knowledge in cinematography is used to guide the shot grouping process. Experimental results show that our approach is promising and outperforms some existing technique

[1]  Liang-Hua Chen,et al.  On the preview of digital movies , 2003, J. Vis. Commun. Image Represent..

[2]  John R. Kender,et al.  Video scene segmentation via continuous video coherence , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[3]  Mubarak Shah,et al.  Detection and representation of scenes in videos , 2005, IEEE Transactions on Multimedia.

[4]  Alan Hanjalic,et al.  Automated high-level movie segmentation for advanced video-retrieval systems , 1999, IEEE Trans. Circuits Syst. Video Technol..

[5]  J. Mollon Color vision. , 1982, Annual review of psychology.

[6]  Ba Tu Truong,et al.  Scene extraction in motion pictures , 2003, IEEE Trans. Circuits Syst. Video Technol..

[7]  Tat-Seng Chua,et al.  A video retrieval and sequencing system , 1995, TOIS.

[8]  Boon-Lock Yeo,et al.  Segmentation of Video by Clustering and Graph Analysis , 1998, Comput. Vis. Image Underst..

[9]  Chong-Wah Ngo,et al.  Motion-Based Video Representation for Scene Change Detection , 2004, International Journal of Computer Vision.

[10]  Michal Irani,et al.  Video indexing based on mosaic representations , 1998, Proc. IEEE.

[11]  Liang-Hua Chen,et al.  Extraction of video object with complex motion , 2004, Pattern Recognit. Lett..

[12]  Leo Maurice Hurvich,et al.  Color vision , 1981 .