Improving the Spatial-Temporal Clue Based Segmentation by the Use of Rhythm

Video is a major media in the society of information under way. Unfortunately, the full use of this media is limited by the opaque character of the video which prevents content-based access. In this paper we improve our previous spatial temporal clues-based semantic video segmentation technique, and propose the use of the rhythm within a video to more precisely capture temporal relations within a scene and between scenes in a video. Preliminary evidence based on a 7 minutes video shows that our spatial temporal clues-based segmentation technique coupled with the rhythm consideration fully detect the narrative structure of a video.

[1]  Michael G. Christel,et al.  Improving Access to a Digital Video Library , 1997, INTERACT.

[2]  Boon-Lock Yeo,et al.  Time-constrained clustering for segmentation of video into story units , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[3]  James F. Allen Maintaining knowledge about temporal intervals , 1983, CACM.

[4]  Liming Chen,et al.  Video segmentation using 3D hints contained in 2D images , 1996, Other Conferences.

[5]  Michael Mills,et al.  A magnifier tool for video data , 1992, CHI.

[6]  M. Smith,et al.  Video Skimming for Quick Browsing based on Audio and Image Characterization , 1995 .

[7]  Yihong Gong,et al.  Automatic parsing of news video , 1994, 1994 Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[8]  Philippe Aigrain,et al.  Medium knowledge-based macro-segmentation of video into sequences , 1997 .

[9]  Boon-Lock Yeo,et al.  Extracting story units from long programs for video browsing and navigation , 1996, Proceedings of the Third IEEE International Conference on Multimedia Computing and Systems.

[10]  Boon-Lock Yeo,et al.  Video browsing using clustering and scene transitions on compressed sequences , 1995, Electronic Imaging.