Gradual transition detection using color coherence and other criteria in a video shot meta-segmentation framework

Shot segmentation provides the basis for almost all high-level video content analysis approaches, validating it as one of the major prerequisites for efficient video semantic analysis, indexing and retrieval. The successful detection of both gradual and abrupt transitions is necessary to this end. In this paper a new gradual transition detection algorithm is proposed, that is based on novel criteria such as color coherence change that exhibit less sensitivity to local or global motion than previously proposed ones. These criteria, each of which could serve as a standalone gradual transition detection approach, are then combined using a machine learning technique, to result in a meta-segmentation scheme. Besides significantly improved performance, advantage of the proposed scheme is that there is no need for threshold selection, as opposed to what would be the case if any of the proposed features were used by themselves and as is typically the case in the relevant literature. Performance evaluation and comparison with four other popular algorithms reveals the effectiveness of the proposed technique.

[1]  Jae-Gark Choi,et al.  Correlation based video-dissolve detection , 2003, International Conference on Information Technology: Research and Education, 2003. Proceedings. ITRE2003..

[2]  Jong-Un Won,et al.  Adaptive video-dissolve detection method based on correlation between successive scenes , 2003 .

[3]  Ramin Zabih,et al.  A feature-based algorithm for detecting and classifying production effects , 1999, Multimedia Systems.

[4]  Chih-Wen Su,et al.  A motion-tolerant dissolve detection algorithm , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[5]  Haibin Lu,et al.  Robust gradual scene change detection , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[6]  Ramin Zabih,et al.  Comparing images using color coherence vectors , 1997, MULTIMEDIA '96.