Video partitioning by temporal slice coherency

We present a novel approach for video partitioning by detecting three essential types of camera breaks, namely cuts, wipes, and dissolves. The approach is based on the analysis of temporal slices which are extracted from the video by slicing through the sequence of video frames and collecting temporal signatures. Each of these slices contains both spatial and temporal information from which coherent regions are indicative of uninterrupted video partitions separated by camera breaks. Properties could further be extracted from the slice for both the detection and classification of camera breaks. For example, cut and wipes are detected by color-texture properties, while dissolves are detected by statistical characteristics. The approach has been tested by extensive experiments.

[1]  David Bordwell,et al.  Film Art: An Introduction , 1979 .

[2]  Wei Xiong,et al.  Efficient Scene Change Detection and Camera Motion Annotation for Video Classification , 1998, Comput. Vis. Image Underst..

[3]  Chong-Wah Ngo,et al.  Detection of gradual transitions through temporal slice analysis , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[4]  Boon-Lock Yeo,et al.  On the extraction of DC sequence from MPEG compressed video , 1995, Proceedings., International Conference on Image Processing.

[5]  S.-L. Peng,et al.  Temporal slice analysis of image sequences , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Min Wu,et al.  An algorithm for wipe detection , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[7]  Ting-Chuen Pong,et al.  Detection of moving objects using a spatiotemporal representation , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[8]  A. M. Alattar.  Wipe scene change detector for use with video compression algorithms and MPEG-7 , 1998 .

[9]  Shih-Fu Chang,et al.  Scene change detection in an MPEG-compressed video sequence , 1995, Electronic Imaging.

[10]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[11]  P. Burt.  Fast filter transform for image processing , 1981 .

[12]  Chong-Wah Ngo,et al.  Camera break detection by partitioning of 2D spatio-temporal images in MPEG domain , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[13]  Gregory L. Zick,et al.  Scene decomposition of MPEG-compressed video , 1995, Electronic Imaging.

[14]  A. Murat Tekalp,et al.  Efficient Filtering and Clustering Methods for Temporal Video Segmentation and Visual Summarization , 1998, J. Vis. Commun. Image Represent..

[15]  Stan Z. Li,et al.  Markov Random Field Modeling in Computer Vision , 1995, Computer Science Workbench.

[16]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[17]  Anil K. Jain,et al.  Unsupervised texture segmentation using Gabor filters , 1990, 1990 IEEE International Conference on Systems, Man, and Cybernetics Conference Proceedings.

[18]  Adnan M. Alattar.  Detecting and compressing dissolve regions in video sequences with a DVI multimedia image compression algorithm , 1993, 1993 IEEE International Symposium on Circuits and Systems.

[19]  T. Little,et al.  Compressed Video Processing For Cut Detection , 1996 .

[20]  Anil K. Jain,et al.  Unsupervised texture segmentation using Gabor filters , 1990, 1990 IEEE International Conference on Systems, Man, and Cybernetics Conference Proceedings.

[21]  Boon-Lock Yeo,et al.  Rapid scene analysis on compressed video , 1995, IEEE Trans. Circuits Syst. Video Technol..