A Statistical Approach to Robust Video Temporal Segmentation

The problem of video ’cut’ detection remains largely an open problem, because of the wide nature of transitions that occur in a digital video. This paper describes a shot boundary detection technique which is an amalgamation of few statistical methods and measures, and robustly detects camera breaks in a full-motion video clip. The proposed algorithm incorporates a weighted histogram, an error-propagation technique for increased robustness, and a curve-fitting technique to extract partitions from the similarity curve for avoiding heuristically chosen threshold value. The algorithm has been validated on many video clips and is shown to give improved results.

[1]  Patrick Bouthemy,et al.  Video partitioning and camera motion characterization for content-based video indexing , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[2]  Rainer Lienhart,et al.  Reliable Transition Detection in Videos: A Survey and Practitioner's Guide , 2001, Int. J. Image Graph..

[3]  Dong Zhang,et al.  A New Shot Boundary Detection Algorithm , 2001, IEEE Pacific Rim Conference on Multimedia.

[4]  Nilesh V. Patel,et al.  Video shot detection and characterization for video databases , 1997, Pattern Recognit..

[5]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[6]  Ullas Gargi,et al.  Performance characterization of video-shot-change detection methods , 2000, IEEE Trans. Circuits Syst. Video Technol..

[7]  William I. Grosky,et al.  The Handbook of Multimedia Information Management , 1997 .

[8]  Borko Furht,et al.  Video and Image Processing in Multimedia Systems , 1995 .

[9]  Rajeev Kumar,et al.  Triplet geometric representation: a novel scale, translation and rotation invariant feature representation based on geometric constraints for recognition of 2D object features , 1997, Image Vis. Comput..

[10]  Narendra Ahuja,et al.  Robust video shot change detection , 1998, 1998 IEEE Second Workshop on Multimedia Signal Processing (Cat. No.98EX175).

[11]  Edoardo Ardizzone,et al.  Automatic Video Database Indexing and Retrieval , 2004, Multimedia Tools and Applications.

[12]  John S. Boreczky,et al.  Comparison of video shot boundary detection techniques , 1996, Electronic Imaging.

[13]  William H. Press,et al.  Numerical recipes in C , 2002 .

[14]  Irena Koprinska,et al.  Temporal video segmentation: A survey , 2001, Signal Process. Image Commun..

[15]  Ramesh C. Jain,et al.  Digital video segmentation , 1994, MULTIMEDIA '94.