Object-based video abstraction using cluster analysis

Among various semantic primitives of video, objects of interest along with their actions and generated events can play an important role in some applications such as an object-based video surveillance system and an object based video indexing/retrieval system. In this paper, we propose an object-based video abstraction algorithm by cluster analysis using the mean shift algorithm. The generated clusters, called segments in this paper, can be used as a small unit in the object-based video indexing/retrieval systems. In the proposed algorithm, Hu's (1962) seven moments are used as shape descriptors for each video object plane (VOP), and shape distance between two VOPs is measured by using weighted Euclidean distance. Promising experimental results on the proposed scheme are presented.

[1]  Alan Hanjalic,et al.  An integrated scheme for automated video abstraction based on unsupervised cluster-validity analysis , 1999, IEEE Trans. Circuits Syst. Video Technol..

[2]  Dorin Comaniciu,et al.  Mean shift analysis and applications , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[3]  Dorin Comaniciu,et al.  Robust analysis of feature spaces: color image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[5]  Jenq-Neng Hwang,et al.  A framework for object-based video analysis , 2000 .

[6]  A. Murat Tekalp,et al.  Object-based indexing of MPEG-4 compressed video , 1997, Electronic Imaging.

[7]  Gary Bradski,et al.  Computer Vision Face Tracking For Use in a Perceptual User Interface , 1998 .

[8]  Yizong Cheng,et al.  Mean Shift, Mode Seeking, and Clustering , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Faouzi Kossentini,et al.  Automatic Key Video Object Plane Selection Using the Shape Information in the MPEG-4 Compressed Domain , 2000, IEEE Trans. Multim..

[10]  Larry D. Hostetler,et al.  The estimation of the gradient of a density function, with applications in pattern recognition , 1975, IEEE Trans. Inf. Theory.