Content-Based Video Segmentation using Statistical Motion Models

We present in this paper an original approach for content-based video segmentation using motion information. The method is generic and does not require any knowledge about the type of the processed video. Its relies on the analysis of the temporal evolution of the dynamic content of the video. The motion content is characterised by a probabilistic Gibbsian modelling of the distribution of local motion-related measurements. The designed statistical framework provides a well formalised similarity measure according to motion activity that we exploit to derive criteria for segmentation decision. Then, the considered merging criteria are sequentially applied between every two successive temporal units of the video to progressively form homogeneous segments in term of motion content. Experiments on real video documents demonstrate the ability of the proposed approach to provide a concise and meaningful overview of a video.

[1]  M. Irani,et al.  Event-Based Video Analysis, , 2001 .

[2]  John S. Boreczky,et al.  Comparison of video shot boundary detection techniques , 1996, J. Electronic Imaging.

[3]  M. Basseville Distance measures for signal processing and pattern recognition , 1989 .

[4]  Patrick Pérez,et al.  Nonparametric motion characterization using causal probabilistic models for video indexing and retrieval , 2002, IEEE Trans. Image Process..

[5]  Yong Rui,et al.  Segmenting visual actions based on spatio-temporal motion patterns , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[6]  Patrick Bouthemy,et al.  Non parametric motion recognition using temporal multiscale Gibbs models , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[7]  Patrick Bouthemy,et al.  A unified approach to shot change detection and camera motion characterization , 1999, IEEE Trans. Circuits Syst. Video Technol..

[8]  Jeho Nam,et al.  Dynamic video summarization and visualization , 1999, MULTIMEDIA '99.

[9]  Boon-Lock Yeo,et al.  Extracting story units from long programs for video browsing and navigation , 1996, Proceedings of the Third IEEE International Conference on Multimedia Computing and Systems.