Video shot detection based on linear prediction of motion

This paper describes an approach for video shot detection. It relies on the temporal analysis of frame to frame optical flow measurements. These measures, which are motion wavelet coefficients directly estimated from the image sequence, exhibit discontinuities when shot boundaries occur. These transitions are detected by considering the temporal trajectories of the linear prediction errors of wavelet coefficients. Experimental results and performance evaluation using videos with reference segmentations are presented to demonstrate the efficiency of the approach.

[1]  Jean-Marc Odobez,et al.  Robust Multiresolution Estimation of Parametric Motion Models , 1995, J. Vis. Commun. Image Represent..

[2]  Lihi Zelnik-Manor,et al.  Event-based analysis of video , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[3]  Takeo Kanade,et al.  Image Registration Using Wavelet-Based Motion Model , 2000, International Journal of Computer Vision.

[4]  Stéphane Marchand-Maillet,et al.  Towards a Standard Protocol for the Evaluation of Video-to-Shots Segmentation Algorithms , 1999 .

[5]  Ullas Gargi,et al.  Performance characterization and comparison of video indexing algorithms , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[6]  Eric Bruno,et al.  Video structuring, indexing and retrieval based on global motion wavelet coefficients , 2002, Object recognition supported by user interaction for service robots.

[7]  Azriel Rosenfeld,et al.  Robust regression methods for computer vision: A review , 1991, International Journal of Computer Vision.

[8]  Yong Rui,et al.  Segmenting visual actions based on spatio-temporal motion patterns , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[9]  Eric Bruno,et al.  Global motion model based on B-spline wavelets: application to motion estimation and video indexing , 2001, ISPA 2001. Proceedings of the 2nd International Symposium on Image and Signal Processing and Analysis. In conjunction with 23rd International Conference on Information Technology Interfaces (IEEE Cat..

[10]  Patrick Bouthemy,et al.  A unified approach to shot change detection and camera motion characterization , 1999, IEEE Trans. Circuits Syst. Video Technol..