Estimation of arbitrary camera motion in MPEG videos

Several algorithms have been proposed to solve the problem of camera motion estimation in digital videos. However, the distinction between translation along the x-axis (y-axis) and rotation around the y-axis (x-axis) has only rarely been considered, and no approach of this kind is known to us for the MPEG domain. In this paper, we present such an algorithm for camera motion estimation in MPEG videos. For performance reasons it is reasonable to extract motion vectors directly from the compressed stream. However, since motion vectors are optimal with respect to compression, they often do not model real motion adequately and can thus be considered as "outliers" with respect to camera motion estimation. Consequently, an outlier removal algorithm is incorporated into our approach to solve this problem. Furthermore, we have investigated the minimum number of motion vectors required to obtain satisfactory results. Comprehensive experiments with 32 video clips demonstrate the performance of the proposed approach.

[1]  Svetha Venkatesh,et al.  Qualitative estimation of camera motion parameters from video sequences , 1997, Pattern Recognition.

[2]  Hyung-Myung Kim,et al.  Efficient camera motion characterization for MPEG video indexing , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[3]  Philippe Joly,et al.  Efficient automatic analysis of camera work and microsegmentation of video using spatiotemporal images , 1996, Signal Process. Image Commun..

[4]  Sanjeev R. Kulkarni,et al.  Rapid estimation of camera motion from compressed video with application to video annotation , 2000, IEEE Trans. Circuits Syst. Video Technol..

[5]  Benoit Mory,et al.  Video motion representation for improved content access , 2000, 2000 Digest of Technical Papers. International Conference on Consumer Electronics. Nineteenth in the Series (Cat. No.00CH37102).

[6]  Irena Koprinska,et al.  Temporal video segmentation: A survey , 2001, Signal Process. Image Commun..

[7]  Mike Brookes,et al.  Precise real-time outlier removal from motion vector fields for 3D reconstruction , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[8]  Chong-Wah Ngo,et al.  Motion analysis and segmentation through spatio-temporal slices processing , 2003, IEEE Trans. Image Process..

[9]  Jong-Il Park,et al.  Estimating camera parameters from motion vectors of digital video , 1998, 1998 IEEE Second Workshop on Multimedia Signal Processing (Cat. No.98EX175).