A Video Mosaic Algorithm for Compressed Video

A video mosaic method is proposed in this paper. Firstly, phase correlation is used to roughly compute translation offset between the first corresponding frames of two video streams, which speeds up corner match procedure and improves matching stability as well. Secondly, SIFT method is used to detect and match corners in the overlapped region. Then, a RANSAC technique is applied to eliminate outliers to ensure effectiveness of the matched corner pairs. Singular value decomposition-least square(SVDLS) method and Levenberg-Marquardt optimization are used to robustly determine the 8-parameters transform. For the other frames left, we calculate a global motion vector between consecutive frames from motion vectors included in the compressed video data, thereafter obtain projection matrix between two frames from that of the previous frame together with the global motion of each input video sequence. In the last step of the algorithm, a multi-band blending technique is used to generate the final panorama. Invalid parameters are verified by the translation offset to make Levenberg-Marquardt optimization more successful. The experiments show that the proposed algorithm exceeds existing ones at matching speed and stability.

[1]  Lucas Kovar,et al.  Footskate cleanup for motion capture editing , 2002, SCA '02.

[2]  Li-Qun Xu,et al.  Robust panorama from MPEG video , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[3]  B. N. Chatterji,et al.  An FFT-based technique for translation, rotation, and scale-invariant image registration , 1996, IEEE Trans. Image Process..

[4]  Aaron Hertzmann,et al.  Style machines , 2000, SIGGRAPH 2000.

[5]  Zhang Zhong-wei.  Efficient Global Motion Estimation Method for MPEG Video , 2004 .

[6]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[7]  Guizhong Liu,et al.  A Robust, Efficient, and Fast Global Motion Estimation Method from MPEG Compressed Video , 2002, IEEE Pacific Rim Conference on Multimedia.

[8]  Audra E. Kosh,et al.  Linear Algebra and its Applications , 1992 .

[9]  Bobby Bodenheimer,et al.  Computing the duration of motion transitions: an empirical approach , 2004, SCA '04.

[10]  Oscar C. Au,et al.  Fast global motion estimation based on local motion segmentation , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[11]  Aaron Hertzmann,et al.  Style-based inverse kinematics , 2004, SIGGRAPH 2004.

[12]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[13]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[14]  Edward H. Adelson,et al.  A multiresolution spline with application to image mosaics , 1983, TOGS.

[15]  Ken Shoemake,et al.  Animating rotation with quaternion curves , 1985, SIGGRAPH.