Global motion estimation using variable block sizes and its application to object segmentation

Global motion is estimated either in the pixel domain or in block based domain. Until now, all the approaches regarding the latter are based on fixed sized blocks while the recent compression methods tend to use variable block sizes during motion estimation. In this paper we present a new procedure for global motion estimation based on a variable block size motion vector field. A block matching algorithm which is able to adapt the block size according to the motion complexity within the frame is used. The resulting motion vectors are employed for global motion estimation. Furthermore, binary foreground-background masks are created based on the frame-by-frame motion compensated differences by exploiting spatial conditions through anisotropic diffusion filtering. For global motion estimation the performance evaluation in terms of background PSNR shows an enhancement of more than 2.5 dB in the well-known “Stefan” sequence, compared to the conventional case of fixed block size, at a reasonable implementation complexity.

[1]  André Kaup,et al.  Global motion estimation in image sequences using robust motion vector field segmentation , 1999, MULTIMEDIA '99.

[2]  Aljoscha Smolic,et al.  Low-complexity global motion estimation from P-frame motion vectors for MPEG-7 applications , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[3]  Ming-Ting Sun,et al.  Global motion estimation from coarsely sampled motion vector field and the applications , 2003, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Mohammed Ghazal,et al.  Robust Global Motion Estimation Oriented to Video Object Segmentation , 2008, IEEE Transactions on Image Processing.

[5]  Michael R. Frater,et al.  Motion-based Object Segmentation using Sprites and Anisotropic Diffusion , 2007, Eighth International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS '07).

[6]  Ahmet M. Kondoz,et al.  Flexible motion model with variable size blocks for depth frames coding in colour-depth based 3D video coding , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[7]  Mathias Wien,et al.  Variable block-size transforms for H.264/AVC , 2003, IEEE Trans. Circuits Syst. Video Technol..

[8]  Aljoscha Smolic,et al.  Long-term global motion estimation and its application for sprite coding, content description, and segmentation , 1999, IEEE Trans. Circuits Syst. Video Technol..

[9]  Thomas Sikora,et al.  Trends and Perspectives in Image and Video Coding , 2005, Proceedings of the IEEE.

[10]  José Ignacio Benavides Benítez,et al.  Global motion estimation algorithm for video segmentation , 2003, Visual Communications and Image Processing.

[11]  Theodore Vlachos,et al.  Motion-compensation using variable-size block-matching with binary partition trees , 2005, IEEE International Conference on Image Processing 2005.