Optimal unified approach to warping and overlapped block estimation in video coding

Among the class of block-based motion estimators, warping prediction and overlapped block motion estimation have emerged recently as two of the most effective inter-frame estimation algorithms. Warping estimation is based on linear operations in the motion field, while overlapped block estimators are based on a linear sum of motion-based estimators in the intensity field. In this paper, we propose a unified framework for estimation of pixel intensities based jointly on warping and overlapped blocks. We motivate our estimator through a discussion of ambiguities in an incomplete (sparsely sampled) motion field; and that different object motions call for resolution of motion ambiguities in either the motion or intensity domain. We offer a means of optimizing the joint estimator simultaneously in intensity and motion domains, thus guaranteeing improved performance compared to warping and overlapped block estimators, which the joint model contains as special cases. Furthermore, the joint framework provides an excellent vehicle for studying the interactions and relative merits of warping and overlapped block estimators in the presence of various motion scenarios.

[1]  Michael T. Orchard,et al.  Overlapped block motion compensation: an estimation-theoretic approach , 1994, IEEE Trans. Image Process..

[2]  Hiroshi Harashima,et al.  Iterative motion estimation method using triangular patches for motion compensation , 1991, Other Conferences.

[3]  Jiro Katto,et al.  An analytical framework for overlapped motion compensation , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[4]  Gary J. Sullivan,et al.  Motion compensation for video compression using control grid interpolation , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[5]  Sharad Singhal,et al.  Windowed motion compensation , 1991, Other Conferences.

[6]  Michael T. Orchard,et al.  Interframe coding of magnetic resonance images , 1996, IEEE Trans. Medical Imaging.