Dense true motion field compensation for video coding

In this paper, a new motion compensation scheme based on dense true motion fields is investigated for video coding. The proposed technique is similar to the block-based decoder-side motion estimation method except that dense motion fields estimated from previously decoded frames are used for frame prediction. This paper demonstrates that even with compression distortions, an iterative dense true motion estimation technique can still produce good quality dense motion fields for video coding or frame-rate up-sampling applications. In particular, we have shown that when the new dense motion field compensation tool is integrated into the B-frame codec of H.264, one can achieve up to 8% overall BD bit-rate savings using standard MPEG test sequences.

[1]  Chang-Su Kim,et al.  Motion-Compensated Frame Interpolation Using Bilateral Motion Estimation and Adaptive Overlapped Block Motion Compensation , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Michael E. Becker 26.1: Motion Blur Measurement and Evaluation: From Theory to the Laboratory , 2007 .

[3]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[4]  Jörn Ostermann,et al.  Decoder-side hierarchical motion estimation for dense vector fields , 2010, 28th Picture Coding Symposium.

[5]  Michael J. Black,et al.  Secrets of optical flow estimation and their principles , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Richard Szeliski,et al.  A Database and Evaluation Methodology for Optical Flow , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[7]  Wen Gao,et al.  A Spatio-Temporal Auto Regressive Model for Frame Rate Upconversion , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Mathias Wien,et al.  Decoder-side motion vector derivation for hybrid video inter coding , 2010, 2010 IEEE International Conference on Multimedia and Expo.