Motion hints based inter-frame prediction for hybrid video coding

Experimental results and the latest standards have proved video coding systems with the ability to adapt the size and shape of the motion estimation area to the objects in the scene can outperform the traditional block-based video coding systems. In this paper, a segmentation-based coding strategy that employs bi-directional motion hints for interframe prediction is proposed. The appealing thing about motion hints is that they are continuous and invertible, even though the observed motion field for a frame will be discontinuous and non-invertible. The proposed scheme outperforms the rate-distortion performance of H.264/AVC reference by 1.1 dB and a bit rebate of 26.6% is achieved.

[1]  Edson M. Hung,et al.  Efficiency improvements for a geometric-partition-based video coder , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[2]  Aous Thabit Naman,et al.  Efficient communication of video using metadata , 2011, 2011 18th IEEE International Conference on Image Processing.

[3]  Mark R. Pickering,et al.  Motion compensation using geometry and an elastic motion model , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[4]  Hujun Bao,et al.  Robust Bilayer Segmentation and Motion/Depth Estimation with a Handheld Camera , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Antonio Ortega,et al.  Motion compensation based on implicit block segmentation , 2008, 2008 15th IEEE International Conference on Image Processing.

[6]  Mark R. Pickering,et al.  A fast approach for geometry-adaptive block partitioning , 2009, 2009 Picture Coding Symposium.

[7]  Simone Milani,et al.  Segmentation-based motion compensation for enhanced video coding , 2011, 2011 18th IEEE International Conference on Image Processing.

[8]  Stefano Tubaro,et al.  Motion Estimation by Quadtree Pruning and Merging , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[9]  Reji Mathew,et al.  Scalable Modeling of Motion and Boundary Geometry With Quad-Tree Node Merging , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Heiko Schwarz,et al.  Adaptive motion model selection using a cubic spline based estimation framework , 2010, 2010 IEEE International Conference on Image Processing.

[11]  David S. Taubman,et al.  On the benefits of leaf merging in quad-tree motion models , 2005, IEEE International Conference on Image Processing 2005.

[12]  Mark R. Pickering,et al.  Motion segmentation initialization strategies for bi-directional inter-frame prediction , 2013, 2013 IEEE 15th International Workshop on Multimedia Signal Processing (MMSP).

[13]  Rui Xu,et al.  Inter-frame prediction using motion hints , 2013, 2013 IEEE International Conference on Image Processing.