Multi-hypothesis Temporal Prediction Using Template Matching Prediction and Block Motion Compensation for High Efficiency Video Coding

This paper introduces a multi-hypothesis temporal prediction technique that combines two motion vectors (MVs) derived respectively from template and block matching for overlapped block motion compensation (OBMC). It achieves similar prediction performance to bi-prediction while only one MV has to be sent. Based on two signal models, the template MV is shown to approximate the pixel true motion around the template centroid. We then find another MV to best complement the template MV from both deterministic and statistical viewpoints, the latter leading to the search of its optimal sampling location in the motion field. The result is a search criterion with OBMC window functions forming a geometry-like motion partitioning. To compromise between performance and complexity, generalizations to adaptive template design, multi-hypothesis prediction and motion merging are made. Extensive experiments conducted with the HM-3.0 software confirm the effectiveness of the proposed schemes.

[1]  Wen-Hsiao Peng,et al.  Parametric OBMC for Pixel-Adaptive Temporal Prediction on Irregular Motion Sampling Grids , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Wen Gao,et al.  Combining template matching and block motion compensation for video coding , 2010, 2010 International Symposium on Intelligent Signal Processing and Communication Systems.

[3]  Yoshinori Suzuki,et al.  An improved low delay inter frame coding using template matching averaging , 2010, 28th Picture Coding Symposium.

[4]  Michael T. Orchard,et al.  A parametric solution for optimal overlapped block motion compensation , 2001, IEEE Trans. Image Process..

[5]  F. Bossen,et al.  Common test conditions and software reference configurations , 2010 .

[6]  Michael T. Orchard,et al.  Overlapped block motion compensation: an estimation-theoretic approach , 1994, IEEE Trans. Image Process..

[7]  Mathias Wien,et al.  Fast decoder side motion vector derivation for inter frame video coding , 2008, 2009 Picture Coding Symposium.

[8]  Thomas S. Huang,et al.  Image processing , 1971 .

[9]  Susumu Itoh,et al.  Analysis of space-dependent characteristics of motion-compensated frame differences based on a statistical motion distribution model , 2002, IEEE Trans. Image Process..

[10]  Wen-Hsiao Peng,et al.  Bi-prediction combining template and block motion compensations , 2011, 2011 18th IEEE International Conference on Image Processing.

[11]  Mathias Wien,et al.  Multihypothesis prediction using decoder side-motion vector derivation in inter-frame video coding , 2009, Electronic Imaging.

[12]  Yoshinori Suzuki,et al.  Block-Based Reduced Resolution Inter Frame Coding with Template Matching Prediction , 2006, 2006 International Conference on Image Processing.