Frame Rate Up-Conversion Based Motion Vector Derivation for Hybrid Video Coding

In this paper, a MV derivation method based on the idea of frame rate up-conversion (FRUC) is proposed. When a block is signaled as FRUC mode, the motion information of the block is derived without signaling. Moreover, derived MVs are refined at sub-block level for more accurate motion field. In addition, two matching methods, i.e., bilateral matching and template matching are supported to obtain good performance in both bi-directional and uni-directional prediction. Simulations under HEVC common test conditions show that over 4.2% average BD-rate reduction was achieved over HEVC reference software HM-16.6 in the case of random access configuration. The method has been adopted into the Joint Exploration Model (JEM) developed by the joint video exploration team (JVET) of MPEG and ITU-T VCEG for the study of next generation video coding standard.

[1]  Yrjö Neuvo,et al.  Fractional frame rate up-conversion using weighted median filters , 1989 .

[2]  Wen Gao,et al.  Multiple Hypotheses Bayesian Frame Rate Up-Conversion by Adaptive Fusion of Motion-Compensated Interpolations , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Mathias Wien,et al.  Decoder-Side Motion Vector Derivation for Block-Based Video Coding , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Wenhao Zhang,et al.  Decoder-side Motion Estimation and Wiener filter for HEVC , 2013, 2013 Visual Communications and Image Processing (VCIP).

[5]  Detlev Marpe,et al.  Block Merging for Quadtree-Based Partitioning in HEVC , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Jo Yew Tham,et al.  A novel unrestricted center-biased diamond search algorithm for block motion estimation , 1998, IEEE Trans. Circuits Syst. Video Technol..

[7]  F. Bossen,et al.  Common test conditions and software reference configurations , 2010 .

[8]  Wen Gao,et al.  A new frame interpolation method with pixel-level motion vector field , 2014, 2014 IEEE Visual Communications and Image Processing Conference.