Multidirectional parabolic prediction-based interpolation-free sub-pixel motion estimation

Motion estimation is one of the most effective key components in video codecs to eliminate temporal redundancies between successive frames. Sub-pixel motion estimation, including sub-pixel interpolation and sub-pixel motion vector prediction, has been employed in many recent international video coding standards to further improve the rate-distortion performance. Although sub-pixel motion estimation plays an important role in improving coding efficiency, it simultaneously brings significant computational complexity, especially in sub-pixel interpolation and motion vector prediction. In this paper, we propose a multidirectional parabolic prediction-based interpolation-free sub-pixel motion estimation scheme. First, four different directional parabolic prediction patterns are developed to estimate the candidate optimal sub-pixel positions, making full use of the available rate-distortion costs of neighboring positions in the integer-pixel motion estimation. Second, an improvement for each directional parabolic prediction pattern is realized by projection operations to generate a more precise candidate optimal sub-pixel position. Third, an optimal sub-pixel position decision method is presented to select the most likely predictive position from the four candidate sub-pixel positions derived in the previous steps. Finally, by fully reusing the information of the powerful advanced motion vector prediction (AMVP) in HEVC, a prediction enhancement mechanism is presented in which the final optimal sub-pixel motion vector (MV) is derived between the MV corresponding to the most likely predictive position and the predictive motion vector (PMV), without requiring extra interpolation operations. Experimental results show that the proposed algorithm significantly reduces the computational complexity of sub-pixel motion estimation and outperforms state-of-the-art interpolation-free sub-pixel motion estimation algorithms with much improved encoding performance and comparable computational complexity reduction. Multidirectional parabolic prediction patterns are developed to reduce coding loss.Projection is introduced to improve each directional parabolic prediction pattern.A prediction enhancement mechanism is presented by incorporating AMVP information.Significant complexity reduction (about 90%) of sub-pixel ME is achieved over HM16.0.Proposed algorithm outperforms state-of-the-art algorithms with improved coding performance.

[1]  David R. Bull,et al.  Sub-pixel motion estimation using kernel methods , 2010, Signal Process. Image Commun..

[2]  Tian Song,et al.  Low complexity algorithm for sub-pixel motion estimation of HEVC , 2013, 2013 IEEE International Conference on Signal Processing, Communication and Computing (ICSPCC 2013).

[3]  Yücel Altunbasak,et al.  Fast Motion Estimation With Interpolation-Free Sub-Sample Accuracy , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Jin-Jang Leou,et al.  A Quadratic Prediction Based Fractional-Pixel Motion Estimation Algorithm for H.264 , 2005, ISM.

[5]  Cedric Nishan Canagarajah,et al.  Interpolation-free subpixel refinement for block-based motion estimation , 2004, IS&T/SPIE Electronic Imaging.

[6]  Jun Rim Choi,et al.  High performance fractional motion estimation in h.264/avc based on one-step algorithm and 8×4 element block processing , 2011, Signal Process. Image Commun..

[7]  David Flynn,et al.  HEVC Complexity and Implementation Analysis , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Lu Yu,et al.  A novel interpolation-free scheme for fractional pixel motion estimation , 2015, 2015 Picture Coding Symposium (PCS).

[9]  Wen Gao,et al.  A comparison of fractional-pel interpolation filters in HEVC and H.264/AVC , 2012, 2012 Visual Communications and Image Processing.

[10]  Cedric Nishan Canagarajah,et al.  Interpolation Free Subpixel Accuracy Motion Estimation , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Oscar C. Au,et al.  A robust interpolation-free approach for sub-pixel accuracy motion estimation , 2013, 2013 IEEE International Conference on Image Processing.

[12]  Jechang Jeong,et al.  Model-based quarter-pixel motion estimation with low computational complexity , 2009 .

[13]  Zhibo Chen,et al.  PPFPS - a paraboloid prediction based fractional pixel search strategy for H.26L , 2002, 2002 IEEE International Symposium on Circuits and Systems. Proceedings (Cat. No.02CH37353).

[14]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Qi Zhang,et al.  Direct Techniques for Optimal Sub-Pixel Motion Accuracy Estimation and Position Prediction , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[17]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[18]  Yun He,et al.  PPHPS: a parabolic prediction-based, fast half-pixel search algorithm for very low bit-rate moving-picture coding , 2003, IEEE Trans. Circuits Syst. Video Technol..