Fast Integer Motion Estimation With Bottom-Up Motion Vector Prediction for an HEVC Encoder

Although advanced motion vector prediction (AMVP) modes based on motion estimation (ME) are selected significantly less due to the merge mode newly adopted in the high-efficiency video coding (HEVC), integer ME (IME) still occupies a large amount of computation in HEVC because the HEVC supports a highly flexible block partitioning structure. Introduction of the merge mode in HEVC substantially affects the optimal search algorithm of IME. Therefore, this gives a chance to reduce the computational complexity of ME with marginal drop of the compression efficiency. This paper proposes a new IME algorithm that significantly reduces its search ranges. Computational complexity of the proposed algorithm is reduced without serious degradation in coding efficiency by obtaining additional accurate motion vector predictors (MVPs) in a bottom-up order and searching narrow regions around multiple MVPs. These bottom-up MVPs are obtained from the prediction units (PUs) in the coding units (CUs) in the hierarchically lower level, which share the pixel area either completely or partially with the current PU. Although the encoder should perform the proposed IME in a bottom-up order from the smallest CUs to the larger CUs, several other processes, such as fractional ME and merges mode are performed in a top-down order to exploit several fast algorithms already adopted in the HEVC test model encoder. To keep compatibility with HEVC standard, the bottom-up MVPs are utilized for only IME. The bitstream is generated using standard AMVP. According to the simulation results, it is confirmed that the proposed algorithm improves the accuracy of MVPs, which leads to the reduction of IME computational complexity up to 81.95% on average with the Bjøntegaard delta bitrate of 0.39%.

[1]  Nouri Masmoudi,et al.  TZSearch pattern search improvement for HEVC motion estimation modules , 2014, 2014 1st International Conference on Advanced Technologies for Signal and Image Processing (ATSIP).

[2]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[3]  Zhi Liu,et al.  Adaptive Inter-Mode Decision for HEVC Jointly Utilizing Inter-Level and Spatiotemporal Correlations , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Myung Hoon Sunwoo,et al.  Efficient integer motion estimation algorithm using sub-sampling , 2009, 2009 International SoC Design Conference (ISOCC).

[5]  Jo Yew Tham,et al.  A novel unrestricted center-biased diamond search algorithm for block motion estimation , 1998, IEEE Trans. Circuits Syst. Video Technol..

[6]  C. Cheung,et al.  Normalized partial distortion search algorithm for block motion estimation , 2000, IEEE Trans. Circuits Syst. Video Technol..

[7]  Hyuk-Jae Lee,et al.  Merge Mode Estimation for a Hardware-Based HEVC Encoder , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Wen Gao,et al.  A Hardware-Efficient Multi-Resolution Block Matching Algorithm and its VLSI Architecture for High Definition MPEG-Like Video Encoders , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Munchurl Kim,et al.  A Novel Fast CU Encoding Scheme Based on Spatiotemporal Encoding Parameters for HEVC Inter Coding , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Ke-Ying Liao,et al.  Enhanced AMVP mechanism based adaptive motion search range decision algorithm for fast HEVC coding , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[11]  Tihao Chiang,et al.  A hierarchical motion estimation algorithm using nonlinear pyramid for MPEG-2 , 1997, Proceedings of 1997 IEEE International Symposium on Circuits and Systems. Circuits and Systems in the Information Age ISCAS '97.

[12]  Chaur-Heh Hsieh,et al.  A Novel Prediction-Based Directional Asymmetric Search Algorithm for Fast Block-Matching Motion Estimation , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Zhenyu Wang,et al.  Fast motion estimation methods for HEVC , 2014, 2014 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting.

[14]  Lai-Man Po,et al.  A novel four-step search algorithm for fast block motion estimation , 1996, IEEE Trans. Circuits Syst. Video Technol..

[15]  C.-C. Jay Kuo,et al.  Fast motion vector estimation using multiresolution-spatio-temporal correlations , 1997, IEEE Trans. Circuits Syst. Video Technol..

[16]  Jong Beom Ra,et al.  An efficient motion vector coding scheme based on minimum bitrate prediction , 1999, IEEE Trans. Image Process..

[17]  Bede Liu,et al.  New fast algorithms for the estimation of block motion vectors , 1993, IEEE Trans. Circuits Syst. Video Technol..

[18]  Byung Cheol Song,et al.  Multi-resolution block matching algorithm and its VLSI architecture for fast motion estimation in an MPEG-2 video encoder , 2004, IEEE Trans. Circuits Syst. Video Technol..

[19]  Oscar C. Au,et al.  Fast integer motion estimation for H.264 video coding standard , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[20]  Takao Onoye,et al.  Hierarchical Structure-Based Fast Mode Decision for H.265/HEVC , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  Lai-Man Po,et al.  A novel cross-diamond search algorithm for fast block motion estimation , 2002, IEEE Trans. Circuits Syst. Video Technol..

[22]  Jeong-Hoon Park,et al.  Block Partitioning Structure in the HEVC Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  Hyuk-Jae Lee,et al.  A survey of fast mode decision algorithms for inter-prediction and their applications to high efficiency video coding , 2012, IEEE Transactions on Consumer Electronics.

[24]  Jianjun Lei,et al.  Early MERGE Mode Decision Based on Motion Estimation and Hierarchical Depth Correlation for HEVC , 2014, IEEE Transactions on Broadcasting.

[25]  Xin Wang,et al.  Adaptive multi-pattern search algorithm for motion estimation , 2009, 2009 4th IEEE Conference on Industrial Electronics and Applications.

[26]  Kamesh Namuduri Motion estimation using spatio-temporal contextual information , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[27]  K. R. Rao,et al.  Motion Compensated Interframe Image Prediction , 1985, IEEE Trans. Commun..

[28]  Yuan-Teng Chang,et al.  A dynamic search range algorithm for H.264/AVC full-search motion estimation , 2010, 2010 IEEE Asia Pacific Conference on Circuits and Systems.

[29]  Tao Yan,et al.  View-Adaptive Motion Estimation and Disparity Estimation for Low Complexity Multiview Video Coding , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[30]  Bing Zeng,et al.  A new three-step search algorithm for block motion estimation , 1994, IEEE Trans. Circuits Syst. Video Technol..

[31]  Bin Li,et al.  An Efficient Fast Mode Decision Method for Inter Prediction in HEVC , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[32]  Kai-Kuang Ma,et al.  A new diamond search algorithm for fast block-matching motion estimation , 2000, IEEE Trans. Image Process..

[33]  Ishfaq Ahmad,et al.  A fast adaptive motion estimation algorithm , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[34]  Marko Viitanen,et al.  Efficient Mode Decision Schemes for HEVC Inter Prediction , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[35]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[36]  Yung-Lyul Lee,et al.  Early Termination of CU Encoding to Reduce HEVC Complexity , 2012, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[37]  Young Serk Shim,et al.  A fast hierarchical motion vector estimation algorithm using mean pyramid , 1995, IEEE Trans. Circuits Syst. Video Technol..

[38]  Ming-Ting Sun,et al.  Fast variable-size block motion estimation using merging procedure with an adaptive threshold , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[39]  Shen-Chuan Tai,et al.  Adaptive Double-Layered Initial Search Pattern for Fast Motion Estimation , 2006, IEEE Transactions on Multimedia.

[40]  Lap-Pui Chau,et al.  Hexagon-based search pattern for fast block motion estimation , 2002, IEEE Trans. Circuits Syst. Video Technol..

[41]  Mei-Juan Chen,et al.  Fast Motion Estimation by Motion Vector Merging Procedure for H. 264 , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[42]  Mathias Wien,et al.  Decoder-Side Motion Vector Derivation for Block-Based Video Coding , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[43]  Ronggang Wang,et al.  Context-adaptive fast motion estimation of HEVC , 2015, 2015 IEEE International Symposium on Circuits and Systems (ISCAS).

[44]  Yongdong Zhang,et al.  High Efficiency Video Coding: High Efficiency Video Coding , 2014 .

[45]  A. Navarro,et al.  Improvements to TZ search motion estimation algorithm for multiview video coding , 2012, 2012 19th International Conference on Systems, Signals and Image Processing (IWSSIP).