Two-Stage Fast Inter CU Decision for HEVC Based on Bayesian Method and Conditional Random Fields

In the latest video coding standard high efficiency video coding (HEVC), a quadtree-based coding unit (CU) partitioning scheme is adopted to better adapt to the characteristics of the video contents. However, the flexible scheme significantly increases the coding complexity, because large amount of possible CU partitioning modes should be traversed. In this paper, we propose a two-stage fast inter CU decision method to reduce the coding complexity of the HEVC encoders. In Stage I, all the CUs are classified into three categories based on the Bayesian method after the prediction unit (PU) mode <inline-formula> <tex-math notation="LaTeX">$merge\,\,2N\times 2N$ </tex-math></inline-formula> is checked. Early CU pruning and early CU skipping are then applied to two of the categories, respectively. For the remaining category which is difficult to differentiate by the rate-distortion cost of the PU mode <inline-formula> <tex-math notation="LaTeX">$merge\,\,2N\times 2N$ </tex-math></inline-formula>, an early CU pruning scheme based on conditional random fields is performed in Stage II, which takes both the local characteristics of the current CU and the coding information of its neighboring CUs into consideration. Experimental results show that our method can reduce 54.93% and 45.84% of the coding complexity on average with only 1.19% and 1.03% Bjontegaard delta bitrate increment under the random access main and the low delay P configurations, respectively.

[1]  Jin Soo Choi,et al.  Early Coding Unit–Splitting Termination Algorithm for High Efficiency Video Coding (HEVC) , 2014 .

[2]  Zhenyu Liu,et al.  CU Partition Mode Decision for HEVC Hardwired Intra Encoder Using Convolution Neural Network , 2016, IEEE Transactions on Image Processing.

[3]  Lu Yu,et al.  CU splitting early termination based on weighted SVM , 2013, EURASIP Journal on Image and Video Processing.

[4]  Zhi Liu,et al.  Adaptive Inter-Mode Decision for HEVC Jointly Utilizing Inter-Level and Spatiotemporal Correlations , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Zhiyong Gao,et al.  Neyman-Pearson-Based Early Mode Decision for HEVC Encoding , 2016, IEEE Transactions on Multimedia.

[6]  Marko Viitanen,et al.  Efficient Mode Decision Schemes for HEVC Inter Prediction , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  E. Parzen On Estimation of a Probability Density Function and Mode , 1962 .

[9]  Jie Chen,et al.  Fast coding unit size selection for HEVC based on Bayesian decision rule , 2012, 2012 Picture Coding Symposium.

[10]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[11]  J. Besag Spatial Interaction and the Statistical Analysis of Lattice Systems , 1974 .

[12]  Junjie Liu,et al.  VLSI friendly fast CU/PU mode decision for HEVC intra encoding: Leveraging convolution neural network , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[13]  Long Xu,et al.  Machine Learning-Based Coding Unit Depth Decisions for Flexible Complexity Allocation in High Efficiency Video Coding , 2015, IEEE Transactions on Image Processing.

[14]  Hongliang Li,et al.  A Fast HEVC Inter CU Selection Method Based on Pyramid Motion Divergence , 2014, IEEE Transactions on Multimedia.

[15]  Susanto Rahardja,et al.  Fast Coding Quad-Tree Decisions Using Prediction Residuals Statistics for High Efficiency Video Coding (HEVC) , 2016, IEEE Transactions on Broadcasting.

[16]  Zhan Ma,et al.  Fast Intra Mode Decision for High Efficiency Video Coding (HEVC) , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Jianjun Lei,et al.  Early MERGE Mode Decision Based on Motion Estimation and Hierarchical Depth Correlation for HEVC , 2014, IEEE Transactions on Broadcasting.

[18]  Kiho Choi,et al.  Early TU decision method for fast video encoding in high efficiency video coding , 2012 .

[19]  Takao Onoye,et al.  Hierarchical Structure-Based Fast Mode Decision for H.265/HEVC , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Xinpeng Zhang,et al.  An Effective CU Size Decision Method for HEVC Encoders , 2013, IEEE Transactions on Multimedia.

[21]  Yung-Lyul Lee,et al.  Early Termination of CU Encoding to Reduce HEVC Complexity , 2012, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[22]  Yongdong Zhang,et al.  High Efficiency Video Coding: High Efficiency Video Coding , 2014 .

[23]  Dongsheng Wang,et al.  CNN oriented fast HEVC intra CU mode decision , 2016, 2016 IEEE International Symposium on Circuits and Systems (ISCAS).

[24]  Munchurl Kim,et al.  A Novel Fast CU Encoding Scheme Based on Spatiotemporal Encoding Parameters for HEVC Inter Coding , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[26]  Zhou Wang,et al.  Flexible Mode Selection and Complexity Allocation in High Efficiency Video Coding , 2013, IEEE Journal of Selected Topics in Signal Processing.

[27]  Rae-Hong Park,et al.  Fast CU Partitioning Algorithm for HEVC Using an Online-Learning-Based Bayesian Decision Rule , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[28]  Xinpeng Zhang,et al.  Fast TU size decision algorithm for HEVC encoders using Bayesian theorem detection , 2015, Signal Process. Image Commun..

[29]  Xingming Sun,et al.  Fast Motion Estimation Based on Content Property for Low-Complexity H.265/HEVC Encoder , 2016, IEEE Transactions on Broadcasting.

[30]  NebutaFestival,et al.  Fast HEVC Encoding Decisions Using Data Mining , 2022 .

[31]  King Ngi Ngan,et al.  Fast HEVC Inter CU Decision Based on Latent SAD Estimation , 2015, IEEE Transactions on Multimedia.

[32]  T. D. Lee,et al.  Statistical Theory of Equations of State and Phase Transitions. II. Lattice Gas and Ising Model , 1952 .

[33]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .