Fast HEVC CU/PU mode decision based on ANN and texture analysis

HEVC (high efficiency video coding), as the latest video coding standard, is more efficient than H.264/AVC, nevertheless it also brings in a very high computational complexity. To reduce the time of CU (coding unit) splitting or PU (prediction unit) mode deciding, a fast algorithm based on ANN (artificial neural network) and texture analysis is proposed in this paper. First, we acquire and then label the CUs of the training set with “split” and “unsplit” according to the quad-tree CU depth. Second, the texture features of “split” and “unsplit” CUs are quantified and compiled, based on which we can set the texture thresholds to judge whether or not to split the current CU or which prediction mode should be taken preliminarily. Finally, in terms of the CUs we can't judge from texture, we use ANN or the original algorithm of HM (HEVC test model) software to decide. Compared to HM15.0, the proposed algorithm can save 51.85% encoding time on average with negligible coding efficiency loss.

[1]  Jing Wang,et al.  Fast HEVC Coding Unit Decision Based On BP-Neural Network , 2015 .

[2]  Long Xu,et al.  Machine Learning-Based Coding Unit Depth Decisions for Flexible Complexity Allocation in High Efficiency Video Coding , 2015, IEEE Transactions on Image Processing.

[3]  Jeong-Hoon Park,et al.  Block Partitioning Structure in the HEVC Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Jaeho Lee,et al.  Fast PU Skip and Split Termination Algorithm for HEVC Intra Prediction , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Lu Yu,et al.  CU splitting early termination based on weighted SVM , 2013, EURASIP Journal on Image and Video Processing.

[7]  Xu Jian,et al.  Fast Mode Decision Algorithm for Intra Prediction in HEVC , 2014, 2020 IEEE 4th Information Technology, Networking, Electronic and Automation Control Conference (ITNEC).

[8]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[9]  Ping An,et al.  Fast CU size decision and mode decision algorithm for HEVC intra coding , 2013, IEEE Transactions on Consumer Electronics.

[10]  Junjie Liu,et al.  VLSI friendly fast CU/PU mode decision for HEVC intra encoding: Leveraging convolution neural network , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[11]  Antti Hallapuro,et al.  High Performance, Low Complexity Video Coding and the Emerging HEVC Standard , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Yong Gan,et al.  Fast Algorithm with Early Termination CU Split and Mode Decision , 2015 .

[13]  F. Bossen,et al.  Common test conditions and software reference configurations , 2010 .