Online-Learning-Based Bayesian Decision Rule for Fast Intra Mode and CU Partitioning Algorithm in HEVC Screen Content Coding

Screen content coding (SCC) is an extension of high efficiency video coding by adopting new coding modes to improve the coding efficiency of SCC at the expense of increased complexity. This paper proposes an online-learning approach for fast mode decision and coding unit (CU) size decision in SCC. To make a fast mode decision, the corner point is first extracted as a unique feature in screen content, which is an essential pre-processing step to guide Bayesian decision modeling. Second, the distinct color number in a CU is derived as another unique feature in screen content to build the precise model using online-learning for skipping unnecessary modes. Third, the correlation of the modes among spatial neighboring CUs is analyzed to further eliminate unnecessary mode candidates. Finally, the Bayesian decision rule using online-learning is applied again to make a fast CU size decision. To ensure the accuracy of the Bayesian decision models, new scene change detection is designed to update the models. Results show that the proposed algorithm achieves 36.69% encoding time reduction with 1.08% Bjøntegaard delta bitrate (BDBR) increment under all intra configuration. By integrating into the existing fast SCC approach, the proposed algorithm reduces 48.83% encoding time with a 1.78% increase in BDBR.

[1]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[2]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Hao Yang,et al.  An efficient intra coding algorithm based on statistical learning for screen content coding , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[4]  Mengmeng Zhang,et al.  An adaptive fast intra mode decision in HEVC , 2012, 2012 19th IEEE International Conference on Image Processing.

[5]  Wan-Chi Siu,et al.  Fast CU partition strategy for HEVC intra-frame coding using learning approach via random forests , 2015, 2015 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA).

[6]  Yui-Lam Chan,et al.  Quadtree decision for depth intra coding in 3D-HEVC by good feature , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[7]  Jizheng Xu,et al.  Overview of the Emerging HEVC Screen Content Coding Extension , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Zhan Ma,et al.  Fast intra mode decision and block matching for HEVC screen content compression , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[9]  Zhan Ma,et al.  Fast CU partition decision using machine learning for screen content compression , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[10]  Shan Liu,et al.  Intra Block Copy in HEVC Screen Content Coding Extensions , 2016, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[11]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Mengmeng Zhang,et al.  Fast intra partition algorithm for HEVC screen content coding , 2014, 2014 IEEE Visual Communications and Image Processing Conference.

[13]  Zhan Ma,et al.  Fast Mode and Partition Decision Using Machine Learning for Intra-Frame Coding in HEVC Screen Content Coding Extension , 2016, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[14]  Yui-Lam Chan,et al.  Fast and efficient intra coding techniques for smooth regions in screen content coding based on boundary prediction samples , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[15]  Do-Kyoung Kwon,et al.  Fast intra block copy (IntraBC) search for HEVC screen content coding , 2014, 2014 IEEE International Symposium on Circuits and Systems (ISCAS).

[16]  Yui-Lam Chan,et al.  Hash based fast local search for Intra Block Copy (IntraBC) mode in HEVC screen content coding , 2015, 2015 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA).

[17]  Jie Chen,et al.  Fast coding unit size selection for HEVC based on Bayesian decision rule , 2012, 2012 Picture Coding Symposium.

[18]  Vijay Bansal,et al.  Fast intra mode decision for HEVC video encoder , 2012, SoftCOM 2012, 20th International Conference on Software, Telecommunications and Computer Networks.

[19]  Rae-Hong Park,et al.  Fast CU Partitioning Algorithm for HEVC Using an Online-Learning-Based Bayesian Decision Rule , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Long Xu,et al.  Machine Learning-Based Coding Unit Depth Decisions for Flexible Complexity Allocation in High Efficiency Video Coding , 2015, IEEE Transactions on Image Processing.

[21]  Zhi Liu,et al.  Effective CU Size Decision for HEVC Intracoding , 2014, IEEE Transactions on Image Processing.

[22]  Antti Hallapuro,et al.  Comparative Rate-Distortion-Complexity Analysis of HEVC and AVC Video Codecs , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  Wen Gao,et al.  A fast intra coding algorithm for HEVC , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[24]  Jianjun Lei,et al.  Fast Intra Prediction Based on Content Property Analysis for Low Complexity HEVC-Based Screen Content Coding , 2017, IEEE Transactions on Broadcasting.

[25]  Jungwoo Lee,et al.  Temporally adaptive motion interpolation exploiting temporal masking in visual perception , 1994, IEEE Trans. Image Process..

[26]  Gangyi Jiang,et al.  Efficient CU and PU Decision Based on Neural Network and Gray Level Co-Occurrence Matrix for Intra Prediction of Screen Content Coding , 2018, IEEE Access.

[27]  Yui-Lam Chan,et al.  Fast HEVC screen content coding by skipping unnecessary checking of intra block copy mode based on CU activity and gradient , 2016, 2016 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA).

[28]  Jaeho Lee,et al.  Fast PU Skip and Split Termination Algorithm for HEVC Intra Prediction , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[29]  Marta Karczewicz,et al.  Palette-Based Coding in the Screen Content Coding Extension of the HEVC Standard , 2015, 2015 Data Compression Conference.