Fine-grain complexity control of HEVC intra prediction in battery-powered video codecs

The high-efficiency video coding (HEVC) standard improves the coding efficiency at the cost of a significantly more complex encoding process. This is an issue for a large number of video-capable devices that operate on batteries, with limited and varying processing power. A complexity controller enables an encoder to provide the best possible quality at any power quota. This paper proposes a complexity control method for HEVC intra coding, based on a Pareto-efficient rate–distortion–complexity (R–D–C) analysis. The proposed method limits the intra prediction for each block (as opposed to existing methods which limit the block partitioning), on a frame-level basis. This method consists of three steps, namely rate-complexity modeling, complexity allocation, and configuration selection. In the first step, a rate-complexity model is presented which estimates the encoding complexity according to the compression intensity. Then, according to the estimated complexity and target complexity, a complexity budget is allocated to each frame. Finally, an encoding configuration from a set of Pareto-efficient configurations is selected according to the allocated complexity and the video content, which offers the best compression performance. Experimental results indicate that the proposed method can adjust the complexity from 100 to 50%, with a mean error rate of less than 0.1%. The proposed method outperforms many state-of-the-art approaches, in terms of both control accuracy and compression efficiency. The encoding performance loss in terms of BD-rate varies from 0.06 to 3.69%, on average, for 90–60% computational complexity, respectively. The method can also be used for lower than 50% complexity if need be, with a higher BD-rate.

[1]  L. Yang,et al.  An Adaptive CU Size Decision Algorithm for HEVC Intra Prediction Based on Complexity Classification Using Machine Learning , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Chao Lu,et al.  High-Performance Algorithm Adaptations and Hardware Architecture for HEVC Intra Encoders , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  José Luis Martínez,et al.  Time and energy modeling of an INTRA-ONLY HEVC encoder , 2015, 2015 Visual Communications and Image Processing (VCIP).

[4]  Guilherme Corrêa,et al.  Adaptive coding tree for complexity control of high efficiency video encoders , 2012, 2012 Picture Coding Symposium.

[5]  William Fornaciari,et al.  All-Digital Control-Theoretic Scheme to Optimize Energy Budget and Allocation in Multi-Cores , 2020, IEEE Transactions on Computers.

[6]  Gangyi Jiang,et al.  Effective Data Driven Coding Unit Size Decision Approaches for HEVC INTRA Coding , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Sam Kwong,et al.  CTU-Level Complexity Control for High Efficiency Video Coding , 2018, IEEE Transactions on Multimedia.

[8]  Guilherme Corrêa,et al.  Performance and Computational Complexity Assessment of High-Efficiency Video Encoders , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Jarno Vanne,et al.  Dynamic Resource Allocation for HEVC Encoding in FPGA-Accelerated SDN Cloud , 2019, 2019 IEEE Nordic Circuits and Systems Conference (NORCAS): NORCHIP and International Symposium of System-on-Chip (SoC).

[10]  Chong-Min Kyung,et al.  Power-rate-distortion modeling for energy minimization of portable video encoding devices , 2011, 2011 IEEE 54th International Midwest Symposium on Circuits and Systems (MWSCAS).

[11]  Chen Li,et al.  Hierarchical Complexity Control of HEVC for Live Video Encoding , 2016, IEEE Access.

[12]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Fernando Díaz-de-María,et al.  Complexity Control Based on a Fast Coding Unit Decision Method in the HEVC Video Coding Standard , 2016, IEEE Transactions on Multimedia.

[14]  Muhammad Usman Karim Khan,et al.  Power-Efficient Workload Balancing for Video Applications , 2016, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[15]  Guilherme Corrêa,et al.  Encoding time control system for HEVC based on Rate-Distortion-Complexity analysis , 2015, 2015 IEEE International Symposium on Circuits and Systems (ISCAS).

[16]  Ping An,et al.  Fast CU size decision and mode decision algorithm for HEVC intra coding , 2013, IEEE Transactions on Consumer Electronics.

[17]  Guilherme Corrêa,et al.  Pareto-Based Method for High Efficiency Video Coding With Limited Encoding Time , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Mahmoud Reza Hashemi,et al.  A computationally scalable fast intra coding scheme for HEVC video encoder , 2018, Multimedia Tools and Applications.

[19]  Il-hong Shin,et al.  Adaptive Intra-Frame Assignment and Bit-Rate Estimation for Variable GOP Length in H.264 , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Ilker Hamzaoglu,et al.  A computation and energy reduction technique for HEVC intra prediction , 2017, IEEE Transactions on Consumer Electronics.

[21]  Guilherme Corrêa,et al.  Complexity control of high efficiency video encoders for power-constrained devices , 2011, IEEE Transactions on Consumer Electronics.

[22]  S. Glantz,et al.  Primer of Applied Regression & Analysis of Variance , 1990 .

[23]  Mahmoud Reza Hashemi,et al.  Fast and efficient intra mode decision for HEVC, based on dual-tree complex wavelet , 2016, Multimedia Tools and Applications.

[24]  S. Glantz Primer of applied regression and analysis of variance / Stanton A. Glantz, Bryan K. Slinker , 1990 .

[25]  Long Xu,et al.  Low-Complexity Encoder Framework for Window-Level Rate Control Optimization , 2013, IEEE Transactions on Industrial Electronics.

[26]  Chin-Feng Lai,et al.  An Adaptive Mode Decision Algorithm Based on Video Texture Characteristics for HEVC Intra Prediction , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[27]  Guilherme Corrêa,et al.  Complexity scalability for real-time HEVC encoders , 2013, Journal of Real-Time Image Processing.

[28]  Zulin Wang,et al.  Reducing Complexity of HEVC: A Deep Learning Approach , 2017, IEEE Transactions on Image Processing.

[29]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[30]  F. Bossen,et al.  Common test conditions and software reference configurations , 2010 .

[31]  Ilker Hamzaoglu,et al.  A low energy intra prediction hardware for high efficiency video coding , 2014, Journal of Real-Time Image Processing.

[32]  Ilker Hamzaoglu,et al.  A computation and energy reduction technique for HEVC intra mode decision , 2014, IEEE Transactions on Consumer Electronics.

[33]  Jianjun Lei,et al.  Fast Intra Prediction Based on Content Property Analysis for Low Complexity HEVC-Based Screen Content Coding , 2017, IEEE Transactions on Broadcasting.

[34]  Xiaoyan Sun,et al.  Subjective-Driven Complexity Control Approach for HEVC , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[35]  Jia Zhang,et al.  Complexity Control in the HEVC Intracoding for Industrial Video Applications , 2019, IEEE Transactions on Industrial Informatics.

[36]  Sergio Bampi,et al.  Complexity control of HEVC encoders targeting real-time constraints , 2017, Journal of Real-Time Image Processing.

[37]  Ilker Hamzaoglu,et al.  Reconfigurable intra prediction hardware for future video coding , 2017, IEEE Transactions on Consumer Electronics.

[38]  Yong-Jo Ahn,et al.  A context-adaptive fast intra coding algorithm of high-efficiency video coding (HEVC) , 2016, Journal of Real-Time Image Processing.

[39]  Stéphane Coulombe,et al.  Fast HEVC Intra Mode Decision Based on RDO Cost Prediction , 2019, IEEE Transactions on Broadcasting.