Complexity scalability for real-time HEVC encoders

The high efficiency video coding (HEVC) standard achieves improved compression efficiency in comparison to previous standards at the cost of much higher computational complexity and consequently longer processing times, which may compromise real-time software-based video encoding, especially at high resolutions. This article addresses the problem of enabling complexity scalability in HEVC encoders by trading-off processing time for rate–distortion (R–D) performance in a controlled manner. The proposed method is based on dynamic constraining of HEVC coding treeblocks (CTBs) by limiting the prediction block (PB) shapes and the maximum tree depth used in each CTB, to decrease the number of R–D evaluations performed in the optimization process. The complexity-scalable encoder is capable of adjusting the processing time used in each group of pictures, according to a predefined target. The results show that processing times can be scaled down to 50 % with negligible R–D performance losses and down to 20 % at a maximum BD-PSNR decrease of 1.41 dB, which is acceptable in many applications and in power constrained devices. The simplicity of the scaling algorithm and the possibility of continuous adjustment of the scaling factor make it amenable to control real-time software-based HEVC video encoders.

[1]  Wen Gao,et al.  Reusable Architecture and Complexity-Controllable Algorithm for the Integer/Fractional Motion Estimation of H.264 , 2007, IEEE Transactions on Consumer Electronics.

[2]  Zhou Wang,et al.  Flexible Mode Selection and Complexity Allocation in High Efficiency Video Coding , 2013, IEEE Journal of Selected Topics in Signal Processing.

[3]  Gary J. Sullivan,et al.  Rate-distortion optimization for video compression , 1998, IEEE Signal Process. Mag..

[4]  Wan-Chi Siu,et al.  Computationally-scalable motion estimation algorithm for H.264/AVC video coding , 2010, IEEE Transactions on Consumer Electronics.

[5]  Xiaojin Li,et al.  A Low Power and Small Area FFT Processor for OFDM Demodulator , 2007, IEEE Transactions on Consumer Electronics.

[6]  Narciso García,et al.  Fast mode decision on H.264/AVC baseline profile for real-time performance , 2008, Journal of Real-Time Image Processing.

[7]  Jie Chen,et al.  Fast coding unit size selection for HEVC based on Bayesian decision rule , 2012, 2012 Picture Coding Symposium.

[8]  Nasser Kehtarnavaz,et al.  Fast adaptive termination mode selection for H.264 scalable video coding , 2009, Journal of Real-Time Image Processing.

[9]  Kiho Choi,et al.  Early TU decision method for fast video encoding in high efficiency video coding , 2012 .

[10]  Nasser Kehtarnavaz,et al.  A fast feature-assisted adaptive early termination approach for multiple reference frames motion estimation in H.264 , 2008, Journal of Real-Time Image Processing.

[11]  F. Bossen,et al.  Common test conditions and software reference configurations , 2010 .

[12]  Sergio Bampi,et al.  Motion Vectors Merging: Low Complexity Prediction Unit Decision Heuristic for the Inter-prediction of HEVC Encoders , 2012, 2012 IEEE International Conference on Multimedia and Expo.

[13]  David Flynn,et al.  HEVC Complexity and Implementation Analysis , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Gregory Doumenis,et al.  A real-time motion estimation FPGA architecture , 2007, Journal of Real-Time Image Processing.

[15]  Guilherme Corrêa,et al.  Coding Tree Depth Estimation for Complexity Reduction of HEVC , 2013, 2013 Data Compression Conference.

[16]  Simone Milani,et al.  Game-theoretic rate-distortion-complexity optimization for HEVC , 2013, 2013 IEEE International Conference on Image Processing.

[17]  Guilherme Corrêa,et al.  Performance and Computational Complexity Assessment of High-Efficiency Video Encoders , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Madhukar Budagavi Real-time image and video processing in portable and mobile devices , 2006, Journal of Real-Time Image Processing.

[19]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[20]  Guilherme Corrêa,et al.  Complexity control of high efficiency video encoders for power-constrained devices , 2011, IEEE Transactions on Consumer Electronics.

[21]  Shen-Chuan Tai,et al.  Speeding Up the Decisions of Quad-Tree Structures and Coding Modes for HEVC Coding Units , 2013 .

[22]  Guifen Tian,et al.  Content adaptive prediction unit size decision algorithm for HEVC intra coding , 2012, 2012 Picture Coding Symposium.