Efficient Multi-Rate Video Encoding for HEVC-Based Adaptive HTTP Streaming

Adaptive HTTP streaming requires a video to be encoded at multiple representations, that is, different qualities. Encoding these multiple representations is a computationally complex process, especially when using the recent High Efficiency Video Coding (HEVC) standard. In this paper, we consider a multi-rate HEVC encoder and identify four types of encoding information that can be reused from a high-quality reference encoding to speed up lower quality-dependent encodings. We show that the encoding decisions from the reference cannot be directly reused, as this would harm the overall rate-distortion (RD) performance. Thus, we propose methods to use the encoding information to constrain the RD optimization of the dependent encodings so that the encoding complexity is reduced while the RD performance is kept high. We additionally show that the proposed methods can be combined, leading to an efficient multi-rate encoder that exhibits high RD performance and substantial complexity reduction. Results show that the encoding time for 12 representations at different spatial resolutions and signal qualities can be reduced on average by 38%, while the average bitrate increases by less than 1%.

[1]  Eckehard G. Steinbach,et al.  Block structure reuse for multi-rate high efficiency video coding , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[2]  Jianle Chen,et al.  Overview of SHVC: Scalable Extensions of the High Efficiency Video Coding Standard , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Zhan Ma,et al.  One-Pass Mode and Motion Decision for Multilayer Quality Scalable Video Coding , 2015, IEEE Transactions on Image Processing.

[4]  David Flynn,et al.  HEVC Complexity and Implementation Analysis , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Kemal Ugur,et al.  Intra Coding of the HEVC Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Pedro Cuenca,et al.  Adaptive Fast Quadtree Level Decision Algorithm for H.264 to HEVC Video Transcoding , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  F. Bossen,et al.  Common test conditions and software reference configurations , 2010 .

[8]  Pål Halvorsen,et al.  Improved Multi-Rate Video Encoding , 2011, 2011 IEEE International Symposium on Multimedia.

[9]  Houqiang Li,et al.  $\lambda $ Domain Rate Control Algorithm for High Efficiency Video Coding , 2014, IEEE Transactions on Image Processing.

[10]  A. Navarro,et al.  Improvements to TZ search motion estimation algorithm for multiview video coding , 2012, 2012 19th International Conference on Systems, Signals and Image Processing (IWSSIP).

[11]  Eckehard G. Steinbach,et al.  Multi-rate encoding for HEVC-based adaptive HTTP streaming with multiple resolutions , 2015, 2015 IEEE 17th International Workshop on Multimedia Signal Processing (MMSP).

[12]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[13]  Rik Van de Walle,et al.  Fast simultaneous video encoder for adaptive streaming , 2015, 2015 IEEE 17th International Workshop on Multimedia Signal Processing (MMSP).

[14]  Jeong-Hoon Park,et al.  Block Partitioning Structure in the HEVC Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Jiangtao Wen,et al.  Efficient Software H.264/AVC to HEVC Transcoding on Distributed Multicore Processors , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Rik Van de Walle,et al.  Fast motion estimation for closed-loop HEVC transrating , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[17]  Thomas Stockhammer,et al.  Dynamic adaptive streaming over HTTP --: standards and design principles , 2011, MMSys.

[18]  Alberto Blanc,et al.  Optimal Selection of Adaptive Streaming Representations , 2014, ACM Trans. Multim. Comput. Commun. Appl..

[19]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Wen Gao,et al.  Rate-GOP Based Rate Control for High Efficiency Video Coding , 2013, IEEE Journal of Selected Topics in Signal Processing.

[21]  Heiko Schwarz,et al.  Overview of the Scalable Video Coding Extension of the H.264/AVC Standard , 2007, IEEE Transactions on Circuits and Systems for Video Technology.