Simultaneous encoder for high-dynamic-range and low-dynamic-range video

High-dynamic-range (HDR) technology is an emerging video technology that allows displays to produce a higher range of luminance to better approximate the range of brightness perceived by the human eye. However, during the transition to this new technology, not all consumer devices will support the full range of luminance values offered by HDR. In order to also support these devices with lower dynamic ranges, content providers have to supply multiple dynamic range versions to provide the best experience to all viewers. This means that the processing cost to compress these versions will be multiplied by the number of versions. As a solution, this paper proposes a simultaneous encoder based on high efficiency video coding. This encoder reuses parts of the coding information generated during compression of an HDR video to accelerate the encoding of a low-dynamicrange (LDR) version of the same video. The proposed method speeds up the encoder 299 times with a bit rate increase of 12.4% compared to a non-accelerated encode of the LDR version. This is more than 90 times faster compared to stateof- the-art fast encoding algorithms and allows simultaneous encoding of the two versions for approximately the computational cost of a single encoder.

[1]  Pål Halvorsen,et al.  Improved Multi-Rate Video Encoding , 2011, 2011 IEEE International Symposium on Multimedia.

[2]  Antonio Jesús Díaz-Honrubia,et al.  A Motion Vector Re-Use Algorithm for H.264/AVC and HEVC Simultaneous Video Encoding , 2015, MoMM.

[3]  Rae-Hong Park,et al.  Fast CU Partitioning Algorithm for HEVC Using an Online-Learning-Based Bayesian Decision Rule , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[5]  Hyuk-Jae Lee,et al.  A survey of fast mode decision algorithms for inter-prediction and their applications to high efficiency video coding , 2012, IEEE Transactions on Consumer Electronics.

[6]  R. Rifkin,et al.  Notes on Regularized Least Squares , 2007 .

[7]  Ping An,et al.  Fast CU size decision and mode decision algorithm for HEVC intra coding , 2013, IEEE Transactions on Consumer Electronics.

[8]  Xinpeng Zhang,et al.  An Effective CU Size Decision Method for HEVC Encoders , 2013, IEEE Transactions on Multimedia.

[9]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Rae-Hong Park,et al.  Noise reduction and adaptive contrast enhancement for local tone mapping , 2012, IEEE Transactions on Consumer Electronics.

[11]  Zhan Ma,et al.  Fast Intra Mode Decision for High Efficiency Video Coding (HEVC) , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Michael J. Burke,et al.  Averaging Correlations: Expected Values and Bias in Combined Pearson rs and Fisher's z Transformations , 1998 .

[13]  Fernando Díaz-de-María,et al.  Complexity Control Based on a Fast Coding Unit Decision Method in the HEVC Video Coding Standard , 2016, IEEE Transactions on Multimedia.

[14]  Rae-Hong Park,et al.  Tone mapping using color correction function and image decomposition in high dynamic range imaging , 2010, IEEE Transactions on Consumer Electronics.

[15]  Panos Nasiopoulos,et al.  Demystifying High-Dynamic-Range Technology: A new evolution in digital media. , 2015, IEEE Consumer Electronics Magazine.

[16]  Munchurl Kim,et al.  A Novel Fast CU Encoding Scheme Based on Spatiotemporal Encoding Parameters for HEVC Inter Coding , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Rae-Hong Park,et al.  Local tone mapping using K-means algorithm and automatic gamma setting , 2011, 2011 IEEE International Conference on Consumer Electronics (ICCE).

[18]  Eckehard G. Steinbach,et al.  Block structure reuse for multi-rate high efficiency video coding , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[19]  Guilherme Corrêa,et al.  Complexity control of high efficiency video encoders for power-constrained devices , 2011, IEEE Transactions on Consumer Electronics.

[20]  Rik Van de Walle,et al.  Fast simultaneous video encoder for adaptive streaming , 2015, 2015 IEEE 17th International Workshop on Multimedia Signal Processing (MMSP).

[21]  Pedro Cuenca,et al.  Adaptive Fast Quadtree Level Decision Algorithm for H.264 to HEVC Video Transcoding , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  Gwanggil Jeon,et al.  Piecewise tone reproduction for high dynamic range imaging , 2009, IEEE Transactions on Consumer Electronics.

[23]  Kiho Choi,et al.  Early TU decision method for fast video encoding in high efficiency video coding , 2012 .

[24]  Eckehard G. Steinbach,et al.  Multi-rate encoding for HEVC-based adaptive HTTP streaming with multiple resolutions , 2015, 2015 IEEE 17th International Workshop on Multimedia Signal Processing (MMSP).

[25]  Jaeho Lee,et al.  A Fast CU Size Decision Algorithm for HEVC , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[26]  Jaeseok Kim,et al.  Natural hdr image tone mapping based on retinex , 2011, IEEE Transactions on Consumer Electronics.

[27]  CTU splitting algorithm for H.264/AVC and HEVC simultaneous encoding , 2016, The Journal of Supercomputing.

[28]  NebutaFestival,et al.  Fast HEVC Encoding Decisions Using Data Mining , 2022 .

[29]  Pål Halvorsen,et al.  Reducing Processing Demands for Multi-Rate Video Encoding: Implementation and Evaluation , 2012, Int. J. Multim. Data Eng. Manag..

[30]  Rik Van de Walle,et al.  Performance analysis of machine learning for arbitrary downsizing of pre-encoded HEVC video , 2015, IEEE Transactions on Consumer Electronics.

[31]  Byeungwoo Jeon,et al.  Early Skip Mode Decision for HEVC Encoder With Emphasis on Coding Quality , 2015, IEEE Transactions on Broadcasting.

[32]  Yongdong Zhang,et al.  High Efficiency Video Coding: High Efficiency Video Coding , 2014 .