High Dynamic Range and Wide Color Gamut Video Coding in HEVC: Status and Potential Future Enhancements

As the video industry begins deployment of ultrahigh-definition TV in both professional and consumer markets, including support for higher dynamic range and wider color gamut services is considered essential within the industry. Higher dynamic range and wider color gamut offer end users a significantly enhanced viewing experience by supporting intensity ranges and colors unattainable in existing distribution ecosystems. In response to this trend, several standardization organizations have launched efforts to better enable these features in both short term and midterm. In this paper, we provide a survey of these standardization activities, with the specific goal of providing a summary of the underlying technologies. Our emphasis is on both existing and potential extensions to the High Efficiency Video Coding standard.

[1]  Karol Myszkowski,et al.  High Dynamic Range Video , 2008, Synthesis Lectures on Computer Graphics and Animation.

[2]  Mark D. Fairchild,et al.  hdr-CIELAB and hdr-IPT: Simple Models for Describing the Color of High-Dynamic-Range and Wide-Color-Gamut Images , 2010, Color Imaging Conference.

[3]  Maryann Simmons,et al.  Subband encoding of high dynamic range imagery , 2004, APGV.

[4]  Hans Hoffmann,et al.  Subjective Quality Evaluation Of High Dynamic Range Video And Display For Future TV , 2014 .

[5]  Donald P. Greenberg,et al.  Time-dependent visual adaptation for fast realistic image display , 2000, SIGGRAPH.

[6]  T. Flaxton,et al.  Production of high dynamic range video , 2013 .

[7]  André Kaup,et al.  High dynamic range video by spatially non-regular optical filtering , 2012, 2012 19th IEEE International Conference on Image Processing.

[8]  Garrett M. Johnson,et al.  Derivation of a color space for image color difference measurement , 2010 .

[9]  Scott Miller,et al.  Perceptual Signal Coding for More Efficient Usage of Bit Codes , 2012 .

[10]  D. Norren,et al.  Light adaptation of primate cones: An analysis based on extracellular data , 1983, Vision Research.

[11]  Jeroen Hubert Stessen,et al.  Deploying Wide Color Gamut and High Dynamic Range in HD and UHD , 2015 .

[12]  James A. Ferwerda,et al.  Elements of Early Vision for Computer Graphics (Tutorial) , 2001, IEEE Computer Graphics and Applications.

[13]  Rabab Kreidieh Ward,et al.  Optimizing a Tone Curve for Backward-Compatible High Dynamic Range Image and Video Compression , 2011, IEEE Transactions on Image Processing.

[14]  Luís Paulo Santos,et al.  A local model of eye adaptation for high dynamic range images , 2004, AFRIGRAPH '04.

[15]  Shree K. Nayar,et al.  Radiometric self calibration , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[16]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Erik Reinhard,et al.  High dynamic range video chains , 2014 .

[18]  Hans-Peter Seidel,et al.  Backward compatible high dynamic range MPEG video compression , 2006, SIGGRAPH 2006.

[19]  Peter G. J. Barten,et al.  Formula for the contrast sensitivity of the human eye , 2003, IS&T/SPIE Electronic Imaging.

[20]  Chul Lee,et al.  Rate-distortion optimized compression of high dynamic range videos , 2008, 2008 16th European Signal Processing Conference.

[21]  Erik Reinhard,et al.  Perception-based high dynamic range video compression with optimal bit-depth transformation , 2011, 2011 18th IEEE International Conference on Image Processing.

[22]  Feng Xiao,et al.  High Dynamic Range Imaging of Natural Scenes , 2002, CIC.

[23]  Hans-Peter Seidel,et al.  High Dynamic Range Image and Video Compression - Fidelity Matching Human Visual Performance , 2007, 2007 IEEE International Conference on Image Processing.

[24]  Tim Borer.  Non-linear Opto-Electrical Transfer Functions for High Dynamic Range Television , 2014 .

[25]  Mathias Wien,et al.  High Efficiency Video Coding: Coding Tools and Specification , 2014 .

[26]  Erik Reinhard,et al.  A reassessment of the simultaneous dynamic range of the human visual system , 2010, APGV '10.

[27]  Kwan-Jung Oh,et al.  P.26: Constant vs. Non‐constant Luminance Video Signals for UHDTV , 2013 .

[28]  Gary J. Sullivan,et al.  Comparison of the Coding Efficiency of Video Coding Standards—Including High Efficiency Video Coding (HEVC) , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[29]  Frédéric Dufaux,et al.  Optimized tone mapping with perceptually uniform luminance values for backward-compatible high dynamic range video compression , 2012, 2012 Visual Communications and Image Processing.

[30]  Herbert Thoma,et al.  An adaptive Logluv transform for High Dynamic Range video compression , 2010, 2010 IEEE International Conference on Image Processing.

[31]  Tania Pouli,et al.  Evaluation of color encodings for high dynamic range pixels , 2015, Electronic Imaging.

[32]  T. Smith,et al.  The C.I.E. colorimetric standards and their use , 1931 .

[33]  Pradeep Sen,et al.  A versatile HDR video production system , 2011, ACM Trans. Graph..

[34]  Yongdong Zhang,et al.  High Efficiency Video Coding: High Efficiency Video Coding , 2014 .

[35]  Charles Poynton,et al.  Deploying wide colour gamut and high dynamic range in HD and UHD , 2014 .