Style Aware Tone Expansion for HDR Displays

The vast majority of video content existing today is in Standard Dynamic Range (SDR) format and there is a strong interest in upscaling this content for upcoming High Dynamic Range (HDR) displays. Tone expansion or inverse tone mapping converts SDR content into HDR format using Expansion Operators (EO). In this paper, we show that current EO's do not perform as well when dealing with content of various lighting style aesthetics. In addition to this, we present a series of perceptual user studies evaluating user preference for lighting style in HDR content. This study shows that tone expansion of stylized content takes the form of gamma correction and we propose a method that adapts the gamma value to the style of the video. We validate our method through a subjective evaluation against state-of-the-art methods. Furthermore, our work has been oriented for 1000 nits HDR displays and we present a framework positioning our method in conformance with existing SDR standards and upcoming HDR TV standards.

[1]  Erik Reinhard,et al.  Do HDR displays support LDR content?: a psychophysical evaluation , 2007, ACM Trans. Graph..

[2]  Timo Kunkel,et al.  Image display algorithms for high‐ and low‐dynamic‐range display devices , 2007 .

[3]  Rafal Mantiuk,et al.  Display adaptive tone mapping , 2008, SIGGRAPH 2008.

[4]  Kurt Debattista,et al.  Advanced High Dynamic Range Imaging: Theory and Practice , 2011 .

[5]  Hans-Peter Seidel,et al.  Enhancement of Bright Video Features for HDR Displays , 2008 .

[6]  E. Reinhard Photographic Tone Reproduction for Digital Images , 2002 .

[7]  Wolfgang Heidrich,et al.  Color correction for tone mapping , 2009, Comput. Graph. Forum.

[8]  Kun Zhou,et al.  High dynamic range image hallucination , 2007, SIGGRAPH '07.

[9]  Francesco Banterle,et al.  Inverse tone mapping , 2006, GRAPHITE '06.

[10]  Laurence Meylan,et al.  The Reproduction of Specular Highlights on High Dynamic Range Displays , 2006, CIC.

[11]  Giuseppe Valenzise,et al.  Dynamic range expansion of video sequences: A subjective quality assessment study , 2014, 2014 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[12]  Kurt Debattista,et al.  Expanding low dynamic range videos for high dynamic range applications , 2008, SCCG.

[13]  Tania Pouli,et al.  Evaluating the Color Fidelity of ITMOs and HDR Color Appearance Models , 2015, ACM Trans. Appl. Percept..

[14]  Scott Miller,et al.  Perceptual Signal Coding for More Efficient Usage of Bit Codes , 2012 .

[15]  Diego Gutierrez,et al.  Evaluation of reverse tone mapping through varying exposure conditions , 2009, ACM Trans. Graph..

[16]  Wolfgang Heidrich,et al.  Ldr2Hdr: on-the-fly reverse tone mapping of legacy video and photographs , 2007, SIGGRAPH 2007.