Improved tone mapping operator for HDR coding optimizing the distortion/spatial complexity trade-off

A common paradigm to code high dynamic range (HDR) image/video content is based on tone-mapping HDR pictures to low dynamic range (LDR), in order to obtain backward compatibility and use existing coding tools, and then use inverse tone mapping at the decoder to predict the original HDR signal. Clearly, the choice of a proper tone mapping is essential in order to achieve good coding performance. The state-of-the-art to design the optimal tone mapping operator (TMO) minimizes the mean-square-error distortion between the original and the predicted HDR image. In this paper, we argue that this is suboptimal in rate-distortion sense, and we propose a more effective TMO design strategy that takes into account also the spatial complexity (which is a proxy for the bitrate) of the coded LDR image. Our results show that the proposed optimization approach enables to obtain substantial coding gain with respect to the minimum-MSE TMO.

[1]  Shan Liu,et al.  Bit-depth scalable coding for high dynamic range video , 2008, Electronic Imaging.

[2]  Rabab K. Ward,et al.  Visually Favorable Tone-Mapping With High Compression Performance in Bit-Depth Scalable Video Coding , 2013, IEEE Trans. Multim..

[3]  Wolfgang Heidrich,et al.  HDR-VDP-2: a calibrated visual metric for visibility and quality predictions in all luminance conditions , 2011, SIGGRAPH 2011.

[4]  S. Osher,et al.  Image restoration: Total variation, wavelet frames, and beyond , 2012 .

[5]  Wolfgang Heidrich,et al.  Color correction for tone mapping , 2009, Comput. Graph. Forum.

[6]  Alan C. Bovik,et al.  Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures , 2009, IEEE Signal Processing Magazine.

[7]  Patrick L. Combettes,et al.  Proximal Splitting Methods in Signal Processing , 2009, Fixed-Point Algorithms for Inverse Problems in Science and Engineering.

[8]  S. Mallat A wavelet tour of signal processing , 1998 .

[9]  Thomas Richter,et al.  On the standardization of the JPEG XT image compression , 2013, 2013 Picture Coding Symposium (PCS).

[10]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[11]  Nelly Pustelnik,et al.  Epigraphical splitting for solving constrained convex formulations of inverse problems with proximal tools , 2012, 1210.5844.

[12]  Rabab Kreidieh Ward,et al.  Optimizing a Tone Curve for Backward-Compatible High Dynamic Range Image and Video Compression , 2011, IEEE Transactions on Image Processing.

[13]  Stefan Winkler,et al.  Image complexity and spatial information , 2013, 2013 Fifth International Workshop on Quality of Multimedia Experience (QoMEX).

[14]  Hans-Peter Seidel,et al.  Perception-motivated high dynamic range video encoding , 2004, SIGGRAPH 2004.

[15]  C. Andrew Segall,et al.  Scalable Coding of High Dynamic Range Video , 2007, 2007 IEEE International Conference on Image Processing.

[16]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[17]  J. Pesquet,et al.  A Parallel Inertial Proximal Optimization Method , 2012 .