On the selection of residual formula for HDR video coding

High Dynamic Range (HDR) videos are commonly compressed using existing Low Dynamic Range (LDR) coding standards. This necessarily implies a Tone Mapping (TM) stage which aims at reducing the input video range while preserving the most significant scene details. In most cases, a residual sequence is encoded and used at the decoder side to recover the HDR content. The challenge is to efficiently encode both LDR sequences (TM and residual) without compromising the quality of the reconstructed video. Furthermore, the choice of the residual sequence can have an important impact on the HDR video coder performances. In this work, we aim to study and analyse different approaches for residual determination. The performance is discussed in terms of entropy of the residual and video coding. Objective assessments show that differential residual presents much higher efficiency than ratio residuals in terms of bandwidth saving and HDR reconstruction quality.

[1]  Hans-Peter Seidel,et al.  Modeling a Generic Tone‐mapping Operator , 2008, Comput. Graph. Forum.

[2]  Frédo Durand,et al.  Noise-optimal capture for high dynamic range photography , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Chul Lee,et al.  Rate-distortion optimized layered coding of high dynamic range videos , 2012, J. Vis. Commun. Image Represent..

[4]  I.R. Khan,et al.  A New Encoding Scheme for HDR Images , 2007, 2007 IEEE International Conference on Signal Processing and Communications.

[5]  Dominique Thoreau,et al.  Impact of temporal coherence-based Tone Mapping on video compression , 2013, 21st European Signal Processing Conference (EUSIPCO 2013).

[6]  Aljoscha Smolic,et al.  Suplemental Material for Temporally Coherent Local Tone Mapping of HDR Video , 2014 .

[7]  Hans-Peter Seidel,et al.  Backward compatible high dynamic range MPEG video compression , 2006, ACM Trans. Graph..

[8]  Edward H. Adelson,et al.  Compressing and companding high dynamic range images with subband architectures , 2005, ACM Trans. Graph..

[9]  Adrien Gruson,et al.  Temporal coherency for video tone mapping , 2012, Other Conferences.

[10]  Kimmo Roimela,et al.  Efficient high dynamic range texture compression , 2008, I3D '08.

[11]  David R. Bull,et al.  High Dynamic Range image & video compression a review , 2013, 2013 18th International Conference on Digital Signal Processing (DSP).

[12]  Masahiro Okuda,et al.  Two-layer coding algorithm for high dynamic range images based on luminance compensation , 2007, J. Vis. Commun. Image Represent..

[13]  Erik Reinhard,et al.  Real Time Automated Tone Mapping System for HDR Video , 2012, ICIP 2012.

[14]  Roberto Scopigno,et al.  BoostHDR: a novel backward-compatible method for HDR images , 2012, Other Conferences.

[15]  Sergio Goma,et al.  High Dynamic Range Image Capture with Plenoptic 2.0 Camera , 2009 .

[16]  Rabab Kreidieh Ward,et al.  Optimizing a Tone Curve for Backward-Compatible High Dynamic Range Image and Video Compression , 2011, IEEE Transactions on Image Processing.

[17]  Robert Wanat,et al.  Evaluation of Tone Mapping Operators for HDR-Video , 2013, Comput. Graph. Forum.

[18]  Wolfgang Heidrich,et al.  Video viewing preferences for HDR displays under varying ambient illumination , 2009, APGV '09.

[19]  Masahiro Okuda,et al.  Flexible and effective High Dynamic Range image coding , 2010, 2010 IEEE International Conference on Image Processing.

[20]  Masahiro Okuda,et al.  HDR video tone mapping based on gamma blending , 2010, 2010 IEEE International Conference on Image Processing.

[21]  Maryann Simmons,et al.  JPEG-HDR: a backwards-compatible, high dynamic range extension to JPEG , 2005, CIC.

[22]  Wolfgang Heidrich,et al.  High dynamic range display systems , 2004, ACM Trans. Graph..

[23]  Hans-Peter Seidel,et al.  Lossy compression of high dynamic range images and video , 2006, Electronic Imaging.

[24]  Touradj Ebrahimi,et al.  A JPEG backward-compatible HDR image compression , 2012, Other Conferences.