Statistical analysis and directional coding of layer-based HDR image coding residue

Existing methods for layer-based backward compatible high dynamic range (HDR) image and video coding mostly focus on the rate-distortion optimization of base layer while neglecting the encoding of the residue signal in the enhancement layer. Although some recent studies handle residue coding by designing function based fixed global mapping curves for 8-bit conversion and exploiting standard codecs on the resulting 8-bit images, they do not take the local characteristics of residue blocks into account. Inspired by the local anisotropic characteristics of the residue signal and directional methods for motion compensated low dynamic range (LDR) video coding, in this paper we first investigate whether HDR image coding residue exhibits also local anisotropic characteristics. Specifically, we verify directional structures in residue blocks by means of auto-covariance analysis for different bitrates, spatial activities and dynamic ranges as the main variables in HDR image coding. Then, we compare the rate distortion performances of directional coding methods with the baseline residue coding methods in the literature along with different combinations of 8-bit conversion methods. The experiments indicate that content dependent 8-bit conversions and directional coding significantly outperforms the existing function based 8-bit conversions and typical coding for residue coding.

[1]  Ajay Luthra,et al.  High Dynamic Range and Wide Color Gamut Video Coding in HEVC: Status and Potential Future Enhancements , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Warnakulasuriya Anil Chandana Fernando,et al.  Adaptive residual mapping for an efficient extension layer coding in two-layer HDR video coding , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[3]  Hans-Peter Seidel,et al.  Backward compatible high dynamic range MPEG video compression , 2006, ACM Trans. Graph..

[4]  Jae S. Lim,et al.  Analysis of one-dimensional transforms in coding motion compensation prediction residuals for video applications , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[5]  Hans-Peter Seidel,et al.  Predicting visible differences in high dynamic range images: model and its calibration , 2005, IS&T/SPIE Electronic Imaging.

[6]  Shan Liu,et al.  Bit-depth scalable coding for high dynamic range video , 2008, Electronic Imaging.

[7]  Ishtiaq Rasool Khan A nonlinear quantization scheme for two-layer HDR image encoding , 2016, Signal Image Video Process..

[8]  Fatih Kamisli Transforms for prediction residuals in video coding , 2010 .

[9]  C. Andrew Segall,et al.  Scalable Coding of High Dynamic Range Video , 2007, 2007 IEEE International Conference on Image Processing.

[10]  Aline Roumy,et al.  Rate-distortion optimization of a tone mapping with SDR quality constraint for backward-compatible high dynamic range compression , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[11]  Hans-Peter Seidel,et al.  Extending quality metrics to full luminance range images , 2008, Electronic Imaging.

[12]  Frederic Dufaux,et al.  Performance evaluation of objective quality metrics for HDR image compression , 2014, Optics & Photonics - Optical Engineering + Applications.

[13]  Alfred M. Bruckstein,et al.  Motion-Compensated Coding and Frame Rate Up-Conversion: Models and Analysis , 2014, IEEE Transactions on Image Processing.

[14]  Frédéric Dufaux,et al.  Methods for improving the tone mapping for backward compatible high dynamic range image and video coding , 2014, Signal Process. Image Commun..

[15]  Jae S. Lim,et al.  1-D Transforms for the Motion Compensation Residual , 2011, IEEE Transactions on Image Processing.

[16]  Dominique Thoreau,et al.  Motion-guided quantization for video tone mapping , 2014, 2014 IEEE International Conference on Multimedia and Expo (ICME).

[17]  Rabab Kreidieh Ward,et al.  Optimizing a Tone Curve for Backward-Compatible High Dynamic Range Image and Video Compression , 2011, IEEE Transactions on Image Processing.