High Dynamic Range image & video compression a review

High Dynamic Range (HDR) imaging technologies can provide high levels of immersion through a dynamic range that meets and even exceeds the instantaneous range of the Human Visual System (HVS). This increase in the level of immersion comes at the cost of significantly higher bit-rate requirements compared to those associated with conventional imaging technologies. As a result, efficient HDR-relevant coding solutions have to be developed. In this paper, we present a review of existing HDR image and video coding methods, thus establishing the current state of the art. We additionally present some of our own recent results in this area.

[1]  Wolfgang Heidrich,et al.  HDR-VDP-2: a calibrated visual metric for visibility and quality predictions in all luminance conditions , 2011, ACM Trans. Graph..

[2]  K. Mullen.  The contrast sensitivity of human colour vision to red‐green and blue‐yellow chromatic gratings. , 1985, The Journal of physiology.

[3]  Gregory Ward Larson,et al.  LogLuv Encoding for Full-Gamut, High-Dynamic Range Images , 1998, J. Graphics, GPU, & Game Tools.

[4]  Geoff Wyvill,et al.  Synthesis Lectures on Computer Graphics and Animation , 2008 .

[5]  Hans-Peter Seidel,et al.  Extending quality metrics to full luminance range images , 2008, Electronic Imaging.

[6]  Hans-Peter Seidel,et al.  Perception-motivated high dynamic range video encoding , 2004, SIGGRAPH 2004.

[7]  Frédéric Dufaux,et al.  Optimized tone mapping with perceptually uniform luminance values for backward-compatible high dynamic range video compression , 2012, 2012 Visual Communications and Image Processing.

[8]  Zeev Farbman,et al.  Interactive local adjustment of tonal values , 2006, ACM Trans. Graph..

[9]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH '08.

[10]  F. Kainz,et al.  The OpenEXR image file format , 2004 .

[11]  Bernd Girod,et al.  Psychovisual aspects of image communication , 1992, Signal Process..

[12]  Peter G. J. Barten,et al.  Contrast sensitivity of the human eye and its e ects on image quality , 1999 .

[13]  Hans-Peter Seidel,et al.  Backward compatible high dynamic range MPEG video compression , 2006, ACM Trans. Graph..

[14]  Robert Wanat,et al.  Physical and Perceptual Limitations of a Projector-based High Dynamic Range Display , 2012, TPCG.

[15]  Edward H. Adelson,et al.  Compressing and companding high dynamic range images with subband architectures , 2005, ACM Trans. Graph..

[16]  Rafal Mantiuk,et al.  Display adaptive tone mapping , 2008, ACM Trans. Graph..

[17]  Hans-Peter Seidel,et al.  Video quality assessment for computer graphics applications , 2010, SIGGRAPH 2010.

[18]  Gregory J. Ward,et al.  The RADIANCE lighting simulation and rendering system , 1994, SIGGRAPH.

[19]  Pradeep Sen,et al.  A versatile HDR video production system , 2011, ACM Trans. Graph..

[20]  Ashraf A. Kassim,et al.  Digital Video Image Quality and Perceptual Coding , 2005, J. Electronic Imaging.

[21]  Ben J Hicks,et al.  SPIE - The International Society for Optical Engineering , 2001 .

[22]  Maryann Simmons,et al.  Subband encoding of high dynamic range imagery , 2004, APGV '04.

[23]  Erik Reinhard,et al.  Image and video compression for HDR content , 2012, Other Conferences.

[24]  Day-Fann Shen,et al.  Measurements of JND property of HVS and its applications to image segmentation, coding, and requantization , 1996, Other Conferences.

[25]  Jill M. Boyce,et al.  Weighted prediction in the H.264/MPEG AVC video coding standard , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).

[26]  Wolfgang Heidrich,et al.  High dynamic range display systems , 2004, ACM Trans. Graph..

[27]  Kevin E. Spaulding,et al.  Using a Residual Image to Extend the Color Gamut and Dynamic Range of an sRGB Image , 2003, PICS.

[28]  Erik Reinhard,et al.  Perceptually lossless High Dynamic Range image compression with JPEG 2000 , 2012, 2012 19th IEEE International Conference on Image Processing.

[29]  Hans-Peter Seidel,et al.  Dynamic range independent image quality assessment , 2008, ACM Transactions on Graphics.

[30]  Scott J. Daly,et al.  Visible differences predictor: an algorithm for the assessment of image fidelity , 1992, Electronic Imaging.

[31]  Bernd Girod,et al.  What's wrong with mean-squared error? , 1993 .

[32]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting , 2010 .

[33]  Greg Turk,et al.  LCIS: a boundary hierarchy for detail-preserving contrast reduction , 1999, SIGGRAPH.

[34]  Hans-Peter Seidel,et al.  Predicting visible differences in high dynamic range images: model and its calibration , 2005, IS&T/SPIE Electronic Imaging.

[35]  Herbert Thoma,et al.  Temporally coherent luminance-to-luma mapping for high dynamic range video coding with H.264/AVC , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[36]  Rabab Kreidieh Ward,et al.  Optimizing a Tone Curve for Backward-Compatible High Dynamic Range Image and Video Compression , 2011, IEEE Transactions on Image Processing.

[37]  Baining Guo,et al.  Pocket reflectometry , 2011, SIGGRAPH 2011.

[38]  Touradj Ebrahimi,et al.  A JPEG backward-compatible HDR image compression , 2012, Other Conferences.

[39]  Herbert Thoma,et al.  An adaptive Logluv transform for High Dynamic Range video compression , 2010, 2010 IEEE International Conference on Image Processing.

[40]  Hans-Peter Seidel,et al.  Dynamic range independent image quality assessment , 2008, ACM Trans. Graph..

[41]  David J. Sakrison,et al.  The effects of a visual fidelity criterion of the encoding of images , 1974, IEEE Trans. Inf. Theory.

[42]  Erik Reinhard,et al.  Real Time Automated Tone Mapping System for HDR Video , 2012, ICIP 2012.

[43]  Erik Reinhard,et al.  Ieee Transactions on Visualization and Computer Graphics 1 Dynamic Range Reduction Inspired by Photoreceptor Physiology , 2022 .

[44]  Erik Reinhard,et al.  Photographic tone reproduction for digital images , 2002, ACM Trans. Graph..

[45]  Charles E. Hughes,et al.  High-dynamic-range still-image encoding in JPEG 2000 , 2005, IEEE Computer Graphics and Applications.

[46]  Erik Reinhard,et al.  Perception-based high dynamic range video compression with optimal bit-depth transformation , 2011, 2011 18th IEEE International Conference on Image Processing.

[47]  Frederic Dufaux,et al.  A comparative survey on high dynamic range video compression , 2012, Other Conferences.