Evaluation of Tone Mapping Operators for HDR-Video

Eleven tone-mapping operators intended for video processing are analyzed and evaluated with camera-captured and computer-generated high-dynamic-range content. After optimizing the parameters of the operators in a formal experiment, we inspect and rate the artifacts (flickering, ghosting, temporal color consistency) and color rendition problems (brightness, contrast and color saturation) they produce. This allows us to identify major problems and challenges that video tone-mapping needs to address. Then, we compare the tone-mapping results in a pair-wise comparison experiment to identify the operators that, on average, can be expected to perform better than the others and to assess the magnitude of differences between the best performing operators.

[1]  Erik Reinhard,et al.  Calibrated image appearance reproduction , 2012, ACM Trans. Graph..

[2]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH '08.

[3]  Rafal Mantiuk,et al.  Assessment of video tone-mapping: Are cameras' S-shaped tone-curves good enough? , 2013, J. Vis. Commun. Image Represent..

[4]  Donald P. Greenberg,et al.  A model of visual adaptation for realistic image synthesis , 1996, SIGGRAPH.

[5]  Erik Reinhard,et al.  Photographic tone reproduction for digital images , 2002, ACM Trans. Graph..

[6]  Xuemei Zhang,et al.  Perceptual image quality: Effects of tone characteristics , 2005, J. Electronic Imaging.

[7]  Stefan Gustavson,et al.  High-dynamic-range video for photometric measurement of illumination , 2007, Electronic Imaging.

[8]  Greg Ward,et al.  A Contrast-Based Scalefactor for Luminance Display , 1994, Graphics Gems.

[9]  Patrick Le Callet,et al.  Spatio-temporal Tone Mapping Operator Based on a Retina Model , 2009, CCIW.

[10]  Pradeep Sen,et al.  A versatile HDR video production system , 2011, SIGGRAPH 2011.

[11]  Donald P. Greenberg,et al.  Time-dependent visual adaptation for fast realistic image display , 2000, SIGGRAPH.

[12]  Robert Wanat,et al.  Evaluation of Tone Mapping Operators for HDR‐Video , 2013, SIGGRAPH '13.

[13]  L. McMillan,et al.  Video enhancement using per-pixel virtual exposures , 2005, SIGGRAPH 2005.

[14]  Rafal Mantiuk,et al.  Comparison of Four Subjective Methods for Image Quality Assessment , 2012, Comput. Graph. Forum.

[15]  Rafal Mantiuk,et al.  Display adaptive tone mapping , 2008, SIGGRAPH 2008.

[16]  Hans-Peter Seidel,et al.  Perceptual evaluation of tone mapping operators with real-world scenes , 2005, IS&T/SPIE Electronic Imaging.

[17]  M. J. D. Powell,et al.  An efficient method for finding the minimum of a function of several variables without calculating derivatives , 1964, Comput. J..

[18]  Stephen Wolf,et al.  Video Quality Measurement Techniques , 2002 .

[19]  Andrew C. Gallagher.  The Art and Science of HDR Imaging , 2012, J. Electronic Imaging.

[20]  Hiroshi Yamaguchi,et al.  Evaluating HDR rendering algorithms , 2007, TAP.

[21]  Hiroshi Yamaguchi,et al.  Testing HDR Image Rendering Algorithms , 2004, CIC.

[22]  Mark D. Fairchild,et al.  Evaluation of HDR tone‐mapping algorithms using a high‐dynamic‐range display to emulate real scenes , 2007, CIC.

[23]  Michael Wimmer,et al.  Evaluation of HDR tone mapping methods using essential perceptual attributes , 2008, Comput. Graph..

[24]  Robert W. G. Hunt,et al.  The reproduction of colour , 1957 .

[25]  Erik Reinhard,et al.  Do HDR displays support LDR content?: a psychophysical evaluation , 2007, SIGGRAPH 2007.

[26]  Wolfgang Heidrich,et al.  HDR-VDP-2: a calibrated visual metric for visibility and quality predictions in all luminance conditions , 2011, SIGGRAPH 2011.

[27]  J. H. van Hateren,et al.  Encoding of high dynamic range video with a model of human cones , 2006, TOGS.

[28]  Michael Ashikhmin,et al.  A reality check for tone-mapping operators , 2006, TAP.

[29]  Stefan Gustavson,et al.  Unified HDR reconstruction from raw CFA data , 2013, IEEE International Conference on Computational Photography (ICCP).

[30]  Alan Chalmers,et al.  Evaluation of tone mapping operators using a High Dynamic Range display , 2005, SIGGRAPH 2005.

[31]  Harald Brendel,et al.  Creating cinematic wide gamut HDR-video for the evaluation of tone mapping operators and HDR-displays , 2014, Electronic Imaging.

[32]  Adrien Gruson,et al.  Temporal coherency for video tone mapping , 2012, Other Conferences.

[33]  D. Amnon Silverstein,et al.  Efficient method for paired comparison , 2001, J. Electronic Imaging.

[34]  Hans-Peter Seidel,et al.  Analysis of Reproducing Real‐World Appearance on Displays of Varying Dynamic Range , 2006, Comput. Graph. Forum.

[35]  H. Seidel,et al.  Perceptual Evaluation of Tone Mapping Operators with Regard to Similarity and Preference , 2002 .

[36]  Christine D. Piatko,et al.  A visibility matching tone reproduction operator for high dynamic range scenes , 1997 .

[37]  Erik Reinhard,et al.  Perceptual evaluation of tone-reproduction operators using the Cornsweet--Craik--O'Brien illusion , 2008, TAP.

[38]  Zhou Wang,et al.  Objective Quality Assessment of Tone-Mapped Images , 2013, IEEE Transactions on Image Processing.

[39]  Céline Villa,et al.  Psychovisual Assessment of Tone-Mapping Operators for Global Appearance and Colour Reproduction , 2010, CGIV/MCS.

[40]  Luís Paulo Santos,et al.  A local model of eye adaptation for high dynamic range images , 2004, AFRIGRAPH '04.

[41]  James V. Stone.  Vision and Brain: How We Perceive the World , 2012 .

[42]  Steve Marschner,et al.  Perceptually based tone mapping of high dynamic range image streams , 2005, EGSR '05.

[43]  Sung-Ho Park,et al.  Evaluating tone mapping algorithms for rendering non-pictorial (scientific) high-dynamic-range images , 2007, J. Vis. Commun. Image Represent..

[44]  Robert Wanat,et al.  Perceptually based parameter adjustments for video processing operations , 2014, SIGGRAPH '14.