Video Tone Mapping

Abstract To display high dynamic range videos on a low dynamic range display, a tone mapping operation is needed. Tone mapping independently each frame of a video sequence leads to temporal artifacts that impair the visual quality of the resulting tone-mapped video. These temporal artifacts are classified into six categories: global flickering, local flickering, temporal noise, temporal brightness incoherency, temporal object incoherency, and hue coherency. We explain in detail the situations in which these artifacts may occur. We review existing video tone mapping operators (techniques that take into account more than a single frame) and show which artifacts are handled by these operators.

[1]  Pradeep Sen,et al.  A versatile HDR video production system , 2011, SIGGRAPH 2011.

[2]  Donald P. Greenberg,et al.  Time-dependent visual adaptation for fast realistic image display , 2000, SIGGRAPH.

[3]  Stefan Gustavson,et al.  Unified HDR reconstruction from raw CFA data , 2013, IEEE International Conference on Computational Photography (ICCP).

[4]  Richard Szeliski,et al.  High dynamic range video , 2003, ACM Trans. Graph..

[5]  Wolfgang Effelsberg,et al.  Flicker reduction in tone mapped high dynamic range video , 2011, Electronic Imaging.

[6]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[7]  Robert Wanat,et al.  Evaluation of Tone Mapping Operators for HDR-Video , 2013, Comput. Graph. Forum.

[8]  Holly E. Rushmeier,et al.  Tone reproduction for realistic images , 1993, IEEE Computer Graphics and Applications.

[9]  Steve Marschner,et al.  Perceptually based tone mapping of high dynamic range image streams , 2005, EGSR '05.

[10]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[11]  Colin Doutre,et al.  Correction of Clipped Pixels in Color Images , 2011, IEEE Transactions on Visualization and Computer Graphics.

[12]  Aggelos K. Katsaggelos,et al.  Noise reduction filters for dynamic image sequences: a review , 1995, Proc. IEEE.

[13]  Luís Paulo Santos,et al.  A local model of eye adaptation for high dynamic range images , 2004, AFRIGRAPH '04.

[14]  Karol Myszkowski,et al.  High Dynamic Range Video , 2008, Synthesis Lectures on Computer Graphics and Animation.

[15]  Frédo Durand,et al.  Interactive Tone Mapping , 2000, Rendering Techniques.

[16]  Aljoscha Smolic,et al.  Suplemental Material for Temporally Coherent Local Tone Mapping of HDR Video , 2014 .

[17]  Erik Reinhard,et al.  Real Time Automated Tone Mapping System for HDR Video , 2012, ICIP 2012.

[18]  Erik Reinhard,et al.  Photographic tone reproduction for digital images , 2002, ACM Trans. Graph..

[19]  Kurt Debattista,et al.  Advanced High Dynamic Range Imaging: Theory and Practice , 2011 .

[20]  Hiroshi Yamaguchi,et al.  Evaluating HDR rendering algorithms , 2007, TAP.

[21]  Zeev Farbman,et al.  Tonal stabilization of video , 2011, SIGGRAPH 2011.

[22]  J. H. van Hateren,et al.  Encoding of high dynamic range video with a model of human cones , 2006, TOGS.

[23]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, SIGGRAPH 2008.

[24]  Charles Hansen,et al.  Adaptive temporal tone mapping , 2004 .

[25]  James A. Ferwerda,et al.  Elements of Early Vision for Computer Graphics (Tutorial) , 2001, IEEE Computer Graphics and Applications.

[26]  Chul Lee,et al.  Gradient Domain Tone Mapping of High Dynamic Range Videos , 2007, 2007 IEEE International Conference on Image Processing.

[27]  Manuel M. Oliveira,et al.  Domain transform for edge-aware image and video processing , 2011, SIGGRAPH 2011.

[28]  Michael Wimmer,et al.  Evaluation of HDR tone mapping methods using essential perceptual attributes , 2008, Comput. Graph..

[29]  Anders Ynnerman,et al.  A unified framework for multi-sensor HDR video reconstruction , 2013, Signal Process. Image Commun..

[30]  Adrien Gruson,et al.  Temporal coherency for video tone mapping , 2012, Other Conferences.

[31]  S. S. Stevens,et al.  Brightness function: effects of adaptation. , 1963, Journal of the Optical Society of America.

[32]  Rafal Mantiuk,et al.  Display adaptive tone mapping , 2008, SIGGRAPH 2008.

[33]  Hans-Peter Seidel,et al.  Perceptual evaluation of tone mapping operators , 2003, SIGGRAPH '03.

[34]  Erik Reinhard,et al.  Color Correction for Tone Reproduction , 2013, CIC.

[35]  Dominique Thoreau,et al.  Zonal brightness coherency for video tone mapping , 2014, Signal Process. Image Commun..