A Nonlocal Variational Formulation for the Improvement of Tone Mapped Images

Due to technical limitations, common display devices can only reproduce images having a low range of intensity values (dynamic range). As a consequence, the dynamic range of images encoding real world scenes, which is large, has to be compressed in order for them to be reproduced on a common display, and this technique is called tone mapping. Because there is no ground truth to compare with, evaluation of a tone mapped image has to be done by comparing with the original high dynamic range image. As standard metrics based on pixelwise comparisons are not suitable for comparing images of different dynamic range, nonlocal perceptual based metrics are commonly used. We propose a general method for optimizing tone mapped images with respect to a given nonlocal metric. In particular, if the metric is perceptual, i.e., it involves perceptual concepts, we provide an adequate minimization strategy. Experiments on a particular perceptual metric tested with different tone mapped images provided by several tone mappi...

[1]  Mahdi Nezamabadi,et al.  Color Appearance Models , 2014, J. Electronic Imaging.

[2]  Christine D. Piatko,et al.  A visibility matching tone reproduction operator for high dynamic range scenes , 1997, SIGGRAPH '97.

[3]  Alan Chalmers,et al.  Evaluation of tone mapping operators using a High Dynamic Range display , 2005, SIGGRAPH 2005.

[4]  Edoardo Provenzi,et al.  An Analysis of Visual Adaptation and Contrast Perception for Tone Mapping , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Steffen Beich,et al.  Digital Video And Hdtv Algorithms And Interfaces , 2016 .

[6]  Wolfgang Heidrich,et al.  HDR-VDP-2: a calibrated visual metric for visibility and quality predictions in all luminance conditions , 2011, ACM Trans. Graph..

[7]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[8]  Hans-Peter Seidel,et al.  A perceptual framework for contrast processing of high dynamic range images , 2006, TAP.

[9]  Marcelo Bertalmío,et al.  A Variational Method for the Optimization of Tone Mapping Operators , 2013, PSIVT.

[10]  Donald P. Greenberg,et al.  Time-dependent visual adaptation for fast realistic image display , 2000, SIGGRAPH.

[11]  Hans-Peter Seidel,et al.  Dynamic range independent image quality assessment , 2008, ACM Trans. Graph..

[12]  Rafal Mantiuk,et al.  Display adaptive tone mapping , 2008, SIGGRAPH 2008.

[13]  Karol Myszkowski,et al.  Adaptive Logarithmic Mapping For Displaying High Contrast Scenes , 2003, Comput. Graph. Forum.

[14]  Holly E. Rushmeier,et al.  Tone reproduction for realistic images , 1993, IEEE Computer Graphics and Applications.

[15]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[16]  Hans-Peter Seidel,et al.  Beyond Tone Mapping: Enhanced Depiction of Tone Mapped HDR Images , 2006, Comput. Graph. Forum.

[17]  Scott J. Daly,et al.  Visible differences predictor: an algorithm for the assessment of image fidelity , 1992, Electronic Imaging.

[18]  Michael Ashikhmin,et al.  A Tone Mapping Algorithm for High Contrast Images , 2002, Rendering Techniques.

[19]  Hans-Peter Seidel,et al.  High dynamic range imaging pipeline: perception-motivated representation of visual content , 2007, Electronic Imaging.

[20]  Hans-Peter Seidel,et al.  Perceptual evaluation of tone mapping operators with real-world scenes , 2005, IS&T/SPIE Electronic Imaging.

[21]  Mark D. Fairchild,et al.  iCAM06: A refined image appearance model for HDR image rendering , 2007, J. Vis. Commun. Image Represent..

[22]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2008, Texts in Computer Science.

[23]  Alan Chalmers,et al.  Evaluation of tone mapping operators using a High Dynamic Range display , 2005, ACM Trans. Graph..

[24]  Hans-Peter Seidel,et al.  Predicting visible differences in high dynamic range images: model and its calibration , 2005, IS&T/SPIE Electronic Imaging.

[25]  Christine D. Piatko,et al.  A Visibility Matching Tone Reproduction Operator for High Dynamic Range Scenes , 1997, IEEE Trans. Vis. Comput. Graph..

[26]  Donald P. Greenberg,et al.  A model of visual adaptation for realistic image synthesis , 1996, SIGGRAPH.

[27]  Andrew B. Watson,et al.  The cortex transform: rapid computation of simulated neural images , 1987 .

[28]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting , 2010 .

[29]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[30]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH '08.

[31]  Erik Reinhard,et al.  Ieee Transactions on Visualization and Computer Graphics 1 Dynamic Range Reduction Inspired by Photoreceptor Physiology , 2022 .