Mixing tone mapping operators on the GPU by differential zone mapping based on psychophysical experiments

Abstract In this paper, we present a new technique for displaying High Dynamic Range (HDR) images on Low Dynamic Range (LDR) displays in an efficient way on the GPU. The described process has three stages. First, the input image is segmented into luminance zones. Second, the tone mapping operator (TMO) that performs better in each zone is automatically selected. Finally, the resulting tone mapping (TM) outputs for each zone are merged, generating the final LDR output image. To establish the TMO that performs better in each luminance zone we conducted a preliminary psychophysical experiment using a set of HDR images and six different TMOs. We validated our composite technique on several (new) HDR images and conducted a further psychophysical experiment, using an HDR display as the reference that establishes the advantages of our hybrid three-stage approach over a traditional individual TMO. Finally, we present a GPU version, which is perceptually equal to the standard version but with much improved computational performance.

[1]  Christine D. Piatko,et al.  A visibility matching tone reproduction operator for high dynamic range scenes , 1997, SIGGRAPH '97.

[2]  Paolo Cignoni,et al.  A Low‐Memory, Straightforward and Fast Bilateral Filter Through Subsampling in Spatial Domain , 2012, Comput. Graph. Forum.

[3]  Zeev Farbman,et al.  Interactive local adjustment of tonal values , 2006, ACM Trans. Graph..

[4]  Mark D. Fairchild,et al.  Meet iCAM: A Next-Generation Color Appearance Model , 2002, Color Imaging Conference.

[5]  Martin Čadík,et al.  Perception Motivated Hybrid Approach to Tone Mapping , 2007 .

[6]  Karol Myszkowski,et al.  Multidimensional image retargeting , 2011, SA '11.

[7]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[8]  Zhou Wang,et al.  Multi-scale structural similarity for image quality assessment , 2003 .

[9]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting , 2010 .

[10]  H BülthoffHeinrich,et al.  Do HDR displays support LDR content , 2007 .

[11]  Marcos Slomp,et al.  Real-time photographic local tone reproduction using summed-area tables , 2008 .

[12]  Hans-Peter Seidel,et al.  Dynamic range independent image quality assessment , 2008, ACM Transactions on Graphics.

[13]  Hans-Peter Seidel,et al.  Perceptual evaluation of tone mapping operators , 2003, SIGGRAPH '03.

[14]  H. A. David,et al.  The Method of Paired Comparisons (2nd ed.). , 1989 .

[15]  Sumanta N. Pattanaik,et al.  Segmentation and adaptive assimilation for detail-preserving display of high-dynamic range images , 2003, The Visual Computer.

[16]  Manuel M. Oliveira.  Real-Time Photographic Local Tone Reproduction Using Summed-Area Tables , 2008 .

[17]  E. S. Pearson.  Biometrika tables for statisticians , 1967 .

[18]  Donald P. Greenberg,et al.  Time-dependent visual adaptation for fast realistic image display , 2000, SIGGRAPH.

[19]  A. Gilchrist,et al.  An anchoring theory of lightness perception. , 1999 .

[20]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2008, Texts in Computer Science.

[21]  Hans-Peter Seidel,et al.  Perceptual evaluation of tone mapping operators with real-world scenes , 2005, IS&T/SPIE Electronic Imaging.

[22]  Despina Michael,et al.  A selective approach for tone mapping high dynamic range content , 2011, SA '11.

[23]  Rui Wang,et al.  Interactive time-dependent tone mapping using programmable graphics hardware , 2003, Rendering Techniques.

[24]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Kurt Debattista,et al.  Advanced High Dynamic Range Imaging: Theory and Practice , 2011 .

[26]  Zhou Wang,et al.  Objective Quality Assessment of Tone-Mapped Images , 2013, IEEE Transactions on Image Processing.

[27]  Hans-Peter Seidel,et al.  Dynamic range independent image quality assessment , 2008, ACM Trans. Graph..

[28]  H. A. David,et al.  The method of paired comparisons , 1966 .

[29]  Richard Szeliski,et al.  High dynamic range video , 2003, ACM Trans. Graph..

[30]  Dominique Thoreau,et al.  Zonal brightness coherency for video tone mapping , 2014, Signal Process. Image Commun..

[31]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[32]  Jessica K. Hodgins,et al.  Two methods for display of high contrast images , 1999, TOGS.

[33]  Hiroshi Yamaguchi,et al.  Evaluating HDR rendering algorithms , 2007, TAP.

[34]  Erik Reinhard,et al.  Do HDR displays support LDR content?: a psychophysical evaluation , 2007, ACM Trans. Graph..

[35]  Michael Wimmer,et al.  Image Attributes and Quality for Evaluation of Tone Mapping Operators , 2006 .

[36]  Erik Reinhard,et al.  Do HDR displays support LDR content?: a psychophysical evaluation , 2007, SIGGRAPH 2007.

[37]  Thomas Bashford-Rogers,et al.  Dynamic range compression by differential zone mapping based on psychophysical experiments , 2012, SAP.

[38]  Despina Michael,et al.  Selective local tone mapping , 2013, 2013 IEEE International Conference on Image Processing.

[39]  Jan Kautz,et al.  Exposure Fusion , 2007 .

[40]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[41]  Holly E. Rushmeier,et al.  Tone reproduction for realistic images , 1993, IEEE Computer Graphics and Applications.

[42]  Chi-Keung Tang,et al.  Soft Color Segmentation and Its Applications , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Michael Wimmer,et al.  Delivering Interactivity to Complex Tone Mapping Operators , 2003, Rendering Techniques.

[44]  Ahmet Oguz Akyüz,et al.  High dynamic range imaging pipeline on the GPU , 2015, Journal of Real-Time Image Processing.

[45]  Karol Myszkowski,et al.  Mapping Images to Target Devices: Spatial, Temporal, Stereo, Tone, and Color , 2012, Eurographics.

[46]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[47]  Karol Myszkowski,et al.  Adaptive Logarithmic Mapping For Displaying High Contrast Scenes , 2003, Comput. Graph. Forum.

[48]  Hans-Peter Seidel,et al.  Lightness Perception in Tone Reproduction for High Dynamic Range Images , 2005, Comput. Graph. Forum.

[49]  Alan Chalmers,et al.  Evaluation of tone mapping operators using a High Dynamic Range display , 2005, ACM Trans. Graph..

[50]  Adrien Gruson,et al.  Temporal coherency for video tone mapping , 2012, Other Conferences.

[51]  Erik Reinhard,et al.  Photographic tone reproduction for digital images , 2002, ACM Trans. Graph..