A Hybrid l1-l0 Layer Decomposition Model for Tone Mapping

Tone mapping aims to reproduce a standard dynamic range image from a high dynamic range image with visual information preserved. State-of-the-art tone mapping algorithms mostly decompose an image into a base layer and a detail layer, and process them accordingly. These methods may have problems of halo artifacts and over-enhancement, due to the lack of proper priors imposed on the two layers. In this paper, we propose a hybrid l1-l0 decomposition model to address these problems. Specifically, an l1 sparsity term is imposed on the base layer to model its piecewise smoothness property. An l0 sparsity term is imposed on the detail layer as a structural prior, which leads to piecewise constant effect. We further propose a multiscale tone mapping scheme based on our layer decomposition model. Experiments show that our tone mapping algorithm achieves visually compelling results with little halo artifacts, outperforming the state-of-the-art tone mapping algorithms in both subjective and objective evaluations.

[1]  R. Arnheim Art And Visual Perception , 1954 .

[2]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[3]  Holly E. Rushmeier,et al.  Tone reproduction for realistic images , 1993, IEEE Computer Graphics and Applications.

[4]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH.

[5]  Michael Elad,et al.  On the origin of the bilateral filter and ways to improve it , 2002, IEEE Trans. Image Process..

[6]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[7]  E. Reinhard Photographic Tone Reproduction for Digital Images , 2002 .

[8]  Nicolai Petkov,et al.  Contour and boundary detection improved by surround suppression of texture edges , 2004, Image Vis. Comput..

[9]  Michael Elad,et al.  A Variational Framework for Retinex , 2002, IS&T/SPIE Electronic Imaging.

[10]  Erik Reinhard,et al.  Ieee Transactions on Visualization and Computer Graphics 1 Dynamic Range Reduction Inspired by Photoreceptor Physiology , 2022 .

[11]  Edward H. Adelson,et al.  Compressing and companding high dynamic range images with subband architectures , 2005, SIGGRAPH 2005.

[12]  Laurence Meylan,et al.  High dynamic range image rendering with a retinex-based adaptive filter , 2006, IEEE Transactions on Image Processing.

[13]  Frédo Durand,et al.  A Fast Approximation of the Bilateral Filter Using a Signal Processing Approach , 2006, ECCV.

[14]  Neil Barakat,et al.  Minimal-Bracketing Sets for High-Dynamic-Range Image Capture , 2008, IEEE Transactions on Image Processing.

[15]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, SIGGRAPH 2008.

[16]  Michael S. Brown,et al.  Globally Optimized Linear Windowed Tone Mapping , 2010, IEEE Transactions on Visualization and Computer Graphics.

[17]  Cewu Lu,et al.  Image smoothing via L0 gradient minimization , 2011, ACM Trans. Graph..

[18]  Rabab Kreidieh Ward,et al.  Optimizing a Tone Curve for Backward-Compatible High Dynamic Range Image and Video Compression , 2011, IEEE Transactions on Image Processing.

[19]  Michael K. Ng,et al.  A Total Variation Model for Retinex , 2011, SIAM J. Imaging Sci..

[20]  Edoardo Provenzi,et al.  An Analysis of Visual Adaptation and Contrast Perception for Tone Mapping , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[22]  S. Osher,et al.  A TV Bregman iterative model of Retinex theory , 2012 .

[23]  Cewu Lu,et al.  Online Robust Dictionary Learning , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Zhou Wang,et al.  Objective Quality Assessment of Tone-Mapped Images , 2013, IEEE Transactions on Image Processing.

[25]  Minh N. Do,et al.  Fast Global Image Smoothing Based on Weighted Least Squares , 2014, IEEE Transactions on Image Processing.

[26]  John W. Fisher,et al.  Bayesian Nonparametric Intrinsic Image Decomposition , 2014, ECCV.

[27]  Yizhou Yu,et al.  Title An L 1 image transform for edge-preserving smoothing andscene-level intrinsic decomposition , 2015 .

[28]  Michael S. Brown,et al.  Fast and Effective L0 Gradient Minimization by Region Fusion , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[29]  Shashi Ranjan,et al.  Local Edge-Preserving Multiscale Decomposition for High Dynamic Range Image Tone Mapping , 2015 .

[30]  Panos Nasiopoulos,et al.  Demystifying High-Dynamic-Range Technology: A new evolution in digital media. , 2015, IEEE Consumer Electronics Magazine.

[31]  Weijian Liu,et al.  Contrast Enhancement by Nonlinear Diffusion Filtering , 2016, IEEE Transactions on Image Processing.

[32]  Xiao-Ping Zhang,et al.  A Weighted Variational Model for Simultaneous Reflectance and Illumination Estimation , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  Masatoshi Okutomi,et al.  Gradient-Domain Image Reconstruction Framework with Intensity-Range and Base-Structure Constraints , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Lei Zhang,et al.  Clustering based content and color adaptive tone mapping , 2017, Comput. Vis. Image Underst..