Enhancing image visuality by multi-exposure fusion

Abstract Image visuality enhancement aims at increasing visual quality of a given image to convey more useful information. The key for visuality enhancement is to comprehensively exploit the details of the image scene. However, one (or several) observed image only provides partial information of the scene. To address this problem, we present a novel multi-exposure fusion based visuality enhancement method in this study. Firstly, we propose a simulated exposure model to synthesize the results of the observed image under different exposure conditions. Then, white balancing and image gradient are separately performed on those simulated exposure results. By doing these, scene details in different exposure conditions as well as image feature spaces (i.e., color and gradient spaces) can be well exploited. To appropriately take advantage of those resultant details, we adopt the Laplacian pyramid based linear fusion framework to integrate them into the enhanced image in a multi-scale way. Different from conventional fusion methods, we develop a more powerful weight map for fusion, which is able to simultaneously highlight pixels with good exposedness, contrast, saturation as well as Gamut. Experimental results demonstrate that the proposed method can effectively enhance the visuality of the observed image. Compared with existing methods, the proposed method well highlights the fine details as well as avoiding halo artifacts.

[1]  Mingkui Tan,et al.  Blind Image Deconvolution by Automatic Gradient Activation , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Erik Reinhard,et al.  Ieee Transactions on Visualization and Computer Graphics 1 Dynamic Range Reduction Inspired by Photoreceptor Physiology , 2022 .

[3]  Erik Reinhard,et al.  Photographic tone reproduction for digital images , 2002, ACM Trans. Graph..

[4]  Marius Tico,et al.  Artifact-free High Dynamic Range imaging , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).

[5]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting , 2010 .

[6]  Frédo Durand,et al.  Noise-optimal capture for high dynamic range photography , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Ramesh Raskar,et al.  Why I Want a Gradient Camera , 2022 .

[8]  Narendra Ahuja,et al.  Split Aperture Imaging for High Dynamic Range , 2004, International Journal of Computer Vision.

[9]  Peter J. Burt,et al.  Enhanced image capture through fusion , 1993, 1993 (4th) International Conference on Computer Vision.

[10]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[11]  Tae-Hyun Oh,et al.  Robust High Dynamic Range Imaging by Rank Minimization , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Jan Kautz,et al.  Exposure Fusion , 2007 .

[13]  Wei Wei,et al.  Cluster Sparsity Field: An Internal Hyperspectral Imagery Prior for Reconstruction , 2018, International Journal of Computer Vision.

[14]  Ramesh Raskar,et al.  Image fusion for context enhancement and video surrealism , 2004, NPAR '04.

[15]  Graham D. Finlayson,et al.  Shades of Gray and Colour Constancy , 2004, CIC.

[16]  Mingkui Tan,et al.  MPGL: An Efficient Matching Pursuit Method for Generalized LASSO , 2017, AAAI.

[17]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH '08.

[18]  A. Ardeshir Goshtasby,et al.  Fusion of multi-exposure images , 2005, Image Vis. Comput..

[19]  Katsushi Ikeuchi,et al.  Radiometric Calibration by Rank Minimization , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Zia-ur Rahman,et al.  A multiscale retinex for bridging the gap between color images and the human observation of scenes , 1997, IEEE Trans. Image Process..

[21]  Yanning Zhang,et al.  High dynamic range imaging by sparse representation , 2017, Neurocomputing.

[22]  Brian A. Wandell,et al.  Rendering high dynamic range images , 2000, Electronic Imaging.

[23]  Wai-kuen Cham,et al.  Gradient-Directed Multiexposure Composition , 2012, IEEE Transactions on Image Processing.

[24]  Joost van de Weijer,et al.  Author Manuscript, Published in "ieee Transactions on Image Processing Edge-based Color Constancy , 2022 .

[25]  Chang-Su Kim,et al.  Optimized contrast enhancement for real-time image and video dehazing , 2013, J. Vis. Commun. Image Represent..

[26]  Christine D. Piatko,et al.  A Visibility Matching Tone Reproduction Operator for High Dynamic Range Scenes , 1997, IEEE Trans. Vis. Comput. Graph..

[27]  Cheolkon Jung,et al.  Perceptual multi-exposure image fusion with overall image quality index and local saturation , 2017, Multimedia Systems.

[28]  Mingkui Tan,et al.  Self-Paced Kernel Estimation for Robust Blind Image Deblurring , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[29]  Neil A. Dodgson,et al.  Cross Dissolve Without Cross Fade: Preserving Contrast, Color and Salience in Image Compositing , 2006, Comput. Graph. Forum.

[30]  Edward H. Adelson,et al.  Compressing and companding high dynamic range images with subband architectures , 2005, SIGGRAPH 2005.

[31]  Chul Lee,et al.  Ghost-Free High Dynamic Range Imaging via Rank Minimization , 2014, IEEE Signal Processing Letters.

[32]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[33]  Panajotis Agathoklis,et al.  Multi-Exposure and Multi-Focus Image Fusion in Gradient Domain , 2016, J. Circuits Syst. Comput..

[34]  Karol Myszkowski,et al.  Adaptive Logarithmic Mapping For Displaying High Contrast Scenes , 2003, Comput. Graph. Forum.

[35]  Bo Gu,et al.  Single image visibility enhancement in gradient domain , 2012 .

[36]  Shree K. Nayar,et al.  High dynamic range imaging: spatially varying pixel exposures , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).