Hue-Correction Scheme Considering Non-Linear Camera Response for Multi-Exposure Image Fusion

We propose a novel hue-correction scheme for multi-exposure image fusion (MEF). Various MEF methods have so far been studied to generate higher-quality images. However, there are few MEF methods considering hue distortion unlike other fields of image processing, due to a lack of a reference image that has correct hue. In the proposed scheme, we generate an HDR image as a reference for hue correction, from input multi-exposure images. After that, hue distortion in images fused by an MEF method is removed by using hue information of the HDR one, on the basis of the constant-hue plane in the RGB color space. In simulations, the proposed scheme is demonstrated to be effective to correct hue-distortion caused by conventional MEF methods. Experimental results also show that the proposed scheme can generate high-quality images, regardless of exposure conditions of input multi-exposure images.

[1]  Shree K. Nayar,et al.  Radiometric self calibration , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[2]  M. Luo,et al.  The development of the CIE 2000 Colour Difference Formula , 2001 .

[3]  Erik Reinhard,et al.  Photographic tone reproduction for digital images , 2002, ACM Trans. Graph..

[4]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[5]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[6]  Karol Myszkowski,et al.  Adaptive Logarithmic Mapping For Displaying High Contrast Scenes , 2003, Comput. Graph. Forum.

[7]  C. A. Murthy,et al.  Hue-preserving color image enhancement without gamut problem , 2003, IEEE Trans. Image Process..

[8]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[9]  Jan Kautz,et al.  Exposure Fusion , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[10]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH '08.

[11]  Wolfgang Heidrich,et al.  Color correction for tone mapping , 2009, Comput. Graph. Forum.

[12]  Michael S. Brown,et al.  Globally Optimized Linear Windowed Tone Mapping , 2010, IEEE Transactions on Visualization and Computer Graphics.

[13]  Jianbo Shi,et al.  Generalized Random Walks for Fusion of Multi-Exposure Images , 2011, IEEE Transactions on Image Processing.

[14]  Chun-Liang Chien,et al.  COLOR IMAGE ENHANCEMENT WITH EXACT HSI COLOR MODEL , 2011 .

[15]  Akira Taguchi,et al.  Hue-preserving color image enhancement in RGB color space with rich saturation , 2012, 2012 International Symposium on Intelligent Signal Processing and Communications Systems.

[16]  Sejung Yang,et al.  Hue-preserving gamut mapping with high saturation , 2013 .

[17]  Bo Gu,et al.  Local Edge-Preserving Multiscale Decomposition for High Dynamic Range Image Tone Mapping , 2013, IEEE Transactions on Image Processing.

[18]  Zhou Wang,et al.  Objective Quality Assessment of Tone-Mapped Images , 2013, IEEE Transactions on Image Processing.

[19]  Shiqian Wu,et al.  Selectively Detail-Enhanced Fusion of Differently Exposed Images With Moving Objects , 2014, IEEE Transactions on Image Processing.

[20]  Neil D. B. Bruce ExpoBlend: Information preserving exposure blending based on normalized log-domain entropy , 2014, Comput. Graph..

[21]  Mila Nikolova,et al.  Fast Hue and Range Preserving Histogram Specification: Theory and New Algorithms for Color Image Enhancement , 2014, IEEE Transactions on Image Processing.

[22]  Masahiro Iwahashi,et al.  Hybrid method for multi-exposure image fusion based on weighted mean and sparse representation , 2015, 2015 23rd European Signal Processing Conference (EUSIPCO).

[23]  Erik Reinhard,et al.  A Gamut-Mapping Framework for Color-Accurate Reproduction of HDR Images , 2016, IEEE Computer Graphics and Applications.

[24]  Patrick Le Callet,et al.  High Dynamic Range Video - From Acquisition, to Display and Applications , 2016 .

[25]  Hitoshi Kiya,et al.  Pseudo multi-exposure fusion using a single image , 2017, 2017 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC).

[26]  2017 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2017, Kuala Lumpur, Malaysia, December 12-15, 2017 , 2017, APSIPA ASC.

[27]  Lei Zhang,et al.  Robust Multi-Exposure Image Fusion: A Structural Patch Decomposition Approach , 2017, IEEE Transactions on Image Processing.

[28]  Nader Karimi,et al.  Fast exposure fusion using exposedness function , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[29]  Noriaki Suetake,et al.  HUE-Preserving Color Contrast Enhancement Method Without Gamut Problem by Using Histogram Specification , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[30]  Hitoshi Kiya,et al.  Automatic exposure compensation using an image segmentation method for single-image-based multi-exposure fusion , 2018 .

[31]  Hitoshi Kiya,et al.  A Hue-Preserving Tone Mapping Scheme Based on Constant-Hue Plane Without Gamut Problem , 2019, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[32]  Yuma Kinoshita,et al.  A Color Compensation Method Using Inverse Camera Response Function for Multi-exposure Image Fusion , 2019, 2019 IEEE 8th Global Conference on Consumer Electronics (GCCE).

[33]  Noriaki Suetake,et al.  Hue-preserving image enhancement in CIELAB color space considering color gamut , 2019, Optical Review.

[34]  Kiya Hitoshi,et al.  Performance evaluation of high-quality image generation methods using multi-exposure images , 2019 .

[35]  Hitoshi Kiya,et al.  Scene Segmentation-Based Luminance Adjustment for Multi-Exposure Image Fusion , 2019, IEEE Transactions on Image Processing.

[36]  Yulan Zhang,et al.  Quaternion-based weighted nuclear norm minimization for color image denoising , 2019, Neurocomputing.