Detail-Enhanced Multi-Scale Exposure Fusion in YUV Color Space

It is recognized that existing multi-scale exposure fusion algorithms can be improved using edge-preserving smoothing techniques. However, the complexity of edge-preserving smoothing-based multi-scale exposure fusion is an issue for mobile devices. In this paper, a simpler multi-scale exposure fusion algorithm is designed in YUV color space. The proposed algorithm can preserve details in the brightest and darkest regions of a high dynamic range (HDR) scene and the edge-preserving smoothing-based multi-scale exposure fusion algorithm while avoiding color distortion from appearing in the fused image. The complexity of the proposed algorithm is about half of the edge-preserving smoothing-based multi-scale exposure fusion algorithm. The proposed algorithm is thus friendlier to the smartphones than the edge-preserving smoothing-based multi-scale exposure fusion algorithm. In addition, a simple detail-enhancement component is proposed to enhance fine details of fused images. The experimental results show that the proposed component can be adopted to produce an enhanced image with visibly enhanced fine details and a higher MEF-SSIM value. This is impossible for existing detail enhancement components. Clearly, the component is attractive for PC-based applications.

[1]  Shiqian Wu,et al.  Weighted Guided Image Filtering , 2016, IEEE Transactions on Image Processing.

[2]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[3]  Jiebo Luo,et al.  Probabilistic Exposure Fusion , 2012, IEEE Transactions on Image Processing.

[4]  Zhengguo Li,et al.  Detail Preserving Multi-Scale Exposure Fusion , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[5]  Robert Wanat,et al.  Evaluation of Tone Mapping Operators for HDR-Video , 2013, Comput. Graph. Forum.

[6]  Zhengguo Li,et al.  Edge-preserving smoothing pyramid based multi-scale exposure fusion , 2018, J. Vis. Commun. Image Represent..

[7]  Kai Zeng,et al.  Perceptual Quality Assessment for Multi-Exposure Image Fusion , 2015, IEEE Transactions on Image Processing.

[8]  Zhengguo Li,et al.  Multi-scale exposure fusion via gradient domain guided image filtering , 2017, 2017 IEEE International Conference on Multimedia and Expo (ICME).

[9]  Zoran A. Ivanovski,et al.  High quality exposure fusion for mobile platforms , 2017, IEEE EUROCON 2017 -17th International Conference on Smart Technologies.

[10]  Jianli Wang,et al.  Multi-exposure images of wavelet transform fusion , 2013, Other Conferences.

[11]  Silvano Di Zenzo,et al.  A note on the gradient of a multi-image , 1986, Comput. Vis. Graph. Image Process..

[12]  Stavri G. Nikolov,et al.  Image fusion: Advances in the state of the art , 2007, Inf. Fusion.

[13]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[14]  Zhengguo Li,et al.  Gradient Domain Guided Image Filtering , 2015, IEEE Transactions on Image Processing.

[15]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH '08.

[16]  Lei Zhang,et al.  Learning a Deep Single Image Contrast Enhancer from Multi-Exposure Images , 2018, IEEE Transactions on Image Processing.

[17]  Zhengguo Li,et al.  Intelligent detail enhancement for differently exposed images , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[18]  Ahmed Abd-el-kader,et al.  Performance measures for image fusion based on wavelet transform and curvelet transform , 2011, 2011 28th National Radio Science Conference (NRSC).

[19]  Jan Kautz,et al.  Exposure Fusion , 2007 .

[20]  Zhengguo Li,et al.  Detail-Enhanced Multi-Scale Exposure Fusion , 2017, IEEE Transactions on Image Processing.

[21]  Ernest L. Hall,et al.  A Nonlinear Model for the Spatial Characteristics of the Human Visual System , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[22]  Nikolaos Mitianoudis,et al.  A hybrid multiple exposure image fusion approach for HDR image synthesis , 2016, 2016 IEEE International Conference on Imaging Systems and Techniques (IST).

[23]  Yanjie Liu,et al.  A Fast Fusion Method for Multi-exposure Image in YUV Color Space , 2018, 2018 IEEE 3rd Advanced Information Technology, Electronic and Automation Control Conference (IAEAC).

[24]  Nader Karimi,et al.  Fast exposure fusion using exposedness function , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[25]  Zhengguo Li,et al.  Visual-Salience-Based Tone Mapping for High Dynamic Range Images , 2014, IEEE Transactions on Industrial Electronics.

[26]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Jianbo Shi,et al.  Generalized Random Walks for Fusion of Multi-Exposure Images , 2011, IEEE Transactions on Image Processing.

[28]  Susanto Rahardja,et al.  Detail-Enhanced Exposure Fusion , 2012, IEEE Transactions on Image Processing.

[29]  Shutao Li,et al.  Image Fusion With Guided Filtering , 2013, IEEE Transactions on Image Processing.

[30]  Zhengguo Li,et al.  Intelligent Detail Enhancement for Exposure Fusion , 2017, IEEE Transactions on Multimedia.

[31]  Mingjing Li,et al.  Review of image fusion algorithm based on multiscale decomposition , 2013, Proceedings 2013 International Conference on Mechatronic Sciences, Electric Engineering and Computer (MEC).