Multi-Exposure and Multi-Focus Image Fusion in Gradient Domain

A multi-exposure and multi-focus image fusion algorithm is proposed. The algorithm is developed for color images and is based on blending the gradients of the luminance components of the input images using the maximum gradient magnitude at each pixel location and then obtaining the fused luminance using a Haar wavelet-based image reconstruction technique. This image reconstruction algorithm is of O(N) complexity and includes a Poisson solver at each resolution to eliminate artifacts that may appear due to the nonconservative nature of the resulting gradient. The fused chrominance, on the other hand, is obtained as a weighted mean of the chrominance channels. The particular case of grayscale images is treated as luminance fusion. Experimental results and comparison with other fusion techniques indicate that the proposed algorithm is fast and produces similar or better results than existing techniques for both multi-exposure as well as multi-focus images.

[1]  Shutao Li,et al.  Fast multi-exposure image fusion with median filter and recursive filter , 2012, IEEE Transactions on Consumer Electronics.

[2]  Colin Bradley,et al.  A New Wave-Front Reconstruction Method for Adaptive Optics Systems Using Wavelets , 2008, IEEE Journal of Selected Topics in Signal Processing.

[3]  J. Kong,et al.  A Novel Fusion Approach of Multi-exposure Image , 2007, EUROCON 2007 - The International Conference on "Computer as a Tool".

[4]  Vps Naidu,et al.  Image Fusion Technique using Multi-resolution Singular Value Decomposition , 2011 .

[5]  Zheng Qin,et al.  Effective Image Fusion Rules Of Multi-scale Image Decomposition , 2007, 2007 5th International Symposium on Image and Signal Processing and Analysis.

[6]  Cedric Nishan Canagarajah,et al.  Pixel- and region-based image fusion with complex wavelets , 2007, Inf. Fusion.

[7]  Pan Agathoklis,et al.  Comparison of Haar wavelet-based and Poisson-based numerical integration techniques , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[8]  Zhou Wang,et al.  Multi-exposure image fusion: A patch-wise approach , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[9]  Preeti Gupta,et al.  Survey on multi-focus image fusion algorithms , 2014, 2014 Recent Advances in Engineering and Computational Sciences (RAECS).

[10]  David S. Watkins,et al.  Fundamentals of Matrix Computations: Watkins/Fundamentals of Matrix Computations , 2005 .

[11]  Matthew Harker,et al.  Least squares surface reconstruction from measured gradient fields , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Kohei Inoue,et al.  A Differentiable Approximation Approach to Contrast-Aware Image Fusion , 2014, IEEE Signal Processing Letters.

[13]  Lining Sun,et al.  A New Wavelet Based Multi-focus Image Fusion Scheme and Its Application on Optical Microscopy , 2006, 2006 IEEE International Conference on Robotics and Biomimetics.

[14]  Yibo Chen,et al.  Edge model based fusion of multi-focus images using matting method , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[15]  Gang Xiao,et al.  Improved dynamic image fusion scheme for infrared and visible sequence based on image fusion system , 2008, 2008 11th International Conference on Information Fusion.

[16]  Minghui Wang,et al.  Research of multi-focus image fusion algorithm based on Gabor filter bank , 2014, 2014 12th International Conference on Signal Processing (ICSP).

[17]  Wang Yajie,et al.  A multi-focus color image fusion method based on edge detection , 2015, Chinese Control and Decision Conference.

[18]  Hadi Seyedarabi,et al.  Multi-focus image fusion for visual sensor networks in DCT domain , 2011, Comput. Electr. Eng..

[19]  Rama Chellappa,et al.  Direct Analytical Methods for Solving Poisson Equations in Computer Vision Problems , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Mrityunjay Kumar,et al.  A Total Variation-Based Algorithm for Pixel-Level Image Fusion , 2009, IEEE Transactions on Image Processing.

[21]  Panajotis Agathoklis,et al.  A wavelet based method for image reconstruction from gradient data with applications , 2013, Multidimensional Systems and Signal Processing.

[22]  Boualem Boashash,et al.  Image fusion-based contrast enhancement , 2012, EURASIP Journal on Image and Video Processing.

[23]  Amlan Chakrabarti,et al.  A New Multi-focus Image Fusion Method Using Principal Component Analysis in Shearlet Domain , 2015, PerMIn '15.

[24]  Rama Chellappa,et al.  A Method for Enforcing Integrability in Shape from Shading Algorithms , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[26]  Lawrence B. Wolff,et al.  Multispectral image visualization through first-order fusion , 2002, IEEE Trans. Image Process..

[27]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[28]  Jun Hu,et al.  HDR Deghosting: How to Deal with Saturation? , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  S. Gabarda,et al.  Blind image quality assessment through anisotropy. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[30]  Chao Wang,et al.  Salience Preserving Image Fusion with Dynamic Range Compression , 2006, 2006 International Conference on Image Processing.

[31]  David S. Watkins,et al.  Fundamentals of matrix computations , 1991 .

[32]  Jianbo Shi,et al.  Generalized Random Walks for Fusion of Multi-Exposure Images , 2011, IEEE Transactions on Image Processing.