Multi-focus image fusion based on L1 image transform

In this paper, a new multi-focus image fusion algorithm based on L1 image transform is proposed. A distinctive advantage of the proposed algorithm is that an edge-preserving image decomposition (EPID) framework is constructed by introducing a L1-norm based image transform, which can not only effectively preserve and sharpen salient edges and ridges while eliminating insignificant details in the smoothing subband, but also maintain the detail information in the detail subbands. Another advantage is that the fusion rules for the smoothing subband and detail subbands are designed respectively according to their own characteristics so that both the structure and detail information can be fully retained. The fusion process mainly consists of the following three steps. Firstly, each source image is decomposed into a smoothing subband and several detail subbands by utilizing the EPID framework. Then, the subbands are fused by different fusion rules respectively to obtain a fused smoothing subband and a series of fused detail subands. Finally, the final fused image is reconstructed with less distortions by synthesizing the fused smoothing subband and a series of fused detail subands. Experimental results demonstrate the superiority of the proposed algorithm in terms of the visual perception and objective assessments.

[1]  Yizhou Yu,et al.  An L1 image transform for edge-preserving smoothing and scene-level intrinsic decomposition , 2015, ACM Trans. Graph..

[2]  Gang Xiao,et al.  Multi-scale Guided Image and Video Fusion: A Fast and Efficient Approach , 2019, Circuits, Systems, and Signal Processing.

[3]  Yafei Zhang,et al.  Performance improvement scheme of multifocus image fusion derived by difference images , 2016, Signal Process..

[4]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[5]  Sun Li,et al.  Multi-scale weighted gradient-based fusion for multi-focus images , 2014, Inf. Fusion.

[6]  Yuanyuan Wang,et al.  Biological image fusion using a NSCT based variable-weight method , 2011, Inf. Fusion.

[7]  Qiaoqiao Li,et al.  Multifocus image fusion using phase congruency , 2015, J. Electronic Imaging.

[8]  Li Chen,et al.  Multi-focus image fusion using a bilateral gradient-based sharpness criterion , 2011 .

[9]  Vladimir Petrovic,et al.  Objective image fusion performance measure , 2000 .

[10]  Shutao Li,et al.  Multifocus image fusion using region segmentation and spatial frequency , 2008, Image Vis. Comput..

[11]  Richard Baraniuk,et al.  The Dual-tree Complex Wavelet Transform , 2007 .

[12]  Mostafa Amin-Naji,et al.  Multi-Focus Image Fusion in DCT Domain using Variance and Energy of Laplacian and Correlation Coefficient for Visual Sensor Networks , 2018 .

[13]  Yuhua Qian,et al.  3D shape reconstruction from multifocus image fusion using a multidirectional modified Laplacian operator , 2020, Pattern Recognit..

[14]  Gonzalo Pajares,et al.  A wavelet-based image fusion tutorial , 2004, Pattern Recognit..

[15]  Alessandro Bevilacqua,et al.  Extended depth of focus in optical microscopy: Assessment of existing methods and a new proposal , 2012, Microscopy research and technique.

[16]  Cedric Nishan Canagarajah,et al.  Pixel- and region-based image fusion with complex wavelets , 2007, Inf. Fusion.

[17]  Zhongliang Jing,et al.  Evaluation of focus measures in multi-focus image fusion , 2007, Pattern Recognit. Lett..

[18]  Yi Chai,et al.  A novel multi-modality image fusion method based on image decomposition and sparse representation , 2017, Inf. Sci..

[19]  Xiaohua Qiu,et al.  Guided filter-based multi-focus image fusion through focus region detection , 2019, Signal Process. Image Commun..

[20]  Henk J. A. M. Heijmans,et al.  A new quality metric for image fusion , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[21]  Yu Liu,et al.  Multi-focus image fusion with a deep convolutional neural network , 2017, Inf. Fusion.

[22]  A. Aghagolzadeh,et al.  Real-time fusion of multi-focus images for visual sensor networks , 2010, 2010 6th Iranian Conference on Machine Vision and Image Processing.

[23]  Veysel Aslantas,et al.  Fusion of multi-focus images using differential evolution algorithm , 2010, Expert Syst. Appl..

[24]  Anan Banharnsakun,et al.  Multi-focus image fusion using best-so-far ABC strategies , 2015, Neural Computing and Applications.

[25]  Marly Guimarães Fernandes Costa,et al.  Multi-focus image fusion for bacilli images in conventional sputum smear microscopy for tuberculosis , 2019, Biomed. Signal Process. Control..

[26]  Yi Chai,et al.  Multifocus image fusion scheme using focused region detection and multiresolution , 2011 .

[27]  Ivo F. Sbalzarini,et al.  Curvature Filters Efficiently Reduce Certain Variational Energies , 2017, IEEE Transactions on Image Processing.

[28]  Qiaoqiao Li,et al.  A Novel Explicit Multi-focus Image Fusion Method , 2015, J. Inf. Hiding Multim. Signal Process..

[29]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[30]  Bo Wang,et al.  Multi-focus image fusion based on multi-scale focus measures and generalized random walk , 2017, 2017 36th Chinese Control Conference (CCC).

[31]  Susanto Rahardja,et al.  A New Multi-Focus Image Fusion Algorithm and Its Efficient Implementation , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[32]  Hui Zhao,et al.  Multi-focus color image fusion in the HSI space using the sum-modified-laplacian and a coarse edge map , 2008, Image Vis. Comput..

[33]  Bo Li,et al.  Multifocus image fusion via fixed window technique of multiscale images and non-local means filtering , 2017, Signal Process..

[34]  Arif Mahmood,et al.  Multi-focus image fusion using Content Adaptive Blurring , 2019, Inf. Fusion.

[35]  Xiangzhi Bai,et al.  Edge preserved image fusion based on multiscale toggle contrast operator , 2011, Image Vis. Comput..

[36]  M. Georgeson,et al.  Blurred edges look faint, and faint edges look sharp: The effect of a gradient threshold in a multi-scale edge coding model , 2007, Vision Research.

[37]  Kun Qian,et al.  Fusion of multi-focus images via a Gaussian curvature filter and synthetic focusing degree criterion. , 2018, Applied optics.

[38]  Muhammad Imran,et al.  Ghost-free multi exposure image fusion technique using dense SIFT descriptor and guided filter , 2019, J. Vis. Commun. Image Represent..

[39]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, SIGGRAPH 2008.

[40]  Shutao Li,et al.  Multifocus image fusion by combining curvelet and wavelet transform , 2008, Pattern Recognit. Lett..

[41]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[42]  Huiqian Du,et al.  Multimodality medical image fusion algorithm based on gradient minimization smoothing filter and pulse coupled neural network , 2016, Biomed. Signal Process. Control..

[43]  Minh N. Do,et al.  Fast Global Image Smoothing Based on Weighted Least Squares , 2014, IEEE Transactions on Image Processing.

[44]  Yu Zhang,et al.  Boundary finding based multi-focus image fusion through multi-scale morphological focus-measure , 2017, Inf. Fusion.

[45]  Shutao Li,et al.  Image matting for fusion of multi-focus images in dynamic scenes , 2013, Inf. Fusion.

[46]  Stavri G. Nikolov,et al.  Image fusion: Advances in the state of the art , 2007, Inf. Fusion.

[47]  Preeti Gupta,et al.  Survey on multi-focus image fusion algorithms , 2014, 2014 Recent Advances in Engineering and Computational Sciences (RAECS).