Multi-focus image fusion based on nonsubsampled contourlet transform and focused regions detection

Abstract A novel multi-focus image fusion algorithm is proposed in nonsubsampled contourlet transform (NSCT) domain. It uses the technique of focused regions detection and some new fusion rules to guide coefficients combination. At first, the initial fused image is acquired with one of conventional multiresolution image fusion method; meanwhile the source multi-focus images are decomposed by using NSCT. The pixels of the original images, which are more similar to the corresponding pixels of initial fused image, are considered from the sharply focused regions. Based on this, the initial focused regions can be determined and the morphological opening and closing are employed for postprocessing. Then the focused regions in each image are identified and used to guide the different subband coefficients combination. Moreover, in order to avoid the erroneous results introduced at the boundary of the focused regions, the coefficients located at the focused border regions are fused by the choice of corresponding subband coefficients according to some new fusion rules. Finally, the fused image is reconstructed by performing the inverse NSCT. The experimental results show that the proposed fusion approach is effective and can provide better performance in fusing multi-focus images than some current methods.

[1]  Veysel Aslantas,et al.  Fusion of multi-focus images using differential evolution algorithm , 2010, Expert Syst. Appl..

[2]  Wei Cai,et al.  A region-based multi-sensor image fusion scheme using pulse-coupled neural network , 2006, Pattern Recognit. Lett..

[3]  L. Yang,et al.  Multimodality medical image fusion based on multiscale geometric analysis of contourlet transform , 2008, Neurocomputing.

[4]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[5]  Yaonan Wang,et al.  Multifocus image fusion using artificial neural networks , 2002, Pattern Recognit. Lett..

[6]  Yi Chai,et al.  Multifocus image fusion scheme based on features of multiscale products and PCNN in lifting stationary wavelet domain , 2011 .

[7]  W. Sweldens The Lifting Scheme: A Custom - Design Construction of Biorthogonal Wavelets "Industrial Mathematics , 1996 .

[8]  Qiang Zhang,et al.  Fusion of Multi-sensor Images Based on the Nonsubsampled Contourlet Transform: Fusion of Multi-sensor Images Based on the Nonsubsampled Contourlet Transform , 2009 .

[9]  Veysel Aslantas,et al.  A comparison of criterion functions for fusion of multi-focus noisy images , 2009 .

[10]  A. G. Flesia,et al.  Can recent innovations in harmonic analysis `explain' key findings in natural image statistics? , 2001, Network.

[11]  Minh N. Do,et al.  The Nonsubsampled Contourlet Transform: Theory, Design, and Applications , 2006, IEEE Transactions on Image Processing.

[12]  Tania Stathaki,et al.  Image Fusion: Algorithms and Applications , 2008 .

[13]  Mark J. Shensa,et al.  The discrete wavelet transform: wedding the a trous and Mallat algorithms , 1992, IEEE Trans. Signal Process..

[14]  Salvador Gabarda,et al.  On the use of a joint spatial-frequency representation for the fusion of multi-focus images , 2005, Pattern Recognit. Lett..

[15]  G. Qu,et al.  Information measure for performance of image fusion , 2002 .

[16]  Guo Bao Fusion of Multi-sensor Images Based on the Nonsubsampled Contourlet Transform , 2008 .

[17]  Shuyuan Yang,et al.  Fusion of multiparametric SAR images based on SW-nonsubsampled contourlet and PCNN , 2009, Signal Process..

[18]  Costas Xydeas,et al.  On the effects of sensor noise in pixel-level image fusion performance , 2000, Proceedings of the Third International Conference on Information Fusion.

[19]  Gonzalo Pajares,et al.  A wavelet-based image fusion tutorial , 2004, Pattern Recognit..

[20]  Yingjie Zhang,et al.  Efficient fusion scheme for multi-focus images by using blurring measure , 2009, Digit. Signal Process..

[21]  Richard G. Baraniuk,et al.  Nonlinear wavelet transforms for image coding via lifting , 2003, IEEE Trans. Image Process..

[22]  Zhongliang Jing,et al.  Evaluation of focus measures in multi-focus image fusion , 2007, Pattern Recognit. Lett..

[23]  屈小波 Xiaobo Qu,et al.  Image Fusion Algorithm Based on Spatial Frequency-Motivated Pulse Coupled Neural Networks in Nonsubsampled Contourlet Transform Domain , 2008 .

[24]  Mark J. T. Smith,et al.  A filter bank for the directional decomposition of images: theory and design , 1992, IEEE Trans. Signal Process..

[25]  Paul S. Fisher,et al.  Image quality measures and their performance , 1995, IEEE Trans. Commun..

[26]  Wim Sweldens,et al.  The lifting scheme: a construction of second generation wavelets , 1998 .

[27]  Oliver Rockinger Pixel - Level Fusion of Image Sequences using Wavelet Frames , 1996 .

[28]  Yi Chai,et al.  Multifocus image fusion scheme using focused region detection and multiresolution , 2011 .

[29]  Vladimir S. Petrovic,et al.  Gradient-based multiresolution image fusion , 2004, IEEE Transactions on Image Processing.

[30]  Shutao Li,et al.  Multifocus image fusion using region segmentation and spatial frequency , 2008, Image Vis. Comput..

[31]  Jingwen Yan,et al.  Image Fusion Algorithm Based on Spatia Frequency-Motivated Pulse Coupled Neural Networks in Nonsubsampled Contourlet Transform Domain: Image Fusion Algorithm Based on Spatia Frequency-Motivated Pulse Coupled Neural Networks in Nonsubsampled Contourlet Transform Domain , 2009 .

[32]  Alexander Toet,et al.  Merging thermal and visual images by a contrast pyramid , 1989 .

[33]  Qiang Zhang,et al.  Multifocus image fusion using the nonsubsampled contourlet transform , 2009, Signal Process..

[34]  Bhabatosh Chanda,et al.  Enhancing effective depth-of-field by image fusion using mathematical morphology , 2006, Image Vis. Comput..

[35]  Shutao Li,et al.  Hybrid Multiresolution Method for Multisensor Multimodal Image Fusion , 2010, IEEE Sensors Journal.

[36]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[37]  Shutao Li,et al.  Multifocus image fusion by combining curvelet and wavelet transform , 2008, Pattern Recognit. Lett..