Multifocus image fusion based on features contrast of multiscale products in nonsubsampled contourlet transform domain

Abstract In this paper, an efficient multifocus image fusion approach is proposed based on local features contrast of multiscale products in nonsubsampled contourlet transform (NSCT) domain. In order to improve the robustness of the fusion algorithm to the noise and select the coefficients of the fused image properly, the multiscale products, which can distinguish edge structures from noise more effectively in NSCT domain, is developed and introduced into image fusion field. The selection principles of different subband coefficients obtained by the NSCT decomposition are discussed in detail. To improve the quality of the fused image, novel different local features contrast measurements, which are proved to be more suitable for human vision system and can extract more useful detail information from source images and inject them into the fused image, are developed and used to select coefficients from the clear parts of subimages to compose coefficients of fused images. Experimental results demonstrate the proposed method performs very well in fusion both noisy and noise-free multifocus images, and outperform conventional methods in terms of both visual quality and objective evaluation criteria.

[1]  A. Trous,et al.  The Discrete Wavelet Transform: Wedding the . , 1992 .

[2]  Alexander Toet,et al.  Image fusion by a ration of low-pass pyramid , 1989, Pattern Recognit. Lett..

[3]  G. Qu,et al.  Information measure for performance of image fusion , 2002 .

[4]  Emmanuel J. Candès,et al.  The curvelet transform for image denoising , 2002, IEEE Trans. Image Process..

[5]  Veysel Aslantas,et al.  A comparison of criterion functions for fusion of multi-focus noisy images , 2009 .

[6]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[7]  Chang-Soo Lee,et al.  New lifting based structure for undecimated wavelet transform , 2000 .

[8]  Minh N. Do,et al.  The Nonsubsampled Contourlet Transform: Theory, Design, and Applications , 2006, IEEE Transactions on Image Processing.

[9]  Mark J. Shensa,et al.  The discrete wavelet transform: wedding the a trous and Mallat algorithms , 1992, IEEE Trans. Signal Process..

[10]  Bhabatosh Chanda,et al.  A simple and efficient algorithm for multifocus image fusion using morphological wavelets , 2006, Signal Process..

[11]  Kiyoharu Aizawa,et al.  Reconstructing Dense Light Field From Array of Multifocus Images for Novel View Synthesis , 2007, IEEE Transactions on Image Processing.

[12]  Alexander Toet,et al.  Merging thermal and visual images by a contrast pyramid , 1989 .

[13]  Jingwen Yan,et al.  Image Fusion Algorithm Based on Spatia Frequency-Motivated Pulse Coupled Neural Networks in Nonsubsampled Contourlet Transform Domain: Image Fusion Algorithm Based on Spatia Frequency-Motivated Pulse Coupled Neural Networks in Nonsubsampled Contourlet Transform Domain , 2009 .

[14]  Vladimir S. Petrovic,et al.  Gradient-based multiresolution image fusion , 2004, IEEE Transactions on Image Processing.

[15]  Max A. Viergever,et al.  A survey of medical image registration , 1998, Medical Image Anal..

[16]  Qiang Zhang,et al.  Multifocus image fusion using the nonsubsampled contourlet transform , 2009, Signal Process..

[17]  Hui Zhao,et al.  Multi-focus color image fusion in the HSI space using the sum-modified-laplacian and a coarse edge map , 2008, Image Vis. Comput..

[18]  Sanjit K. Mitra,et al.  Digital ladder networks , 1973 .

[19]  L. Yang,et al.  Multimodality medical image fusion based on multiscale geometric analysis of contourlet transform , 2008, Neurocomputing.

[20]  Dennis M. Healy,et al.  Wavelet transform domain filters: a spatially selective noise filtration technique , 1994, IEEE Trans. Image Process..

[21]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[22]  W. Sweldens The Lifting Scheme: A Custom - Design Construction of Biorthogonal Wavelets "Industrial Mathematics , 1996 .

[23]  Minh N. Do,et al.  Directional multiscale statistical modeling of images , 2003, SPIE Optics + Photonics.

[24]  Cedric Nishan Canagarajah,et al.  Non-Gaussian model-based fusion of noisy images in the wavelet domain , 2010, Comput. Vis. Image Underst..

[25]  Henry Leung,et al.  Pixel visibility based multifocus image fusion , 2003, International Conference on Neural Networks and Signal Processing, 2003. Proceedings of the 2003.

[26]  Zhongliang Jing,et al.  Evaluation of focus measures in multi-focus image fusion , 2007, Pattern Recognit. Lett..

[27]  Yaonan Wang,et al.  Multifocus image fusion using artificial neural networks , 2002, Pattern Recognit. Lett..

[28]  Mark J. T. Smith,et al.  A filter bank for the directional decomposition of images: theory and design , 1992, IEEE Trans. Signal Process..

[29]  Brian M. Sadler,et al.  Analysis of Multiscale Products for Step Detection and Estimation , 1999, IEEE Trans. Inf. Theory.

[30]  Shree K. Nayar,et al.  Shape from Focus , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  屈小波 Xiaobo Qu,et al.  Image Fusion Algorithm Based on Spatial Frequency-Motivated Pulse Coupled Neural Networks in Nonsubsampled Contourlet Transform Domain , 2008 .

[32]  Zhongliang Jing,et al.  Multi-focus image fusion using pulse coupled neural network , 2007, Pattern Recognit. Lett..

[33]  Xiao-Hui Yang,et al.  Fusion Algorithm for Remote Sensing Images Based on Nonsubsampled Contourlet Transform , 2008 .

[34]  Wei Cai,et al.  A region-based multi-sensor image fusion scheme using pulse-coupled neural network , 2006, Pattern Recognit. Lett..

[35]  Gemma Piella,et al.  A general framework for multiresolution image fusion: from pixels to regions , 2003, Inf. Fusion.

[36]  Shutao Li,et al.  Multifocus Image Fusion and Restoration With Sparse Representation , 2010, IEEE Transactions on Instrumentation and Measurement.

[37]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Gonzalo Pajares,et al.  A wavelet-based image fusion tutorial , 2004, Pattern Recognit..

[39]  Costas Xydeas,et al.  On the effects of sensor noise in pixel-level image fusion performance , 2000, Proceedings of the Third International Conference on Information Fusion.