Multifocus image fusion using the nonsubsampled contourlet transform

A novel image fusion algorithm based on the nonsubsampled contourlet transform (NSCT) is proposed in this paper, aiming at solving the fusion problem of multifocus images. The selection principles of different subband coefficients obtained by the NSCT decomposition are discussed in detail. Based on the directional vector normal, a 'selecting' scheme combined with the 'averaging' scheme is presented for the lowpass subband coefficients. Based on the directional bandlimited contrast and the directional vector standard deviation, a selection principle is put forward for the bandpass directional subband coefficients. Experimental results demonstrate that the proposed algorithm cannot only extract more important visual information from source images, but also effectively avoid the introduction of artificial information. It significantly outperforms the traditional discrete wavelet transform-based and the discrete wavelet frame transform-based image fusion methods in terms of both visual quality and objective evaluation, especially when the source images are not perfectly registered.

[1]  R. L. Valois,et al.  The orientation and direction selectivity of cells in macaque visual cortex , 1982, Vision Research.

[2]  A. T. Erdem,et al.  On modeling the focus blur in image restoration , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[3]  Minh N. Do,et al.  Nonsubsampled contourlet transform: construction and application in enhancement , 2005, IEEE International Conference on Image Processing 2005.

[4]  Minh N. Do,et al.  The Nonsubsampled Contourlet Transform: Theory, Design, and Applications , 2006, IEEE Transactions on Image Processing.

[5]  Wei Cai,et al.  A region-based multi-sensor image fusion scheme using pulse-coupled neural network , 2006, Pattern Recognit. Lett..

[6]  Gonzalo Pajares,et al.  A wavelet-based image fusion tutorial , 2004, Pattern Recognit..

[7]  Mark J. T. Smith,et al.  A filter bank for the directional decomposition of images: theory and design , 1992, IEEE Trans. Signal Process..

[8]  Yaonan Wang,et al.  Multifocus image fusion using artificial neural networks , 2002, Pattern Recognit. Lett..

[9]  D H Tay,et al.  Flexible design of multidimensional perfect reconstruction FIR 2-band filters using transformations of variables , 1993, IEEE Trans. Image Process..

[10]  Vladimir Petrovic,et al.  Objective image fusion performance characterisation , 2005, ICCV 2005.

[11]  Alexander Toet,et al.  Merging thermal and visual images by a contrast pyramid , 1989 .

[12]  Minh N. Do,et al.  Nonsubsampled contourilet transform: filter design and applications in denoising , 2005, IEEE International Conference on Image Processing 2005.

[13]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[14]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[15]  Vladimir S. Petrovic,et al.  Gradient-based multiresolution image fusion , 2004, IEEE Transactions on Image Processing.

[16]  Sam Kavusi,et al.  Computationally efficient algorithm for multifocus image reconstruction , 2003, IS&T/SPIE Electronic Imaging.

[17]  Alexander Toet,et al.  Image fusion by a ration of low-pass pyramid , 1989, Pattern Recognit. Lett..

[18]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[19]  Rick S. Blum,et al.  A categorization of multiscale-decomposition-based image fusion schemes with a performance study for a digital camera application , 1999, Proc. IEEE.

[20]  Mark J. Shensa,et al.  The discrete wavelet transform: wedding the a trous and Mallat algorithms , 1992, IEEE Trans. Signal Process..

[21]  Bhabatosh Chanda,et al.  A simple and efficient algorithm for multifocus image fusion using morphological wavelets , 2006, Signal Process..

[22]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[23]  Minh N. Do,et al.  Framing pyramids , 2003, IEEE Trans. Signal Process..

[24]  W. Sweldens.  The Lifting Scheme: A Custom - Design Construction of Biorthogonal Wavelets "Industrial Mathematics , 1996 .

[25]  Gonzalo Pajares Martinsanz,et al.  A wavelet-based image fusion tutorial , 2004 .

[26]  Henry Leung,et al.  Pixel visibility based multifocus image fusion , 2003, International Conference on Neural Networks and Signal Processing, 2003. Proceedings of the 2003.