Image Fusion Based on Nonsubsampled Contourlet Transform and Pulse Coupled Neural Networks

In order to overcome the lacking of Shift invariance in Contourlet Transform, enable the image fusion to be in accord with human vision properties, Nonsubsampled Contourlet Transform (NSCT) and Pulse Coupled Neural Networks(PCNN) were used jointly in image fusion algorithms. Original images were decomposed to get the coefficients of low frequency sub bands and high frequency sub bands. The coefficients of low and high frequency sub bands were processed by a modified PCNN. Matching degree of original images is defined and used in fusion rules. Fusion image was obtained by NSCT inverse transformation. Experimental result shows this method is better than Wavelet, Contourlet and traditional PCNN methods, it has bigger mutual information, so the fusion image include more original image's information.

[1]  Wei Cai,et al.  A region-based multi-sensor image fusion scheme using pulse-coupled neural network , 2006, Pattern Recognit. Lett..

[2]  Yong-An Zheng,et al.  False Color Fusion for Multi-band SAR Images Based on Contourlet Transform , 2007 .

[3]  Victor J. D. Tsai,et al.  Frequency-based fusion of multiresolution images , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[4]  Gonzalo Pajares,et al.  A wavelet-based image fusion tutorial , 2004, Pattern Recognit..

[5]  Myeong-Ryong Nam,et al.  Fusion of multispectral and panchromatic Satellite images using the curvelet transform , 2005, IEEE Geoscience and Remote Sensing Letters.

[6]  Yaonan Wang,et al.  Multifocus image fusion using artificial neural networks , 2002, Pattern Recognit. Lett..

[7]  Sam Kavusi,et al.  Computationally efficient algorithm for multifocus image reconstruction , 2003, IS&T/SPIE Electronic Imaging.

[8]  Rick S. Blum On multisensor image fusion performance limits from an estimation theory perspective , 2006, Inf. Fusion.

[9]  Gonzalo Pajares Martinsanz,et al.  A wavelet-based image fusion tutorial , 2004 .

[10]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[11]  Minh N. Do,et al.  The Nonsubsampled Contourlet Transform: Theory, Design, and Applications , 2006, IEEE Transactions on Image Processing.