Image Fusion Algorithm Based on Pulse Coupled Neural Networks and Nonsubsampled Contourlet Transform

The principles and features of nonsubsampled contourlet transform (NSCT) and pulse coupled neural networks (PCNN) are described in brief. Combining their characteristics, in NSCT domain, a new image fusion algorithm based on PCNN is proposed in this paper. Directional contrast and regional spatial frequency in NSCT domain is input to motivate PCNN and coefficients in NSCT domain with large firing times are selected as coefficients of the fused image. The experimental results demonstrate that the proposed algorithm can extract the original image's features better. The fused image’s representation capacity in spatial detail is also improved. Compared with the other fusion algorithms such as contourlet-based, NSCT-based, and NSCT-PCNN-based (maximum firing-times), the proposed algorithm provides better subjective and objective visual effect.

[1]  Rick S. Blum,et al.  A categorization of multiscale-decomposition-based image fusion schemes with a performance study for a digital camera application , 1999, Proc. IEEE.

[2]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[3]  John L. Johnson,et al.  PCNN models and applications , 1999, IEEE Trans. Neural Networks.

[4]  Reinhard Eckhorn,et al.  Feature Linking via Synchronization among Distributed Assemblies: Simulations of Results from Cat Visual Cortex , 1990, Neural Computation.

[5]  James Llinas,et al.  An introduction to multisensor data fusion , 1997, Proc. IEEE.

[6]  Pascal Vasseur,et al.  Introduction to Multisensor Data Fusion , 2005, The Industrial Information Technology Handbook.

[7]  Fang Qing,et al.  Contrast-Based Multiresolution Image Fusion , 2000 .

[8]  Myeong-Ryong Nam,et al.  Fusion of multispectral and panchromatic Satellite images using the curvelet transform , 2005, IEEE Geoscience and Remote Sensing Letters.

[9]  Hai Wang,et al.  Image fusion algorithm based on nonsubsampled contourlet transform , 2010, 2010 2nd International Conference on Future Computer and Communication.

[10]  Jingwen Yan,et al.  A novel image fusion algorithm based on bandelet transform , 2007 .

[11]  屈小波 Xiaobo Qu,et al.  Image Fusion Algorithm Based on Spatial Frequency-Motivated Pulse Coupled Neural Networks in Nonsubsampled Contourlet Transform Domain , 2008 .

[12]  Stéphane Mallat,et al.  Sparse geometric image representations with bandelets , 2005, IEEE Transactions on Image Processing.

[13]  Peter Tino,et al.  IEEE Transactions on Neural Networks , 2009 .

[14]  Minh N. Do,et al.  The Nonsubsampled Contourlet Transform: Theory, Design, and Applications , 2006, IEEE Transactions on Image Processing.