Image fusion algorithm for visible and PMMW images based on Curvelet and improved PCNN

Aiming at the fusion of visible and Passive Millimeter Wave (PMMW) images, a novel algorithm based on second generation Curvelet and improved pulse coupled neural network (PCNN) is proposed. Firstly, the fast discrete Curvelet transform was applied to the visible and PMMW image, respectively, to obtain the coefficients at different scales and in various directions. For the coarse scale, the fusion coefficients are determined by the feature of PMMW image which is extracted by region growing. It ensured that the useless information was abandoned. On the other hand, for the fine scale, the fusion coefficients are selected by improved PCNN. Finally, the fusion results are obtained through the inverse Curvelet transform. The experimental result demonstrates that the proposed algorithm can integrate the important information of visible and PMMW image, and improve the performance of fusion from traditional Curvelet method and PCNN method.

[1]  Reinhard Eckhorn,et al.  Feature Linking via Synchronization among Distributed Assemblies: Simulations of Results from Cat Visual Cortex , 1990, Neural Computation.

[2]  Mark E. Oxley,et al.  Physiologically motivated image fusion for object detection using a pulse coupled neural network , 1999, IEEE Trans. Neural Networks.

[3]  Cheng Zhao,et al.  FUSION OF INFRARED AND VISIBLE IMAGES BASED ON THE SECOND GENERATION CURVELET TRANSFORM: FUSION OF INFRARED AND VISIBLE IMAGES BASED ON THE SECOND GENERATION CURVELET TRANSFORM , 2009 .

[4]  E. Candès,et al.  New tight frames of curvelets and optimal representations of objects with piecewise C2 singularities , 2004 .

[5]  Jamie P. Heather,et al.  A review of image fusion technology in 2005 , 2005, SPIE Defense + Commercial Sensing.

[6]  屈小波 Xiaobo Qu,et al.  Image Fusion Algorithm Based on Spatial Frequency-Motivated Pulse Coupled Neural Networks in Nonsubsampled Contourlet Transform Domain , 2008 .

[7]  Fu Meng,et al.  FUSION OF INFRARED AND VISIBLE IMAGES BASED ON THE SECOND GENERATION CURVELET TRANSFORM , 2009 .

[8]  Peter J. Burt,et al.  Enhanced image capture through fusion , 1993, 1993 (4th) International Conference on Computer Vision.

[9]  Paul S. Fisher,et al.  Image quality measures and their performance , 1995, IEEE Trans. Commun..

[10]  Jingwen Yan,et al.  Image fusion algorithm based on orientation information motivated Pulse Coupled Neural Networks , 2008, 2008 7th World Congress on Intelligent Control and Automation.

[11]  Yong Li,et al.  Multi-sensor image fusion by NSCT-PCNN transform , 2011, 2011 IEEE International Conference on Computer Science and Automation Engineering.

[12]  Laurent Demanet,et al.  Fast Discrete Curvelet Transforms , 2006, Multiscale Model. Simul..

[13]  L. Yujiri,et al.  Passive Millimeter Wave Imaging , 2003, 2006 IEEE MTT-S International Microwave Symposium Digest.

[14]  Markus Peichl,et al.  Study of passive MMW personnel imaging with respect to suspicious and common concealed objects for security applications , 2008, Security + Defence.