A Visible and Passive Millimeter Wave Image Fusion Algorithm Based on Pulse-Coupled Neural Network in Tetrolet Domain for Early Risk Warning

An algorithm based on pulse-coupled neural network (PCNN) constructed in the Tetrolet transform domain is proposed for the fusion of the visible and passive millimeter wave images in order to effectively identify concealed targets. The Tetrolet transform is applied to build the framework of the multiscale decomposition due to its high sparse degree. Meanwhile, a Laplacian pyramid is used to decompose the low-pass band of the Tetrolet transform for improving the approximation performance. In addition, the maximum criterion based on regional average gradient is applied to fuse the top layers along with selecting the maximum absolute values of the other layers. Furthermore, an improved PCNN model is employed to enhance the contour feature of the hidden targets and obtain the fusion results of the high-pass band based on the firing time. Finally, the inverse transform of Tetrolet is exploited to obtain the fused results. Some objective evaluation indexes, such as information entropy, mutual information, and , are adopted for evaluating the quality of the fused images. The experimental results show that the proposed algorithm is superior to other image fusion algorithms.

[1]  Yan Xian.  Image fusion based on Tetrolet transform , 2013 .

[2]  W. Kong,et al.  Image fusion technique based on non-subsampled contourlet transform and adaptive unit-fast-linking pulse-coupled neural network , 2011 .

[3]  Sarat Kumar Sahoo,et al.  Pulse coupled neural networks and its applications , 2014, Expert Syst. Appl..

[4]  Zhou Zhiyong.  Nonsubsampled contourlet image fusion algorithm based on directional region , 2013 .

[5]  Ma Yi-de,et al.  PCNN Model Automatic Parameters Determination and Its Modified Model , 2012 .

[6]  Yu Huang,et al.  Fusion of visible and infrared image based on stationary tetrolet transform , 2017, 2017 32nd Youth Academic Annual Conference of Chinese Association of Automation (YAC).

[7]  Shutao Li,et al.  Performance comparison of different multi-resolution transforms for image fusion , 2011, Inf. Fusion.

[8]  Wei Wang,et al.  Infrared and Visible Image Fusion Based on Tetrolet Transform , 2016 .

[9]  G. Qu,et al.  Information measure for performance of image fusion , 2002 .

[10]  Zhang Xiao.  Validation and Correlation Analysis of Metrics for Evaluating Performance of Image Fusion , 2014 .

[11]  Costas Xydeas,et al.  On the effects of sensor noise in pixel-level image fusion performance , 2000, Proceedings of the Third International Conference on Information Fusion.

[12]  Jingwen Yan,et al.  Image Fusion Algorithm Based on Spatia Frequency-Motivated Pulse Coupled Neural Networks in Nonsubsampled Contourlet Transform Domain: Image Fusion Algorithm Based on Spatia Frequency-Motivated Pulse Coupled Neural Networks in Nonsubsampled Contourlet Transform Domain , 2009 .

[13]  Jianyu Yang,et al.  Image fusion algorithm for visible and PMMW images based on Curvelet and improved PCNN , 2012, 2012 IEEE 11th International Conference on Signal Processing.

[14]  Ye Zhang,et al.  A Novel Hybrid Method for Remote Sensing Image Approximation Using the Tetrolet Transform , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[15]  Changjiang Zhang,et al.  Multi-channel satellite cloud image fusion in the tetrolet transform domain , 2014 .

[16]  Faliang Chang,et al.  Fusion of Multi-focus Images Based on the 2-Generation Curvelet Transform , 2011 .

[17]  Qing Guo,et al.  Performance analysis of multi-spectral and panchromatic image fusion techniques based on two wavelet discrete approaches , 2011 .

[18]  Jens Krommweh,et al.  Tetrolet transform: A new adaptive Haar wavelet algorithm for sparse image representation , 2010, J. Vis. Commun. Image Represent..

[19]  L. Yujiri,et al.  Passive Millimeter Wave Imaging , 2003, 2006 IEEE MTT-S International Microwave Symposium Digest.

[20]  Markus Peichl,et al.  Study of passive MMW personnel imaging with respect to suspicious and common concealed objects for security applications , 2008, Security + Defence.

[21]  Xiangguang Chen,et al.  Segmentation of Concealed Objects in Passive Millimeter-Wave Images Based on the Gaussian Mixture Model , 2015 .

[22]  Shuai Ding,et al.  Image Fusion Algorithm Based on Nonsubsampled Contourlet Transform , 2013 .

[23]  Jianyu Yang,et al.  A Novel Image Fusion Algorithm for Visible and PMMW Images based on Clustering and NSCT , 2016 .

[24]  Liangchao Li,et al.  Image fusion algorithm for visible and PMMW images based on EM and Ncut , 2013, 2013 International Conference on Computational Problem-Solving (ICCP).

[25]  Ying Zhu,et al.  Review of Image Fusion Based on Pulse-Coupled Neural Network , 2015, Archives of Computational Methods in Engineering.