An Image Fusion Method Based on NSCT and Dual-channel PCNN Model

NSCT is one of useful multiscale geometric analysis tools, which takes full advantage of geometric regularity of image intrinsic structures. The dual-channel PCNN is a simplified PCNN model, which can process multiple images by a single PCNN. This saves time in the process of image fusion and cuts down computational complexity. In this paper, we present a new image fusion scheme based on NSCT and dual-channel PCNN. Firstly, the fusion rules of subband coefficients of NSCT are discussed. For the fusion rule of low frequency coefficients, the maximum selection rule (MSR) is used. Then, for the fusion rule of high frequency coefficients, spatial frequency (SF) of each high frequency subband is considered as the gradient features of images to motivate dual-channel PCNN networks and generate pulse of neurons. At last, fused image is obtained by using the inverse NSCT transform. In order to show that the proposed method can deal with image fusion, we used two pairs of images as our experimental subjects. The proposed method is compared with other five methods. The performance of various methods is mathematically evaluated by using four image quality evaluation criteria. Experimental comparisons conducted on different fusion methods prove the effectiveness of the proposed fusion method

[1]  Yide Ma,et al.  Medical image fusion using m-PCNN , 2008, Inf. Fusion.

[2]  Nian Yi Wang,et al.  A New Image Fusion Method Based on Improved PCNN and Multiscale Decomposition , 2013 .

[3]  Paul S. Fisher,et al.  Image quality measures and their performance , 1995, IEEE Trans. Commun..

[4]  Yide Ma,et al.  Review of pulse-coupled neural networks , 2010, Image Vis. Comput..

[5]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[6]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[7]  Wen-Rong Wu,et al.  Image Contrast Enhancement Based on a Histogram Transformation of Local Standard Deviation , 1998, IEEE Trans. Medical Imaging.

[8]  Zhang Baohua,et al.  A multi-focus image fusion algorithm based on an improved dual-channel PCNN in NSCT domain , 2013 .

[9]  Veysel Aslantas,et al.  A comparison of criterion functions for fusion of multi-focus noisy images , 2009 .

[10]  Minh N. Do,et al.  The Nonsubsampled Contourlet Transform: Theory, Design, and Applications , 2006, IEEE Transactions on Image Processing.

[11]  Wang Hongmei Multi-focus image fusion method based on Contourlet transform , 2009 .

[12]  Mark E. Oxley,et al.  Physiologically motivated image fusion for object detection using a pulse coupled neural network , 1999, IEEE Trans. Neural Networks.

[13]  Wei Li,et al.  A new image fusion algorithm based on wavelet packet analysis and PCNN , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[14]  G. Qu,et al.  Information measure for performance of image fusion , 2002 .

[15]  Zheng Liu,et al.  Human visual system inspired multi-modal medical image fusion framework , 2013, Expert Syst. Appl..

[16]  Minh N. Do,et al.  Framing pyramids , 2003, IEEE Trans. Signal Process..

[17]  Vladimir Petrovic,et al.  Objective image fusion performance measure , 2000 .