A novel image fusion algorithm based on human vision system

The proposed new fusion algorithm is based on the improved pulse coupled neural network(PCNN) model, the fundamental characteristics of images and the properties of human vision system. Compared with the traditional algorithm where the linking strength of each neuron is the same and its value is chosen through experimentation, this algorithm uses the contrast of each pixel as its value, so that the linking strength of each pixel can be chosen adaptively. After the processing of PCNN with the adaptive linking strength, new fire mapping images are obtained for each image taking part in the fusion. The clear objects of each original image are decided by the compare-selection operator with the fire mapping images pixel by pixel and then all of them are merged into a new clear image. Furthermore, by this algorithm, other parameters, for example, Δ, the threshold adjusting constant, only have a slight effect on the new fused image. It therefore overcomes the difficulty in adjusting parameters in PCNN. Experiments show that the proposed algorithm works better in preserving the edge and texture information than the wavelet transform method and the Laplacian pyramid method do image fusion.

[1]  John L. Johnson,et al.  PCNN models and applications , 1999, IEEE Trans. Neural Networks.

[2]  Eugene M. Izhikevich,et al.  Weakly pulse-coupled oscillators, FM interactions, synchronization, and oscillatory associative memory , 1999, IEEE Trans. Neural Networks.

[3]  Erik Blasch,et al.  Biological information fusion using a PCNN and belief filtering , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[4]  Alexander Toet,et al.  Merging thermal and visual images by a contrast pyramid , 1989 .

[5]  Shi Mei-hong.  A METHOD OF IMAGE GAUSS NOISE FILTERING BASED ON PCNN , 2002 .

[6]  Gu Xiaodong.  Image Pre-processing Based Rough Set and PCNN , 2003 .

[7]  Mark E. Oxley,et al.  Physiologically motivated image fusion for object detection using a pulse coupled neural network , 1999, IEEE Trans. Neural Networks.

[8]  Reinhard Eckhorn,et al.  Neural mechanisms of scene segmentation: recordings from the visual cortex suggest basic circuits for linking field models , 1999, IEEE Trans. Neural Networks.

[9]  Fang Qing,et al.  Contrast-Based Multiresolution Image Fusion , 2000 .

[10]  Dai Ruo-lan,et al.  Automated image segmentation using pulse coupled neural networks and images entropy , 2002 .

[11]  Shi Mei-hong.  Image Binary Segmentation Based on Improved PCNN Mode , 2002 .

[12]  Zhe Chen,et al.  A multisensor image fusion algorithm based on PCNN , 2004, Fifth World Congress on Intelligent Control and Automation (IEEE Cat. No.04EX788).