Spiking cortical model for multifocus image fusion

Spiking Cortical Model (SCM) is derived from primate visual cortex. It has a high sensitivity for low intensities of stimulus, but low sensitivity for high intensities, and is suitable for image processing. This paper adopts an improved SCM for multifocus image fusion. Firstly we analyze and compare various image clarity measures, and then we propose a new SCM fusion method based on a composite image clarity criterion which synthesizes virtues of two classic clarity criteria. As to the iteration number of SCM model for image processing, we introduce time matrix as an adaptive setting method instead of using fixed constant, which can automatically and adaptively calculate iteration number for each image accurately. Besides, we optimize pulsing output matrix of source image according to natural optical focus principle before forming and outputting the final fused image. In order to verify the effectiveness of the proposed method, we compare it with other ten methods under four fusion effect evaluation indices. The experimental results show that the proposed approach can obtain better fusion results than others, and is an effective multifocus image fusion method.

[1]  John L. Johnson.  Pulse-coupled neural networks , 1994, Defense + Commercial Sensing.

[2]  Jason M. Kinser,et al.  Simplified pulse-coupled neural network , 1996, Defense + Commercial Sensing.

[3]  Reinhard Eckhorn,et al.  Feature Linking via Synchronization among Distributed Assemblies: Simulations of Results from Cat Visual Cortex , 1990, Neural Computation.

[4]  Wei Li,et al.  A new image fusion algorithm based on wavelet packet analysis and PCNN , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[5]  Dheeraj Agrawal,et al.  Multifocus image fusion using modified pulse coupled neural network for improved image quality , 2010 .

[6]  Zhongliang Jing,et al.  Evaluation of focus measures in multi-focus image fusion , 2007, Pattern Recognit. Lett..

[7]  G. Qu,et al.  Information measure for performance of image fusion , 2002 .

[8]  Yaonan Wang,et al.  Combination of images with diverse focuses using the spatial frequency , 2001, Inf. Fusion.

[9]  Shree K. Nayar,et al.  Shape from Focus , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Jason M. Kinser,et al.  Image Processing using Pulse-Coupled Neural Networks , 1998, Perspectives in Neural Computing.

[11]  Yide Ma,et al.  Review of pulse-coupled neural networks , 2010, Image Vis. Comput..

[12]  Wei Cai,et al.  Pulse Coupled Neural Network Based Image Fusion , 2005, ISNN.

[13]  Yide Ma,et al.  New Spiking Cortical Model for Invariant Texture Retrieval and Image Processing , 2009, IEEE Transactions on Neural Networks.

[14]  Jason M. Kinser,et al.  The intersecting cortical model in image processing , 2004 .

[15]  Jeffery Johnson,et al.  Pulse coupled neural networks for image processing , 1995, Proceedings IEEE Southeastcon '95. Visualize the Future.

[16]  Yide Ma,et al.  A Novel Algorithm of Image Enhancement Based on Pulse Coupled Neural Network Time Matrix and Rough Set , 2007, Fourth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD 2007).

[17]  Qiguang Miao,et al.  A novel adaptive multi-focus image fusion algorithm based on PCNN and sharpness , 2005, SPIE Defense + Commercial Sensing.

[18]  Yide Ma,et al.  Applications of Pulse-Coupled Neural Networks , 2011 .

[19]  Heggere S. Ranganath,et al.  Perfect image segmentation using pulse coupled neural networks , 1999, IEEE Trans. Neural Networks.

[20]  Sim Heng Ong,et al.  Autofocusing for tissue microscopy , 1993, Image Vis. Comput..

[21]  Yide Ma,et al.  Medical image fusion using m-PCNN , 2008, Inf. Fusion.

[22]  Zhongliang Jing,et al.  Multi-focus image fusion using pulse coupled neural network , 2007, Pattern Recognit. Lett..

[23]  W. Kong,et al.  Image fusion technique based on non-subsampled contourlet transform and adaptive unit-fast-linking pulse-coupled neural network , 2011 .

[24]  Yaonan Wang,et al.  Multifocus image fusion using artificial neural networks , 2002, Pattern Recognit. Lett..

[25]  Mark E. Oxley,et al.  Physiologically motivated image fusion for object detection using a pulse coupled neural network , 1999, IEEE Trans. Neural Networks.

[26]  I. Mokris,et al.  Feature generation improving by optimized PCNN , 2008, 2008 6th International Symposium on Applied Machine Intelligence and Informatics.

[27]  Yun Zhang,et al.  Wavelet based image fusion techniques — An introduction, review and comparison , 2007 .

[28]  Sam Kavusi,et al.  Computationally efficient algorithm for multifocus image reconstruction , 2003, IS&T/SPIE Electronic Imaging.