A novel image fusion algorithm using an NSCT and a PCNN with digital filtering

ABSTRACT Image fusion is an important task in both image processing and computer vision research that use multisensor processing and multiscale analysis. This paper proposed a novel image fusion algorithm using a nonsubsampled contourlet transform (NSCT) and a pulse-coupled neural network (PCNN) with digital filtering. First, we decomposed two original images into a low-frequency and a series of high-frequency subband coefficients based on the NSCT and repeated that step for the next low-frequency subband. Second, each low-frequency subband coefficient in different levels in the frequency domain for both images was duplicated, and then these low-frequency subband coefficients of different levels from two different images were processed through a Laplacian filter and an average filter. The Laplacian filter can improve the performance of both edge and texture representation; the average filter can implement image smoothing for creating a superior reconstruction of an image via the low-frequency subband coefficients of the frequency domain in image processing. Moreover, the coupling coefficients from different images were fused by using the PCNN. Finally, reconstructed a fused image based on low- and high-frequency subband coefficients in different scales and directions using the inverse NSCT. Experimental results show that the proposed algorithm is superior to state-of-the-art conventional image fusion algorithms.

[1]  Qiang Zhang,et al.  Multifocus image fusion using the nonsubsampled contourlet transform , 2009, Signal Process..

[2]  L. Yang,et al.  Multimodality medical image fusion based on multiscale geometric analysis of contourlet transform , 2008, Neurocomputing.

[3]  Yu Zhang,et al.  Image denoising using SVM classification in nonsubsampled contourlet transform domain , 2013, Inf. Sci..

[4]  John L. Johnson,et al.  PCNN models and applications , 1999, IEEE Trans. Neural Networks.

[5]  Theo Gevers,et al.  Selection and Fusion of Color Models for Image Feature Detection , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Jin Li,et al.  Image Fusion Algorithm Based on Simplified PCNN in Nonsubsampled Contourlet Transform Domain , 2012 .

[7]  Wenzhong Shi,et al.  Multisource Image Fusion Method Using Support Value Transform , 2007, IEEE Transactions on Image Processing.

[8]  Jian-Huang Lai,et al.  Extraction of illumination invariant facial features from a single image using nonsubsampled contourlet transform , 2010, Pattern Recognit..

[9]  Jason Jianjun Gu,et al.  Multi-focus image fusion using PCNN , 2010, Pattern Recognit..

[10]  Matti Pietikäinen,et al.  Multiscale Local Phase Quantization for Robust Component-Based Face Recognition Using Kernel Fusion of Multiple Descriptors , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Jason M. Kinser,et al.  Image Processing using Pulse-Coupled Neural Networks , 1998, Perspectives in Neural Computing.

[12]  Guoan Yang,et al.  A Novel Design Approach for Contourlet Filter Banks , 2010, IEICE Trans. Inf. Syst..

[13]  Paul A. Yushkevich,et al.  Multi-Atlas Segmentation with Joint Label Fusion , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Minh N. Do,et al.  The Nonsubsampled Contourlet Transform: Theory, Design, and Applications , 2006, IEEE Transactions on Image Processing.

[15]  Minh N. Do,et al.  Nonsubsampled contourlet transform: construction and application in enhancement , 2005, IEEE International Conference on Image Processing 2005.

[16]  Xavier Otazu,et al.  Multiresolution-based image fusion with additive wavelet decomposition , 1999, IEEE Trans. Geosci. Remote. Sens..

[17]  Yu-rong Ge,et al.  Image Fusion Algorithm Based on Pulse Coupled Neural Networks and Nonsubsampled Contourlet Transform , 2010, 2010 Second International Workshop on Education Technology and Computer Science.

[18]  Shutao Li,et al.  Hybrid Multiresolution Method for Multisensor Multimodal Image Fusion , 2010, IEEE Sensors Journal.

[19]  Shutao Li,et al.  Multifocus Image Fusion and Restoration With Sparse Representation , 2010, IEEE Transactions on Instrumentation and Measurement.

[20]  Shuyuan Yang,et al.  Fusion of multiparametric SAR images based on SW-nonsubsampled contourlet and PCNN , 2009, Signal Process..

[21]  Jong Beom Ra,et al.  Contrast-Enhanced Fusion of Multisensor Images Using Subband-Decomposed Multiscale Retinex , 2012, IEEE Transactions on Image Processing.

[22]  屈小波 Xiaobo Qu,et al.  Image Fusion Algorithm Based on Spatial Frequency-Motivated Pulse Coupled Neural Networks in Nonsubsampled Contourlet Transform Domain , 2008 .

[23]  Jyh-Cheng Chen,et al.  An Automatic Segmentation and Classification Framework Based on PCNN Model for Single Tooth in MicroCT Images , 2016, PloS one.

[24]  Reinhard Eckhorn,et al.  Feature Linking via Synchronization among Distributed Assemblies: Simulations of Results from Cat Visual Cortex , 1990, Neural Computation.

[25]  Vladimir S. Petrovic,et al.  Gradient-based multiresolution image fusion , 2004, IEEE Transactions on Image Processing.