Algorithm for image fusion based on orthogonal grouplet transform and pulse-coupled neural network

Abstract. Orthogonal grouplet transformation is a kind of weighted multiscale Haar transform. It can effectively approximate the geometric structure of any shape in a small region or one with long association. Pulse-coupled neural network (PCNN), a simplified neural network, is able to extract useful information from a complex background without learning or training. In order to get better fusion effect, grouplet transform is applied for its advantage of describing complex edges or texture, and then coefficients are fused by PCNN. An algorithm named GT-PCNN based on grouplet transform and PCNN is proposed. It defines a coefficient fusion rule based on fire times and an association field fusion rule based on regional fire variance. The image fused by GT-PCNN has clear edges and texture and the overall effect looks good. Indicators of average gray, entropy, and mutual information are all better than those of the average algorithm, the principal component analysis algorithm and the algorithm based on wavelet transform and PCNN.

[1]  M. Uschold,et al.  Methods and applications , 1953 .

[2]  Reinhard Eckhorn,et al.  Feature Linking via Synchronization among Distributed Assemblies: Simulations of Results from Cat Visual Cortex , 1990, Neural Computation.

[3]  Stéphane Mallat,et al.  Sparse geometric image representations with bandelets , 2005, IEEE Transactions on Image Processing.

[4]  Pascal Vasseur,et al.  Introduction to Multisensor Data Fusion , 2005, The Industrial Information Technology Handbook.

[5]  Q Guihong,et al.  Medical image fusion by wavelet transform modulus maxima. , 2001, Optics express.

[6]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[7]  John L. Johnson,et al.  PCNN models and applications , 1999, IEEE Trans. Neural Networks.

[8]  Shutao Li,et al.  Multifocus image fusion by combining curvelet and wavelet transform , 2008, Pattern Recognit. Lett..

[9]  Jingwen Yan,et al.  A novel image fusion algorithm based on bandelet transform , 2007 .

[10]  Liu Qing,et al.  Automated image segmentation using improved PCNN model based on cross-entropy , 2004, Proceedings of 2004 International Symposium on Intelligent Multimedia, Video and Speech Processing, 2004..

[11]  Lorenzo Bruzzone,et al.  Image fusion techniques for remote sensing applications , 2002, Inf. Fusion.

[12]  Heggere S. Ranganath,et al.  Perfect image segmentation using pulse coupled neural networks , 1999, IEEE Trans. Neural Networks.

[13]  Ali Mohammad-Djafari,et al.  Image fusion and unsupervised joint segmentation using a HMM and MCMC algorithms , 2005, J. Electronic Imaging.

[14]  Takahiro Saito,et al.  Image denoising with hard color-shrinkage and grouplet transform , 2010, 28th Picture Coding Symposium.

[15]  Kosei Ishimura,et al.  Synchronized oscillation and dynamical clustering in chaotic PCNN , 2002, Proceedings of the 41st SICE Annual Conference. SICE 2002..

[16]  Shuai Ding,et al.  Image Fusion Algorithm Based on Nonsubsampled Contourlet Transform , 2013 .

[17]  Longquan Dai,et al.  Image denoising with Grouplet transform , 2010, 2010 2nd International Conference on Advanced Computer Control.

[18]  屈小波 Xiaobo Qu,et al.  Image Fusion Algorithm Based on Spatial Frequency-Motivated Pulse Coupled Neural Networks in Nonsubsampled Contourlet Transform Domain , 2008 .

[19]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[20]  Hayder Radha,et al.  Computational Photography: Methods and Applications , 2010, J. Electronic Imaging.

[21]  Sebastiano Battiato,et al.  Adaptive image data fusion for consumer devices application , 2004, IEEE 6th Workshop on Multimedia Signal Processing, 2004..

[22]  Rastislav Lukac.  Computational Photography: Methods and Applications , 2010 .

[23]  D. Donoho.  Wedgelets: nearly minimax estimation of edges , 1999 .

[24]  Wei Li,et al.  A new image fusion algorithm based on wavelet packet analysis and PCNN , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[25]  Mehran Yazdi,et al.  A Novel Image Fusion Method Using Curvelet Transform Based on Linear Dependency Test , 2009, 2009 International Conference on Digital Image Processing.

[26]  M. L. Padgett,et al.  Pulse coupled neural networks (PCNN) and wavelets: biosensor applications , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[27]  Xiaodong Gu,et al.  Orientation Detection and Attention Selection based Unit-linking PCNN , 2005, 2005 International Conference on Neural Networks and Brain.

[28]  Yi Chai,et al.  Multifocus image fusion scheme based on features of multiscale products and PCNN in lifting stationary wavelet domain , 2011 .

[29]  James Llinas,et al.  An introduction to multisensor data fusion , 1997, Proc. IEEE.

[30]  Aldo Maalouf,et al.  Colour image super-resolution using geometric grouplets , 2012 .

[31]  E. Candès,et al.  Curvelets: A Surprisingly Effective Nonadaptive Representation for Objects with Edges , 2000 .

[32]  Christine Fernandez-Maloigne,et al.  A grouplet-based reduced reference image quality assessment , 2009, 2009 International Workshop on Quality of Multimedia Experience.

[33]  Fei-Fei Li,et al.  Grouplet: A structured image representation for recognizing human and object interactions , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.