Image fusion with Internal Generative Mechanism

The Internal Generative Mechanism is brought into image fusion.A refined saliency detection method is proposed.Experiments on various images tested the effectiveness of the algorithm. In this paper, an Internal Generative Mechanism (IGM) based fusion algorithm is proposed. In the algorithm, source images are decomposed into a coarse layer and a detail layer by simulating the mechanism of human visual system perceiving images; then, the algorithm fuses the detail layer using Pulse Coupled Neural Network (PCNN), and fuses the coarse layer by using the spectral residual based saliency method; finally, coefficients in all the fused layers are combined to obtain the final fused image. The interests of the algorithm lie in the fact that it accords with the basic principles of human visual system perceiving images and it can preserve detail information that exists in source images. Experiments on various images are conducted to test the effectiveness of the algorithm. The experimental results have shown that the final images fused by the proposed algorithm achieve satisfying visual perception; meanwhile, the algorithm is superior to other traditional algorithms in terms of objective measures.

[1]  Simon X. Yang,et al.  A Novel approach for Multimodal Medical Image Fusion using Hybrid Fusion Algorithms for Disease Analysis , 2017 .

[2]  Li Wei,et al.  Research on fusion method for infrared and visible images via compressive sensing , 2013 .

[3]  Zhongliang Jing,et al.  Evaluation of focus measures in multi-focus image fusion , 2007, Pattern Recognit. Lett..

[4]  Vladimir Petrovic,et al.  Objective evaluation of signal-level image fusion performance , 2005 .

[5]  Jing Tian,et al.  SAR and Multispectral Image Fusion Using Generalized IHS Transform Based on à Trous Wavelet and EMD Decompositions , 2010, IEEE Sensors Journal.

[6]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[7]  Zheng Liu,et al.  Directive Contrast Based Multimodal Medical Image Fusion in NSCT Domain , 2013, IEEE Transactions on Multimedia.

[8]  Yaonan Wang,et al.  Combination of images with diverse focuses using the spatial frequency , 2001, Inf. Fusion.

[9]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Thomas Fechner,et al.  Pixel-level image fusion: the case of image sequences , 1998, Defense, Security, and Sensing.

[11]  Zhou Wang,et al.  Modern Image Quality Assessment , 2006, Modern Image Quality Assessment.

[12]  Mei Yang,et al.  Multi-focus image fusion algorithm based on shearlets , 2011 .

[13]  Sim Heng Ong,et al.  Autofocusing for tissue microscopy , 1993, Image Vis. Comput..

[14]  Manjunath V. Joshi,et al.  Multiresolution Image Fusion: Use of Compressive Sensing and Graph Cuts , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[15]  Yuanyuan Wang,et al.  Biological image fusion using a NSCT based variable-weight method , 2011, Inf. Fusion.

[16]  Shutao Li,et al.  Multifocus image fusion using region segmentation and spatial frequency , 2008, Image Vis. Comput..

[17]  Shree K. Nayar,et al.  Shape from Focus , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Zhaodong Liu,et al.  A novel fusion scheme for visible and infrared images based on compressive sensing , 2015 .

[19]  Karim Faez,et al.  Infrared and visible image fusion using fuzzy logic and population-based optimization , 2012, Appl. Soft Comput..

[20]  Sarat Kumar Sahoo,et al.  Pulse coupled neural networks and its applications , 2014, Expert Syst. Appl..

[21]  Danilo P. Mandic,et al.  Multiscale Image Fusion Using Complex Extensions of EMD , 2009, IEEE Transactions on Signal Processing.

[22]  Shutao Li,et al.  Image matting for fusion of multi-focus images in dynamic scenes , 2013, Inf. Fusion.

[23]  Bhabatosh Chanda,et al.  Multi-focus image fusion using a morphology-based focus measure in a quad-tree structure , 2013, Inf. Fusion.

[24]  Anup Basu,et al.  Cross-Scale Coefficient Selection for Volumetric Medical Image Fusion , 2013, IEEE Transactions on Biomedical Engineering.

[25]  Alan C. Bovik,et al.  Image information and visual quality , 2006, IEEE Trans. Image Process..

[26]  Shutao Li,et al.  Image Fusion With Guided Filtering , 2013, IEEE Transactions on Image Processing.

[27]  G. Qu,et al.  Information measure for performance of image fusion , 2002 .

[28]  Wenzhong Shi,et al.  Multisource Image Fusion Method Using Support Value Transform , 2007, IEEE Transactions on Image Processing.

[29]  Shutao Li,et al.  Remote Sensing Image Fusion via Sparse Representations Over Learned Dictionaries , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Shao Zhenfeng,et al.  Fusion of infrared and visible images based on focus measure operators in the curvelet domain. , 2012, Applied optics.

[31]  Yu Han,et al.  A new image fusion performance metric based on visual information fidelity , 2013, Inf. Fusion.

[32]  Shuyuan Yang,et al.  Image fusion based on a new contourlet packet , 2010, Inf. Fusion.

[33]  Xiongfei Li,et al.  Multi-focus image fusion using image-partition-based focus detection , 2014, Signal Process..

[34]  Guangming Shi,et al.  Perceptual Quality Metric With Internal Generative Mechanism , 2013, IEEE Transactions on Image Processing.

[35]  Weisi Lin,et al.  A Psychovisual Quality Metric in Free-Energy Principle , 2012, IEEE Transactions on Image Processing.