An Image Fusion Framework Based on Human Visual System in Framelet Domain

In this paper, a novel image fusion algorithm based on framelet transform is presented. The core idea is to decompose all the images to be fused into low and high-frequency bands using framelet transform. For fusion, two different selection strategies are developed and used for low and high-frequency bands. The first strategy is adaptive weighted average based on local energy and is applied to fuse the low-frequency bands. In order to fuse high-frequency bands, a new strategy is developed based on texture while exploiting the human visual system characteristics, which can preserve more details in source images and further improve the quality of fused image. Experimental results demonstrate the efficiency and better performance than existing image fusion methods both in visual inspection and objective evaluation criteria.

[1]  Nikolaos Mitianoudis,et al.  Adaptive Image Fusion Using Ica Bases , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[2]  Balasubramanian Raman,et al.  A New Image Fusion Technique Based on Directive Contrast , 2009 .

[3]  Gaurav Bhatnagar,et al.  Real Time Human Visual System Based Framework for Image Fusion , 2010, ICISP.

[4]  Shutao Li,et al.  Multisensor Remote Sensing Image Fusion Using Stationary Wavelet Transform: Effects of Basis and Decomposition Level , 2008, Int. J. Wavelets Multiresolution Inf. Process..

[5]  Thierry Pun,et al.  A Stochastic Approach to Content Adaptive Digital Image Watermarking , 1999, Information Hiding.

[6]  Jiaxiong Peng,et al.  Image Fusion Method Based on Short Support Symmetric Non-Separable Wavelet , 2004, Int. J. Wavelets Multiresolution Inf. Process..

[7]  Vladimir S. Petrovic,et al.  Gradient-based multiresolution image fusion , 2004, IEEE Transactions on Image Processing.

[8]  Robert Krupinski,et al.  Approximated fast estimator for the shape parameter of generalized Gaussian distribution for a small sample size , 2015 .

[9]  Vladimir S. Petrovic,et al.  Objective pixel-level image fusion performance measure , 2000, SPIE Defense + Commercial Sensing.

[10]  Q Guihong,et al.  Medical image fusion by wavelet transform modulus maxima. , 2001, Optics express.

[11]  Peter J. Burt,et al.  Enhanced image capture through fusion , 1993, 1993 (4th) International Conference on Computer Vision.

[12]  Ivan W. Selesnick,et al.  Iterated oversampled filter banks and wavelet frames , 2000, SPIE Optics + Photonics.

[13]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[14]  Hong Li.  Wavelet-Based Weighted Average and Human Vision System Image Fusion , 2006, Int. J. Wavelets Multiresolution Inf. Process..

[15]  Jian Liu,et al.  A Novel Image Fusion Approach Based on Wavelet Transform and Fuzzy Logic , 2006, Int. J. Wavelets Multiresolution Inf. Process..

[16]  Vladimir Petrovic,et al.  Objective image fusion performance measure , 2000 .

[17]  I. Selesnick,et al.  Symmetric wavelet tight frames with two generators , 2004 .

[18]  G. Nason,et al.  A statistical multiscale approach to image segmentation and fusion , 2005, 2005 7th International Conference on Information Fusion.

[19]  P. Vaidyanathan.  Multirate Systems And Filter Banks , 1992 .

[20]  Gang Liu,et al.  A region-based image fusion algorithm using multiresolution segmentation , 2003, Proceedings of the 2003 IEEE International Conference on Intelligent Transportation Systems.

[21]  Gaurav Bhatnagar,et al.  Distributed Multiresolution Discrete Fourier Transform and its Application to Watermarking , 2010, Int. J. Wavelets Multiresolution Inf. Process..

[22]  C. Chui,et al.  Compactly supported tight frames associated with refinable functions , 2000 .

[23]  James Llinas,et al.  An introduction to multisensor data fusion , 1997, Proc. IEEE.

[24]  Shouzhi Yang,et al.  Construction of compactly Supported Conjugate Symmetric Complex Tight Wavelet Frames , 2010, Int. J. Wavelets Multiresolution Inf. Process..

[25]  P. Chavez,et al.  Extracting spectral contrast in landsat thematic mapper image data using selective principal component analysis , 1989 .

[26]  Gaurav Bhatnagar,et al.  A new Contrast Based Image Fusion using Wavelet Packets , 2008, ArXiv.

[27]  Feng-Ying Zhou,et al.  Gmra-Based Construction of Framelets in Reducing Subspaces of L2(ℝd) , 2011, Int. J. Wavelets Multiresolution Inf. Process..

[28]  Uday B. Desai,et al.  Fusion of Surveillance Images in Infrared and Visible Band Using Curvelet, Wavelet and Wavelet Packet Transform , 2010, Int. J. Wavelets Multiresolution Inf. Process..