Multi-sensor image fusion based on statistical features and wavelet transform

In this paper, we have proposed a novel feature based fusion algorithm which integrates the fusion technique of low pass and high pass wavelet coefficients. First we have decomposed source images into discrete wavelet decomposition coefficients. Thereafter, approximation coefficients are partition into n number of blocks and features are extracted from each block in the coefficients. Two same correspondence blocks features are then combined to make a feature matrix M. Finally, the weight is computed by applying the principle component analysis (PCA) on the feature matrix M to fuse the same corresponding blocks. After fusion of n blocks, they are combined to get final fused low pass coefficients. In the next phase, all the details or high pass coefficients are fused by computing the relative information of the coefficients and activity measure of each pixel in the neighborhood. Finally, the new coefficient matrix is obtained by concatenating fused approximation and details coefficients and the fused image is reconstructed using inverse wavelet transform. To verify the superiority of our proposed algorithm, we have tested it on 100 pair different sensor images collected from Manchester University UK databases. Finally, the proposed algorithm is compared with one existing algorithm and it performs better in terms of subjective and objective perception.

[1]  Rick S. Blum,et al.  Multi-sensor image fusion and its applications , 2005 .

[2]  Vladimir Petrovic,et al.  Objective image fusion performance measure , 2000 .

[3]  Aleksandra Pizurica,et al.  Extending the Depth of Field in Microscopy Through Curvelet-Based Frequency-Adaptive Image Fusion , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[4]  Jacqueline Le Moigne Multi-Sensor Image Fusion and Its Applications , 2005 .

[5]  Alexander Toet,et al.  A morphological pyramidal image decomposition , 1989, Pattern Recognit. Lett..

[6]  Gemma Piella,et al.  A region-based multiresolution image fusion algorithm , 2002, Proceedings of the Fifth International Conference on Information Fusion. FUSION 2002. (IEEE Cat.No.02EX5997).

[7]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[8]  Shutao Li,et al.  Image Fusion Using Nonsubsampled Contourlet Transform , 2007, Fourth International Conference on Image and Graphics (ICIG 2007).

[9]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[10]  Lei Deng,et al.  An image fusion method based on region segmentation and wavelet transform , 2012, 2012 20th International Conference on Geoinformatics.

[11]  Hadi Seyedarabi,et al.  A non-reference image fusion metric based on mutual information of image features , 2011, Comput. Electr. Eng..

[12]  Jamal Saeedi,et al.  The new segmentation and fuzzy logic based multi-sensor image fusion , 2009, 2009 24th International Conference Image and Vision Computing New Zealand.

[13]  B. S. Manjunath,et al.  Multi-sensor image fusion using the wavelet transform , 1994, Proceedings of 1st International Conference on Image Processing.

[14]  Ruiquan Mao,et al.  Image fusion algorithm based on arbitrary shaped regions combination , 2010, 2010 International Conference on Intelligent Control and Information Processing.

[15]  Richard Baraniuk,et al.  The Dual-tree Complex Wavelet Transform , 2007 .

[16]  B. Luo,et al.  Large-Scale Graph Database Indexing Based on T-mixture Model and ICA , 2007, Fourth International Conference on Image and Graphics (ICIG 2007).

[17]  Ma Li A multi-focus image fusion algorithm based on image pixel clarity , 2009 .