Multispectral image fusion based on diffusion morphology for enhanced vision applications

Existing image fusion methods based on morphological image analysis, that expresses the geometrical idea of image shape as a label image, are quite sensitive to the quality of image segmentation and, therefore, not sufficiently robust to noise and high frequency distortions. On the other hand, there are a number of methods in the field of dimensionality reduction and data comparison that give possibility of avoiding an image segmentation step by using diffusion maps techniques. The paper proposes a new approach for multispectral image fusion based on the combination of morphological image analysis and diffusion maps theory (i.e. Diffusion Morphology). A new image fusion algorithm is described that uses a matched diffusion filtering procedure instead of morphological projection. The algorithm is implemented for a three channels Enhanced Vision System prototype. The comparative results of image fusion are shown on real images acquired in flight experiments.

[1]  N. Canagarajah,et al.  Wavelets for Image Fusion , 2001 .

[2]  Hua Huang,et al.  No-reference image quality assessment based on spatial and spectral entropies , 2014, Signal Process. Image Commun..

[3]  S. Yu. Zheltov,et al.  SHAPE-BASED IMAGE MATCHING USING HEAT KERNELS AND DIFFUSION MAPS , 2014 .

[4]  Nikolaos Mitianoudis,et al.  Pixel-based and region-based image fusion schemes using ICA bases , 2007, Inf. Fusion.

[5]  Ammad Ali,et al.  Face Recognition with Local Binary Patterns , 2012 .

[6]  Stéphane Lafon,et al.  Diffusion maps , 2006 .

[7]  Tee-Ann Teo,et al.  Pyramid-based image empirical mode decomposition for the fusion of multispectral and panchromatic images , 2012, EURASIP J. Adv. Signal Process..

[8]  Jean-Yves Tourneret,et al.  Bayesian Fusion of Multi-Band Images , 2013, IEEE Journal of Selected Topics in Signal Processing.

[9]  Ronald R. Coifman,et al.  Geometries of sensor outputs, inference, and information processing , 2006, SPIE Defense + Commercial Sensing.

[10]  Cedric Nishan Canagarajah,et al.  Pixel- and region-based image fusion with complex wavelets , 2007, Inf. Fusion.

[11]  Bala Venkatesh,et al.  Morphological image analysis of transmission systems , 2005 .

[12]  L. M. Mestetskiy,et al.  Morphological Image Analysis for Computer Vision Applications , 2015 .

[13]  Alan C. Bovik,et al.  Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality , 2011, IEEE Transactions on Image Processing.

[14]  Junping Du,et al.  Feature-Based Image Fusion with a Uniform Discrete Curvelet Transform , 2013 .

[15]  O. V. Vygolov,et al.  Enhanced, Synthetic and Combined Vision Technologies for Civil Aviation , 2015 .

[16]  Karim Faez,et al.  Infrared and visible image fusion using fuzzy logic and population-based optimization , 2012, Appl. Soft Comput..

[17]  Haixu Wang,et al.  Multimodal medical image fusion based on IHS and PCA , 2010 .

[18]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[19]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.