Image fusion method based on the advection equation

Abstract. We present an innovative method based on the linear advection equation, an important partial differential equation, to perform the fusion of images. The basic idea of this method is to insert the relevant information from other source images into the current source image through an advection process. Furthermore, we present the discrete scheme of this model and compare it with classical fusion approaches, the diffusion equation-based method, and some state-of-the-art fusion approaches on three groups of fusion images that are often used in the image fusion research. The results of experiments show that the fusion method based on the advection equation is comparable with the best of the classical, diffusion-based, and state-of-the-art methods. The high “weighted performance metric” QAB/F of fused images certifies that the relevant information is well injected from the input to the output images. Moreover, this method has fewer adjustable parameters with settings that affect the metric QAB/F less than other methods, and the evolution from input to output is also faster than the diffusion-based method. In addition, this model allows us to cope with noisy source image fusion by adding a diffusion term in the equation, thereby combining the denoising process with the fusion process.

[1]  Yvonne Schuhmacher Image Fusion Theories Techniques And Applications , 2016 .

[2]  P. J. Burt,et al.  The Pyramid as a Structure for Efficient Computation , 1984 .

[3]  Dagoberto S. Freitas,et al.  A VARIATIONAL APPROACH IN THE DISSIPATIVE CUBIC-QUINTIC NONLINEAR SCHRÖDINGER EQUATION , 2002 .

[4]  王小军 Wang Xiaojun,et al.  Multisensor Image Fusion Using Wavelet Based on Contourlet Transform , 2009 .

[5]  Sos S. Agaian,et al.  Multiscale image fusion using an adaptive similarity-based sensor weighting scheme and human visual system-inspired contrast measure , 2012, J. Electronic Imaging.

[6]  Gonzalo Pajares Martinsanz,et al.  A wavelet-based image fusion tutorial , 2004 .

[7]  Romulus Terebes,et al.  Low-level fusion: a PDE-based approach , 2007, 2007 10th International Conference on Information Fusion.

[8]  Vladimir Petrovic,et al.  Objective image fusion performance measure , 2000 .

[9]  Romulus Terebes,et al.  A PDE-Based Approach for Image Fusion , 2007, ACIVS.

[10]  Alexander Toet,et al.  Merging thermal and visual images by a contrast pyramid , 1989 .

[11]  Yi Chai,et al.  Multifocus image fusion and denoising scheme based on homogeneity similarity , 2012 .

[12]  Todd Wittman,et al.  A variational approach to hyperspectral image fusion , 2009, Defense + Commercial Sensing.

[13]  Sebastien Guillon,et al.  A PDE-Based Approach to Three-Dimensional Seismic Data Fusion , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Guofan Jin,et al.  Fusion of noisy infrared and visible images based on anisotropic bivariate shrinkage , 2011 .

[15]  Gemma Piella,et al.  Image Fusion for Enhanced Visualization: A Variational Approach , 2009, International Journal of Computer Vision.

[16]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Lawrence B. Wolff,et al.  Multispectral image visualization through first-order fusion , 2002, IEEE Trans. Image Process..

[18]  Alexander Toet,et al.  Image fusion by a ration of low-pass pyramid , 1989, Pattern Recognit. Lett..

[19]  Xiangzhi Bai Morphological image fusion using the extracted image regions and details based on multi-scale top-hat transform and toggle contrast operator , 2013, Digit. Signal Process..

[20]  Cedric Nishan Canagarajah,et al.  Pixel- and region-based image fusion with complex wavelets , 2007, Inf. Fusion.

[21]  P. Lions,et al.  Image selective smoothing and edge detection by nonlinear diffusion. II , 1992 .

[22]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[23]  Laura Igual,et al.  A Variational Model for P+XS Image Fusion , 2006, International Journal of Computer Vision.

[24]  S. Pop,et al.  A new discrete PDE-based fusion model , 2009, IEEE EUROCON 2009.