Image Fusion Based on Multi-objective Optimization

This paper solves the image fusion problem by using a multi-object optimization strategy and a key energy function. The energy function mainly consists of two components. One ensures injection of more correlated detailed spatial information. The detailed information is extracted from gradient representation of the image to be fused. The other one guarantees that the spectral information is preserved by a data fitting term. By minimizing the proposed energy function, the fusion result can be obtained. Moreover, a key parameter is used in the energy function to adjust the weights of the spectral and spatial information during the image fusion. In this paper, a multi-object optimization is constructed to determine such a key parameter. The image fusion performance is evaluated through visional perception and some fusion indexes. Experimental results further demonstrate advantages of the proposed technique over the conventional fusion techniques.

[1]  Paul Scheunders,et al.  A multivalued image wavelet representation based on multiscale fundamental forms , 2002, IEEE Trans. Image Process..

[2]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[3]  Guy Gilboa,et al.  Constrained and SNR-Based Solutions for TV-Hilbert Space Image Denoising , 2006, Journal of Mathematical Imaging and Vision.

[4]  Thomas Brox,et al.  High Accuracy Optical Flow Estimation Based on a Theory for Warping , 2004, ECCV.

[5]  Xavier Otazu,et al.  Multiresolution-based image fusion with additive wavelet decomposition , 1999, IEEE Trans. Geosci. Remote. Sens..

[6]  Horst Bischof,et al.  A Duality Based Approach for Realtime TV-L1 Optical Flow , 2007, DAGM-Symposium.

[7]  ANTONIN CHAMBOLLE,et al.  An Algorithm for Total Variation Minimization and Applications , 2004, Journal of Mathematical Imaging and Vision.

[8]  James Kennedy,et al.  The particle swarm: social adaptation of knowledge , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[9]  Tony F. Chan,et al.  Structure-Texture Image Decomposition—Modeling, Algorithms, and Parameter Selection , 2006, International Journal of Computer Vision.

[10]  Mingqiang Zhu,et al.  An Efficient Primal-Dual Hybrid Gradient Algorithm For Total Variation Image Restoration , 2008 .

[11]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[12]  Te-Ming Tu,et al.  A new look at IHS-like image fusion methods , 2001, Inf. Fusion.

[13]  P Scheunders,et al.  Fusion and merging of multispectral images with use of multiscale fundamental forms. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[14]  V. K. Shettigara,et al.  A generalized component substitution technique for spatial enhancement of multispectral images using , 1992 .

[15]  Paul Scheunders,et al.  Fusion and Merging of Multispectral Images using Multiscale Fundamental Forms , 2001 .

[16]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[17]  R. Schowengerdt CHAPTER 1 – The Nature of Remote Sensing , 1997 .

[18]  Tao Chen,et al.  Image fusion using weighted multiscale fundamental form , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[19]  Jean-Michel Morel,et al.  Fast Cartoon + Texture Image Filters , 2010, IEEE Transactions on Image Processing.

[20]  Stanley Osher,et al.  Modeling Textures with Total Variation Minimization and Oscillating Patterns in Image Processing , 2003, J. Sci. Comput..

[21]  Robert A. Schowengerdt,et al.  Remote sensing, models, and methods for image processing , 1997 .

[22]  Vladimir Petrovic,et al.  Objective image fusion performance measure , 2000 .

[23]  G. Qu,et al.  Information measure for performance of image fusion , 2002 .

[24]  J. Nichol,et al.  Satellite remote sensing for detailed landslide inventories using change detection and image fusion , 2005 .

[25]  Victor Alchanatis,et al.  Image fusion of visible and thermal images for fruit detection. , 2009 .