Variational model-based very high spatial resolution remote sensing image fusion

Abstract A remote sensing image fusion technique provides a mechanism for integrating multiple remotely sensed images to form an innovative image by using a certain algorithm for improving the spatial quality of the source image with minimal spectral distortion. Many algorithms, known as pan-sharpening algorithms, have been developed to improve the spatial resolution of multispectral (MS) images with a panchromatic (Pan) image. In the standard fusion methods, high spectral quality implies low spatial quality and vice versa. The utility of one Pan-sharpening model based on the variational model (VM) that consists of several energy terms is tested on very high spatial resolution images. In this model, the geometric structure matching term is used to inject the geometric structure of the Pan image, and the spectral matching term is utilized for preserving the spectral information. To balance the tradeoff between injecting the spatial information and preserving the spectral information, a static and a dynamic weight paradigm were introduced in this paper to control their relative contributions (static weights VM and dynamic weights VM). The evaluation of the experimental results on the QuickBird and WorldView-2 datasets shows that VM-based fusion models are better than the principal component analysis, Brovey transform fusion model, and Wavelet fusion model, and the dynamic weights VM performs better than the static weights VM. VM-based fusion models could be good options for very high spatial resolution remote sensing image fusion.

[1]  Te-Ming Tu,et al.  A fast intensity-hue-saturation fusion technique with spectral adjustment for IKONOS imagery , 2004, IEEE Geoscience and Remote Sensing Letters.

[2]  Y. Zhang,et al.  A new merging method and its spectral and spatial effects , 1999 .

[3]  J. Rolet,et al.  Extraction of spectral information from Landsat TM data and merger with SPOT panchromatic imagery: a contribution to the study of geological structures , 1993 .

[4]  Mario Lillo-Saavedra,et al.  Spectral or spatial quality for fused satellite imagery? A trade‐off solution using the wavelet à trous algorithm , 2006 .

[5]  Nicolas H. Younan,et al.  Quality analysis of pansharpened images , 2004, IGARSS 2004. 2004 IEEE International Geoscience and Remote Sensing Symposium.

[6]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[7]  D. Yocky Multiresolution wavelet decomposition image merger of landsat thematic mapper and SPOT panchromatic data , 1996 .

[8]  K. Nikolakopoulos Comparison of Nine Fusion Techniques for Very High Resolution Data , 2008 .

[9]  A. H. J. M. Pellemans,et al.  MERGING MULTISPECTRAL AND PANCHROMATIC SPOT IMAGES WITH RESPECT TO THE RADIOMETRIC PROPERTIES OF THE SENSOR , 1993 .

[10]  Jean-Michel Morel,et al.  Geometry and Color in Natural Images , 2002, Journal of Mathematical Imaging and Vision.

[11]  Yun Zhang,et al.  Wavelet based image fusion techniques — An introduction, review and comparison , 2007 .

[12]  Te-Ming Tu,et al.  Best Tradeoff for High-Resolution Image Fusion to Preserve Spatial Details and Minimize Color Distortion , 2007, IEEE Geoscience and Remote Sensing Letters.

[13]  José A. Malpica,et al.  Hue Adjustment to IHS Pan-Sharpened IKONOS Imagery for Vegetation Enhancement , 2007, IEEE Geoscience and Remote Sensing Letters.

[14]  Myungjin Choi,et al.  A new intensity-hue-saturation fusion approach to image fusion with a tradeoff parameter , 2006, IEEE Trans. Geosci. Remote. Sens..

[15]  Jocelyn Chanussot,et al.  Comparison of Pansharpening Algorithms: Outcome of the 2006 GRS-S Data-Fusion Contest , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Laura Igual,et al.  A Variational Model for P+XS Image Fusion , 2006, International Journal of Computer Vision.

[17]  J. E. Bare,et al.  Application of the IHS color transform to the processing of multisensor data and image enhancement , 1982 .

[18]  Nebiye Musaoglu,et al.  Merging hyperspectral and panchromatic image data: qualitative and quantitative analysis , 2009 .

[19]  Jocelyn Chanussot,et al.  Synthesis of Multispectral Images to High Spatial Resolution: A Critical Review of Fusion Methods Based on Remote Sensing Physics , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Alan R. Gillespie,et al.  Color enhancement of highly correlated images. II. Channel ratio and “chromaticity” transformation techniques , 1987 .

[21]  L. Wald,et al.  Fusion of high spatial and spectral resolution images : The ARSIS concept and its implementation , 2000 .

[22]  Bo Huang,et al.  Unified fusion of remote-sensing imagery: generating simultaneously high-resolution synthetic spatial–temporal–spectral earth observations , 2013 .

[23]  Xavier Otazu,et al.  Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Dafang Zhuang,et al.  Advances in Multi-Sensor Data Fusion: Algorithms and Applications , 2009, Sensors.

[25]  J. G. Liu,et al.  Smoothing Filter-based Intensity Modulation: A spectral preserve image fusion technique for improving spatial details , 2000 .

[26]  Christine Pohl,et al.  Multisensor image fusion in remote sensing: concepts, methods and applications , 1998 .

[27]  D. G. Clayton,et al.  Gram‐Schmidt Orthogonalization , 1971 .

[28]  V. Karathanassi,et al.  A comparison study on fusion methods using evaluation indicators , 2007 .

[29]  J. Zhou,et al.  A wavelet transform method to merge Landsat TM and SPOT panchromatic data , 1998 .

[30]  Yun Zhang,et al.  An IHS and wavelet integrated approach to improve pan-sharpening visual quality of natural colour IKONOS and QuickBird images , 2005, Inf. Fusion.

[31]  Seema Jalan,et al.  Comparison of different pan-sharpening methods for spectral characteristic preservation: multi-temporal CARTOSAT-1 and IRS-P6 LISS-IV imagery , 2012 .

[32]  Robert M. Argent,et al.  Concepts, methods and applications in environmental model integration , 2004, Environ. Model. Softw..

[33]  E. Csaplovics,et al.  Examination of image fusion using synthetic variable ratio (SVR) technique , 2007 .