Context-adaptive pansharpening algorithm for high-resolution satellite imagery

Pansharpening algorithms are important methods for overcoming the technical limitations of satellite sensors. However, most approaches to pansharpening have tended either to distort the spectral characteristics of the original multispectral image or reduce the visual sharpness of the panchromatic image. In this paper, we propose a pansharpening algorithm that uses both a global and a local context-adaptive parameter based on component substitution. The purpose of this algorithm is to produce fused images with spectral information similar to that of multispectral data while preserving spatial sharpness better than other algorithms such as the Gram–Schmidt algorithm, Additive Wavelet Luminance Proportional algorithm, and algorithms developed in our previous work. The proposed parameter is calculated using the spatial and spectral characteristics of an image. It is derived from a spatial correlation between each multispectral band and adjusted-intensity image based on Laplacian filtering and statistical ratios, and the parameter is subsequently adaptively adjusted using image entropy to optimize the fusion quality in terms of the sensor and image characteristics. An experiment using IKONOS-2, QuickBird-2, and Geoeye-1 imagery demonstrated that a global context-adaptive parameter model is effective for spatial enhancement and that a local context-adaptive model is useful for image visualization and spectral information preservation.

[1]  Myeong-Ryong Nam,et al.  Fusion of multispectral and panchromatic Satellite images using the curvelet transform , 2005, IEEE Geoscience and Remote Sensing Letters.

[2]  Y. Zhang,et al.  A new merging method and its spectral and spatial effects , 1999 .

[3]  Luciano Alparone,et al.  A Theoretical Analysis of the Effects of Aliasing and Misregistration on Pansharpened Imagery , 2011, IEEE Journal of Selected Topics in Signal Processing.

[4]  Andrea Garzelli,et al.  Optimal MMSE Pan Sharpening of Very High Resolution Multispectral Images , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Luciano Alparone,et al.  MTF-tailored Multiscale Fusion of High-resolution MS and Pan Imagery , 2006 .

[6]  Consuelo Gonzalo Martín,et al.  A directed search algorithm for setting the spectral-spatial quality trade-off of fused images by the wavelet à trous method , 2008 .

[7]  Wei Yao,et al.  Improved GIHSA for image fusion based on parameter optimization , 2010 .

[8]  Yun Zhang,et al.  Comparison and improvement of wavelet‐based image fusion , 2008 .

[9]  Te-Ming Tu,et al.  A fast intensity-hue-saturation fusion technique with spectral adjustment for IKONOS imagery , 2004, IEEE Geoscience and Remote Sensing Letters.

[10]  Xavier Otazu,et al.  Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Chulhee Lee,et al.  Fast and Efficient Panchromatic Sharpening , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[12]  S. Baronti,et al.  Sharpening of very high resolution images with spectral distortion minimization , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[13]  Mario Lillo-Saavedra,et al.  Spectral or spatial quality for fused satellite imagery? A trade‐off solution using the wavelet à trous algorithm , 2006 .

[14]  Andrea Garzelli,et al.  Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis , 2002, IEEE Trans. Geosci. Remote. Sens..

[15]  Bruno Aiazzi,et al.  Improving Component Substitution Pansharpening Through Multivariate Regression of MS $+$Pan Data , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[16]  J. Zhou,et al.  A wavelet transform method to merge Landsat TM and SPOT panchromatic data , 1998 .

[17]  Robert Edge Universal Image Quality , 2010 .

[18]  Bruno Aiazzi,et al.  A Comparison Between Global and Context-Adaptive Pansharpening of Multispectral Images , 2009, IEEE Geoscience and Remote Sensing Letters.

[19]  Michael Möller,et al.  An Adaptive IHS Pan-Sharpening Method , 2010, IEEE Geoscience and Remote Sensing Letters.

[20]  Yun Zhang,et al.  Understanding image fusion , 2004 .

[21]  Jocelyn Chanussot,et al.  Comparison of Pansharpening Algorithms: Outcome of the 2006 GRS-S Data-Fusion Contest , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Xavier Otazu,et al.  Comparison between Mallat's and the ‘à trous’ discrete wavelet transform based algorithms for the fusion of multispectral and panchromatic images , 2005 .

[23]  Myungjin Choi,et al.  A new intensity-hue-saturation fusion approach to image fusion with a tradeoff parameter , 2006, IEEE Trans. Geosci. Remote. Sens..

[24]  L. Wald,et al.  Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images , 1997 .

[25]  Qingquan Li,et al.  M-band wavelet transform for the generation of high-resolution multispectral images , 2008 .

[26]  Luciano Alparone,et al.  A global quality measurement of pan-sharpened multispectral imagery , 2004, IEEE Geoscience and Remote Sensing Letters.

[27]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[28]  Kiyun Yu,et al.  A New Adaptive Component-Substitution-Based Satellite Image Fusion by Using Partial Replacement , 2011, IEEE Transactions on Geoscience and Remote Sensing.