Pansharpening With Multiscale Normalized Nonlocal Means Filter: A Two-Step Approach

Pansharpening aims to synthesize a high-spatial-resolution multispectral (MS) image by fusing a panchromatic (PAN) image and a low-resolution MS image. The multiresolution analysis (MRA)-based methods are a popular group of pansharpening methods. However, in the MRA-based methods, spatial distortions may occur in the pansharpened product due to the misalignment of PAN and MS data. To address the spatial distortion issue in MRA-based methods, this paper proposes a two-step approach, which consists of the coarse step and the refined step. The coarse step produces a preliminary result using the traditional details injection model. Then, the preliminary product is refined with a second details injection operation in the refined step. Moreover, in our proposed two-step approach, a novel multiscale decomposition based on a normalized nonlocal means (NNLM) filter is developed to extract the spatial detail. Compared with the original nonlocal means filter, the designed NNLM makes the similarity measure more robust and accurate by exploiting the normalized intensity value and the mean value jointly. The experimental results on various satellite data demonstrate the superiority of the proposed pansharpening scheme by comparing with ten well-known methods.

[1]  Xuelong Li,et al.  Single Image Super-Resolution With Non-Local Means and Steering Kernel Regression , 2012, IEEE Transactions on Image Processing.

[2]  Stuart Crozier,et al.  Denoising of Dynamic Contrast-Enhanced MR Images Using Dynamic Nonlocal Means , 2010, IEEE Transactions on Medical Imaging.

[3]  Te-Ming Tu,et al.  A fast intensity-hue-saturation fusion technique with spectral adjustment for IKONOS imagery , 2004, IEEE Geoscience and Remote Sensing Letters.

[4]  Luciano Alparone,et al.  Remote sensing image fusion using the curvelet transform , 2007, Inf. Fusion.

[5]  Luisa Verdoliva,et al.  A Nonlocal SAR Image Denoising Algorithm Based on LLMMSE Wavelet Shrinkage , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Yonghyun Kim,et al.  Improved Additive-Wavelet Image Fusion , 2011, IEEE Geoscience and Remote Sensing Letters.

[7]  L. Wald,et al.  Fusion of high spatial and spectral resolution images : The ARSIS concept and its implementation , 2000 .

[8]  Jocelyn Chanussot,et al.  Comparison of Pansharpening Algorithms: Outcome of the 2006 GRS-S Data-Fusion Contest , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Shutao Li,et al.  Remote Sensing Image Fusion via Sparse Representations Over Learned Dictionaries , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Te-Ming Tu,et al.  A new look at IHS-like image fusion methods , 2001, Inf. Fusion.

[11]  Richard Bamler,et al.  A Sparse Image Fusion Algorithm With Application to Pan-Sharpening , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Johannes R. Sveinsson,et al.  Model-Based Satellite Image Fusion , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Xavier Otazu,et al.  Multiresolution-based image fusion with additive wavelet decomposition , 1999, IEEE Trans. Geosci. Remote. Sens..

[14]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[15]  W. J. Carper,et al.  The use of intensity-hue-saturation transformations for merging SPOT panchromatic and multispectral image data , 1990 .

[16]  Liang-pei Zhang,et al.  Integrated fusion of multi-scale polar-orbiting and geostationary satellite observations for the mapping of high spatial and temporal resolution land surface temperature , 2015 .

[17]  Andrea Garzelli,et al.  Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis , 2002, IEEE Trans. Geosci. Remote. Sens..

[18]  Maneesh Agrawala,et al.  Multiscale shape and detail enhancement from multi-light image collections , 2007, SIGGRAPH 2007.

[19]  Bruno Aiazzi,et al.  A Comparison Between Global and Context-Adaptive Pansharpening of Multispectral Images , 2009, IEEE Geoscience and Remote Sensing Letters.

[20]  Roger L. King,et al.  An Efficient Pan-Sharpening Method via a Combined Adaptive PCA Approach and Contourlets , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Shutao Li,et al.  A New Pan-Sharpening Method Using a Compressed Sensing Technique , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Liangpei Zhang,et al.  Two-Step Sparse Coding for the Pan-Sharpening of Remote Sensing Images , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[23]  Mehran Yazdi,et al.  Panchromatic and Multispectral Image Fusion Based on Maximization of Both Spectral and Spatial Similarities , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Steven K. Rogers,et al.  Perceptual-based image fusion for hyperspectral data , 1997, IEEE Trans. Geosci. Remote. Sens..

[25]  L. Wald,et al.  Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images , 1997 .

[26]  Liangpei Zhang,et al.  Adjustable Model-Based Fusion Method for Multispectral and Panchromatic Images , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[27]  Bruno Aiazzi,et al.  Improving Component Substitution Pansharpening Through Multivariate Regression of MS $+$Pan Data , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Henry Leung,et al.  Fusion of Multispectral and Panchromatic Images Using a Restoration-Based Method , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Myungjin Choi,et al.  A new intensity-hue-saturation fusion approach to image fusion with a tradeoff parameter , 2006, IEEE Trans. Geosci. Remote. Sens..

[30]  Luciano Alparone,et al.  A global quality measurement of pan-sharpened multispectral imagery , 2004, IEEE Geoscience and Remote Sensing Letters.

[31]  Luciano Alparone,et al.  Image fusion—the ARSIS concept and some successful implementation schemes , 2003 .

[32]  S. Baronti,et al.  Multispectral and panchromatic data fusion assessment without reference , 2008 .

[33]  Antoni Buades,et al.  A Nonlocal Variational Model for Pansharpening Image Fusion , 2014, SIAM J. Imaging Sci..

[34]  Jocelyn Chanussot,et al.  Improving MODIS Spatial Resolution for Snow Mapping Using Wavelet Fusion and ARSIS Concept , 2008, IEEE Geoscience and Remote Sensing Letters.

[35]  Anustup Choudhury,et al.  Hierarchy of nonlocal means for preferred automatic sharpness enhancement and tone mapping. , 2013, Journal of the Optical Society of America. A, Optics, image science, and vision.

[36]  Laura Igual,et al.  A Variational Model for P+XS Image Fusion , 2006, International Journal of Computer Vision.

[37]  Xavier Otazu,et al.  Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Michael Möller,et al.  An Adaptive IHS Pan-Sharpening Method , 2010, IEEE Geoscience and Remote Sensing Letters.