Nearest-neighbor diffusion-based pan-sharpening algorithm for spectral images

Abstract. Commercial multispectral satellite datasets, such as WorldView-2 and Geoeye-1 images, are often delivered with a high-spatial resolution panchromatic image (PAN) as well as a corresponding lower resolution multispectral image (MSI). Certain fine features are only visible on the PAN but are difficult to discern on the MSI. To fully utilize the high-spatial resolution of the PAN and the rich spectral information from the MSI, a pan-sharpening process can be carried out. However, difficulties arise in maintaining radiometric accuracy, particularly for applications other than visual assessment. We propose a fast pan-sharpening process based on nearest-neighbor diffusion with the aim to enhance the salient spatial features while preserving spectral fidelity. Our approach assumes that each pixel spectrum in the pan-sharpened image is a weighted linear mixture of the spectra of its immediate neighboring superpixels; it treats each spectrum as its smallest element of operation, which is different from the most existing algorithms that process each band separately. Our approach is shown to be capable of preserving salient spatial and spectral features. We expect this algorithm to facilitate fine feature extraction from satellite images.

[1]  J. C. Price,et al.  Combining panchromatic and multispectral imagery dual resolution satellite instruments , 1987 .

[2]  Yun Zhang,et al.  A review and comparison of commercially available pan-sharpening techniques for high resolution satellite image fusion , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[3]  Xavier Otazu,et al.  Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Xavier Otazu,et al.  Comparison between Mallat's and the ‘à trous’ discrete wavelet transform based algorithms for the fusion of multispectral and panchromatic images , 2005 .

[5]  Xavier Otazu,et al.  Multiresolution-based image fusion with additive wavelet decomposition , 1999, IEEE Trans. Geosci. Remote. Sens..

[6]  Altan Mesut,et al.  A comparative analysis of image fusion methods , 2012, 2012 20th Signal Processing and Communications Applications Conference (SIU).

[7]  Subhasis Chaudhuri,et al.  An Optimization-Based Approach to Fusion of Hyperspectral Images , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[8]  David W. Messinger,et al.  A spectral image clustering algorithm based on ant colony optimization , 2012, Defense + Commercial Sensing.

[9]  Andrea Garzelli,et al.  Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis , 2002, IEEE Trans. Geosci. Remote. Sens..

[10]  V. K. Shettigara,et al.  A generalized component substitution technique for spatial enhancement of multispectral images using , 1992 .

[11]  Mehran Yazdi,et al.  Panchromatic and Multispectral Image Fusion Based on Maximization of Both Spectral and Spatial Similarities , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Manfred Ehlers,et al.  Performance of evaluation methods in image fusion , 2009, 2009 12th International Conference on Information Fusion.

[13]  Lizhong Xu,et al.  Multispectral and panchromatic image fusion based on improved bilateral filter , 2011 .

[14]  John R. Schott,et al.  Remote Sensing: The Image Chain Approach , 1996 .

[15]  Andrea Garzelli,et al.  Optimal MMSE Pan Sharpening of Very High Resolution Multispectral Images , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Yonghyun Kim,et al.  Improved Additive-Wavelet Image Fusion , 2011, IEEE Geoscience and Remote Sensing Letters.

[17]  Jocelyn Chanussot,et al.  Comparison of Pansharpening Algorithms: Outcome of the 2006 GRS-S Data-Fusion Contest , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Bin Chen,et al.  A Novel Adaptive Scheme for Evaluating Spectral Similarity in High-Resolution Urban Scenes , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[19]  L. Wald,et al.  Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images , 1997 .

[20]  Subhasis Chaudhuri,et al.  Visualization of Hyperspectral Images Using Bilateral Filtering , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[21]  J. R. Jensen Remote Sensing of the Environment: An Earth Resource Perspective , 2000 .

[22]  Te-Ming Tu,et al.  An Adjustable Pan-Sharpening Approach for IKONOS/QuickBird/GeoEye-1/WorldView-2 Imagery , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[23]  Aggelos K. Katsaggelos,et al.  A survey of classical methods and new trends in pansharpening of multispectral images , 2011, EURASIP J. Adv. Signal Process..

[24]  Yuri Zhang,et al.  A new automatic approach for effectively fusing Landsat 7 as well as IKONOS images , 2002, IEEE International Geoscience and Remote Sensing Symposium.

[25]  Marco Dorigo,et al.  Distributed Optimization by Ant Colonies , 1992 .

[26]  Chulhee Lee,et al.  Fast and Efficient Panchromatic Sharpening , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  D Pradines,et al.  Improving Spot Images Size And Multispectral Resolution , 1986, Other Conferences.

[29]  David W. Messinger,et al.  Pan-sharpening of spectral image with anisotropic diffusion for fine feature extraction using GPU , 2013, Defense, Security, and Sensing.

[30]  John R. Schott,et al.  Evaluation of Two Applications of Spectral Mixing Models to Image Fusion , 2000 .

[31]  Andrea Garzelli,et al.  Interband structure modeling for Pan-sharpening of very high-resolution multispectral images , 2005, Inf. Fusion.