Pan-sharpening of spectral image with anisotropic diffusion for fine feature extraction using GPU

Feature extraction from satellite imagery is a challenging topic. Commercial multispectral satellite data sets, such as WorldView 2 images, are often delivered with a high spatial resolution panchromatic image (PAN) as well as a corresponding low-resolution multispectral spectral image (MSI). Certain fine features are only visible on the PAN but difficult to discern on the MSI. To fully utilize the high spatial resolution of the PAN and the rich spectral information from the MSI, a pan sharpening process can be carried out. In this paper, we propose a novel and fast pan sharpening process based on anisotropic diffusion with the aim to aid feature extraction that enhances salient spatial features. Our approach assumes that each pixel spectrum in the pan-sharpened image is a weighted linear mixture of the spectra of its immediate neighboring superpixels; it treats spectrum as its smallest element of operation, which is different from most existing algorithms that process each band separately. Our approach is shown to be capable of preserving salient features. In addition, the process is highly parallel with intensive neighbor operations and is implemented on a general purpose GPU card with NVIDIA CUDA architecture that achieves approximately 25 times speedup for our setup. We expect this algorithm to facilitate fine feature extraction from satellite images.

[1]  Yun Zhang,et al.  A review and comparison of commercially available pan-sharpening techniques for high resolution satellite image fusion , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[2]  V. K. Shettigara,et al.  A generalized component substitution technique for spatial enhancement of multispectral images using , 1992 .

[3]  Mehran Yazdi,et al.  Panchromatic and Multispectral Image Fusion Based on Maximization of Both Spectral and Spatial Similarities , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Xavier Otazu,et al.  Multiresolution-based image fusion with additive wavelet decomposition , 1999, IEEE Trans. Geosci. Remote. Sens..

[5]  Chulhee Lee,et al.  Fast and Efficient Panchromatic Sharpening , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  D Pradines,et al.  Improving Spot Images Size And Multispectral Resolution , 1986, Other Conferences.

[8]  Xavier Otazu,et al.  Comparison between Mallat's and the ‘à trous’ discrete wavelet transform based algorithms for the fusion of multispectral and panchromatic images , 2005 .

[9]  Andrea Garzelli,et al.  Optimal MMSE Pan Sharpening of Very High Resolution Multispectral Images , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Miguel Vélez-Reyes,et al.  Evaluation of the GPU architecture for the implementation of target detection algorithms for hyperspectral imagery , 2011, Defense + Commercial Sensing.

[11]  Michael E. Winter,et al.  Hyperspectral processing in graphical processing units , 2011, Defense + Commercial Sensing.

[12]  J. R. Jensen Remote Sensing of the Environment: An Earth Resource Perspective , 2000 .

[13]  Rohit Chandra,et al.  Parallel programming in openMP , 2000 .

[14]  Marco Dorigo,et al.  Distributed Optimization by Ant Colonies , 1992 .

[15]  Qingquan Li,et al.  A comparative analysis of image fusion methods , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Vidya Manian,et al.  Parallel implementation of nonlinear dimensionality reduction methods applied in object segmentation using CUDA in GPU , 2011, Defense + Commercial Sensing.

[17]  Manfred Ehlers,et al.  Performance of evaluation methods in image fusion , 2009, 2009 12th International Conference on Information Fusion.

[18]  Te-Ming Tu,et al.  An Adjustable Pan-Sharpening Approach for IKONOS/QuickBird/GeoEye-1/WorldView-2 Imagery , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[19]  Subhasis Chaudhuri,et al.  Visualization of Hyperspectral Images Using Bilateral Filtering , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Francisco Tirado,et al.  GPU for Parallel On-Board Hyperspectral Image Processing , 2008, Int. J. High Perform. Comput. Appl..

[21]  Bin Chen,et al.  Novel spectral similarity measure for high resolution urban scenes , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[22]  Subhasis Chaudhuri,et al.  An Optimization-Based Approach to Fusion of Hyperspectral Images , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[23]  Andrea Garzelli,et al.  Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis , 2002, IEEE Trans. Geosci. Remote. Sens..

[24]  Kevin Skadron,et al.  Enabling Task Parallelism in the CUDA Scheduler , 2009 .

[25]  John R. Schott,et al.  Evaluation of Two Applications of Spectral Mixing Models to Image Fusion , 2000 .

[26]  Andrea Garzelli,et al.  Interband structure modeling for Pan-sharpening of very high-resolution multispectral images , 2005, Inf. Fusion.

[27]  Wen-mei W. Hwu,et al.  GPU Computing Gems Emerald Edition , 2011 .

[28]  Yonghyun Kim,et al.  Improved Additive-Wavelet Image Fusion , 2011, IEEE Geoscience and Remote Sensing Letters.

[29]  Jocelyn Chanussot,et al.  Comparison of Pansharpening Algorithms: Outcome of the 2006 GRS-S Data-Fusion Contest , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[30]  J. C. Price,et al.  Combining panchromatic and multispectral imagery dual resolution satellite instruments , 1987 .

[31]  David W. Messinger,et al.  A spectral image clustering algorithm based on ant colony optimization , 2012, Defense + Commercial Sensing.

[32]  Lizhong Xu,et al.  Multispectral and panchromatic image fusion based on improved bilateral filter , 2011 .

[33]  John R. Schott,et al.  Remote Sensing: The Image Chain Approach , 1996 .

[34]  Aggelos K. Katsaggelos,et al.  A survey of classical methods and new trends in pansharpening of multispectral images , 2011, EURASIP J. Adv. Signal Process..

[35]  Yuri Zhang,et al.  A new automatic approach for effectively fusing Landsat 7 as well as IKONOS images , 2002, IEEE International Geoscience and Remote Sensing Symposium.

[36]  Nayda G. Santiago,et al.  Abundance estimation algorithms using NVIDIA CUDA technology , 2008, SPIE Defense + Commercial Sensing.

[37]  L. Dagum,et al.  OpenMP: an industry standard API for shared-memory programming , 1998 .

[38]  Xavier Otazu,et al.  Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods , 2005, IEEE Transactions on Geoscience and Remote Sensing.