Radiometric assessment of four pan-sharpening algorithms as applied to hyperspectral imagery

Pan-sharpening - fusing the spatial and spectral information between panchromatic (PAN) and multispectral (MSI) or hyperspectral (HSI) imagery of a common scene is a hot topic in remote sensing due to a wide range of applications such as target detection, vegetation monitoring, and subsurface detection (e.g. landmines), among others. However, the focus of panchromatic sharpening is generally placed on visual quality of the resulting image and image-wide summary spectral accuracy metrics. Here we are interested in radiometrically accurate panchromatic sharpening of hyperspectral imagery with particular emphasis on spectral algorithm performance. Four pansharpening algorithms are applied to hyperspectral imagery and evaluated for spectral/radiometric fidelity. Two datasets from SHARE2012 were used: one which features rural scene elements and one which features an urban scene. Target detection was also performed to evaluate algorithm sharpening performance. We find that although visually the performance of the four algorithms were roughly similar, they differ in spectral/radiometric fidelity as well as performance in ACE target detection.

[1]  David W. Messinger,et al.  The SHARE 2012 data campaign , 2013, Defense, Security, and Sensing.

[2]  C. Padwick,et al.  WORLDVIEW-2 PAN-SHARPENING , 2010 .

[3]  Naoto Yokoya,et al.  Coupled non-negative matrix factorization (CNMF) for hyperspectral and multispectral data fusion: Application to pasture classification , 2011, 2011 IEEE International Geoscience and Remote Sensing Symposium.

[4]  Naoto Yokoya,et al.  Hyperspectral Pansharpening: A Review , 2015, IEEE Geoscience and Remote Sensing Magazine.

[5]  Jocelyn Chanussot,et al.  A Convex Formulation for Hyperspectral Image Superresolution via Subspace-Based Regularization , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[6]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[7]  Qingshan Liu,et al.  Hyperspectral Image Classification Using Spectral-Spatial LSTMs , 2017, CCCV.

[8]  Jocelyn Chanussot,et al.  Synthesis of Multispectral Images to High Spatial Resolution: A Critical Review of Fusion Methods Based on Remote Sensing Physics , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Bin Chen,et al.  Nearest-neighbor diffusion-based pan-sharpening algorithm for spectral images , 2014, Optical Engineering.

[10]  Naoto Yokoya,et al.  Hyperspectral and Multispectral Data Fusion: A comparative review of the recent literature , 2017, IEEE Geoscience and Remote Sensing Magazine.

[11]  Magnus O. Ulfarsson,et al.  Hyperspectral Feature Extraction Using Sparse and Smooth Low-Rank Analysis , 2019, Remote. Sens..

[12]  Seniha Esen Yuksel,et al.  Target detection in hyperspectral images , 2016, 2016 24th Signal Processing and Communication Application Conference (SIU).

[13]  Sylvia S. Shen Effects of sharpening on hyperspectral exploitation , 2002, SPIE Defense + Commercial Sensing.

[14]  Maria Axelsson,et al.  Target detection in hyperspectral imagery using forward modeling and in-scene information , 2016 .