Hyper-Sharpening: A First Approach on SIM-GA Data

This paper aims at defining a new paradigm (hypersharpening) in remote sensing image fusion. In fact, due to the development of new instruments, thinking only in terms of pansharpening is reductive. Even though some expressions as hyperspectral (HS) pansharpening already exist, there is not a suitable definition when multispectral/hyperspectral data are used as source to extract spatial details. After defining the hypersharpening framework, we draw the readers' attention to its peculiar characteristics, by proposing and evaluating two hypersharpening methods. Experiments are carried out on the data produced by the updated version of SIM-GA imager, designed by Selex ES, which is composed by a panchromatic camera and two spectrometers in the VNIR and SWIR spectral ranges, respectively. Owing to the different resolution factors among panchromatic, VNIR and SWIR data sets, we can apply hypersharpening to fuse SWIR data to VNIR resolution. Comparisons of hypersharpening with “traditional” pansharpening show hypersharpening is more effective.

[1]  Thomas L. Ainsworth,et al.  Improved Manifold Coordinate Representations of Large-Scale Hyperspectral Scenes , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Luciano Alparone,et al.  Pansharpening of hyperspectral images: a critical analysis of requirements and assessment on simulated PRISMA data , 2013, Remote Sensing.

[3]  L. Wald,et al.  Fusion of high spatial and spectral resolution images : The ARSIS concept and its implementation , 2000 .

[4]  Te-Ming Tu,et al.  A new look at IHS-like image fusion methods , 2001, Inf. Fusion.

[5]  W. H. Farrand,et al.  Determining the number and identity of spectral endmembers; an integrated approach using Neyman-Person eigen-thresholding and iterative constrained RMS error minimization , 1993 .

[6]  Bruno Aiazzi,et al.  Improving Component Substitution Pansharpening Through Multivariate Regression of MS $+$Pan Data , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[7]  L. Wald,et al.  Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images , 1997 .

[8]  Luciano Alparone,et al.  Benefits of signal-dependent noise reduction for spectral analysis of data from advanced imaging spectrometers , 2011, 2011 3rd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[9]  Jean-Yves Tourneret,et al.  Hyperspectral and Multispectral Image Fusion Based on a Sparse Representation , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Chein-I Chang,et al.  Constrained band selection for hyperspectral imagery , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[11]  V. K. Shettigara,et al.  A generalized component substitution technique for spatial enhancement of multispectral images using , 1992 .

[12]  Russell C. Hardie,et al.  Hyperspectral resolution enhancement using high-resolution multispectral imagery with arbitrary response functions , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Jocelyn Chanussot,et al.  A Critical Comparison Among Pansharpening Algorithms , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[14]  O. L. Frost,et al.  An algorithm for linearly constrained adaptive array processing , 1972 .

[15]  Alan R. Gillespie,et al.  Color enhancement of highly correlated images. II. Channel ratio and “chromaticity” transformation techniques , 1987 .

[16]  P. Switzer,et al.  A transformation for ordering multispectral data in terms of image quality with implications for noise removal , 1988 .

[17]  Jocelyn Chanussot,et al.  A Convex Formulation for Hyperspectral Image Superresolution via Subspace-Based Regularization , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Shutao Li,et al.  Remote Sensing Image Fusion via Sparse Representations Over Learned Dictionaries , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Wen Dou,et al.  A general framework for component substitution image fusion: An implementation using the fast image fusion method , 2007, Comput. Geosci..

[20]  Russell C. Hardie,et al.  Application of the stochastic mixing model to hyperspectral resolution enhancement , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Naoto Yokoya,et al.  Coupled Nonnegative Matrix Factorization Unmixing for Hyperspectral and Multispectral Data Fusion , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Luciano Alparone,et al.  Hyperspectral pansharpening based on modulation of pixel spectra , 2010, 2010 2nd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[23]  Bin Wang,et al.  Fusion of Hyperspectral and Multispectral Images: A Novel Framework Based on Generalization of Pan-Sharpening Methods , 2014, IEEE Geoscience and Remote Sensing Letters.

[24]  Sheldon M. Ross,et al.  Introduction to Probability and Statistics for Engineers and Scientists , 1987 .

[25]  Xavier Otazu,et al.  Multiresolution-based image fusion with additive wavelet decomposition , 1999, IEEE Trans. Geosci. Remote. Sens..

[26]  Xavier Otazu,et al.  Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Jean-Yves Tourneret,et al.  Bayesian fusion of hyperspectral and multispectral images , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[28]  J. B. Lee,et al.  Enhancement of high spectral resolution remote-sensing data by a noise-adjusted principal components transform , 1990 .

[29]  Luciano Alparone,et al.  A Theoretical Analysis of the Effects of Aliasing and Misregistration on Pansharpened Imagery , 2011, IEEE Journal of Selected Topics in Signal Processing.

[30]  Bruno Aiazzi,et al.  A Comparison Between Global and Context-Adaptive Pansharpening of Multispectral Images , 2009, IEEE Geoscience and Remote Sensing Letters.

[31]  T. Tu,et al.  Blind separation of spectral signatures in hyperspectral imagery , 2001 .

[32]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[33]  I. Jolliffe.  Principal Component Analysis , 2002 .

[34]  Jocelyn Chanussot,et al.  Fusion of hyperspectral and panchromatic images using multiresolution analysis and nonlinear PCA band reduction , 2011, 2011 IEEE International Geoscience and Remote Sensing Symposium.

[35]  Russell C. Hardie,et al.  MAP estimation for hyperspectral image resolution enhancement using an auxiliary sensor , 2004, IEEE Transactions on Image Processing.

[36]  Richard Bamler,et al.  A Sparse Image Fusion Algorithm With Application to Pan-Sharpening , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[37]  W. J. Carper,et al.  The use of intensity-hue-saturation transformations for merging SPOT panchromatic and multispectral image data , 1990 .

[38]  José M. Bioucas-Dias,et al.  Hyperspectral Subspace Identification , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Akira Iwasaki,et al.  Hyperspectral Imager Suite (HISUI) -Japanese hyper-multi spectral radiometer , 2011, 2011 IEEE International Geoscience and Remote Sensing Symposium.

[40]  S. Baronti,et al.  Twenty-Five Years of Pansharpening: A Critical Review and New Developments , 2012 .

[41]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[42]  Chein-I Chang,et al.  Estimation of number of spectrally distinct signal sources in hyperspectral imagery , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[43]  Shutao Li,et al.  A New Pan-Sharpening Method Using a Compressed Sensing Technique , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[44]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[45]  Bruno Aiazzi,et al.  Hyper-sharpening of hyperspectral data: A first approach , 2014, 2014 6th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[46]  Andrea Garzelli,et al.  Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis , 2002, IEEE Trans. Geosci. Remote. Sens..

[47]  Luciano Alparone,et al.  Image fusion—the ARSIS concept and some successful implementation schemes , 2003 .

[48]  L. Trefethen,et al.  Numerical linear algebra , 1997 .

[49]  S. Baronti,et al.  Multispectral and panchromatic data fusion assessment without reference , 2008 .

[50]  John R. Schott,et al.  Application of Spectral Mixture Analysis and Image Fusion Techniques for Image Sharpening , 1998 .

[51]  Luciano Alparone,et al.  Context modeling for joint spectral and radiometirc distortion minimization in pyramid-based fusion of MS and P image data , 2003, SPIE Remote Sensing.

[52]  Fred A. Kruse,et al.  The Spectral Image Processing System (SIPS) - Interactive visualization and analysis of imaging spectrometer data , 1993 .

[53]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[54]  Jocelyn Chanussot,et al.  Indusion: Fusion of Multispectral and Panchromatic Images Using the Induction Scaling Technique , 2008, IEEE Geoscience and Remote Sensing Letters.

[55]  Naoto Yokoya,et al.  Hyperspectral and multispectral data fusion mission on hyperspectral imager suite (HISUI) , 2013, 2013 IEEE International Geoscience and Remote Sensing Symposium - IGARSS.

[56]  Yifan Zhang,et al.  Noise-Resistant Wavelet-Based Bayesian Fusion of Multispectral and Hyperspectral Images , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[57]  Luciano Alparone,et al.  MTF-tailored Multiscale Fusion of High-resolution MS and Pan Imagery , 2006 .

[58]  John R. Schott,et al.  Evaluation of Two Applications of Spectral Mixing Models to Image Fusion , 2000 .

[59]  Thomas L. Ainsworth,et al.  Exploiting manifold geometry in hyperspectral imagery , 2005, IEEE Transactions on Geoscience and Remote Sensing.