Fusion of short-wave infrared and visible near-infrared WorldView-3 data

Abstract Pansharpening refers to the fusion of a low spatial resolution multispectral image and a high spatial resolution panchromatic image in order to have a synthesized (fused) product with the same spatial resolution of the panchromatic image and the same spectral resolution of the multispectral data. In this work, the problem of fusing the entire set of bands acquired by the WorldView-3 sensor from the visible spectrum to the short-wave infrared spectrum is addressed. In particular, the goal is to enhance the spatial resolution of all the visible, near-infrared, and short-wave infrared bands in order to reach the spatial resolution of the panchromatic image. A framework is proposed exploiting the multispectral image at middle spatial resolution to improve the performance (which is assessed on both simulated and real WorldView-3 data) of the fusion between short-wave infrared and panchromatic data.

[1]  Paolo Gamba,et al.  Human Settlements: A Global Challenge for EO Data Processing and Interpretation , 2013, Proceedings of the IEEE.

[2]  A. Solberg,et al.  Oil spill detection by satellite remote sensing , 2005 .

[3]  Bei Ye,et al.  Assessment of WorldView-3 Data for Lithological Mapping , 2017, Remote. Sens..

[4]  Richard Bamler,et al.  A Sparse Image Fusion Algorithm With Application to Pan-Sharpening , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[5]  J. G. Liu,et al.  Smoothing Filter-based Intensity Modulation: A spectral preserve image fusion technique for improving spatial details , 2000 .

[6]  Bo Huang,et al.  Urban land-use mapping using a deep convolutional neural network with high spatial resolution multispectral remote sensing imagery , 2018, Remote Sensing of Environment.

[7]  Te-Ming Tu,et al.  A new look at IHS-like image fusion methods , 2001, Inf. Fusion.

[8]  Jocelyn Chanussot,et al.  Contrast and Error-Based Fusion Schemes for Multispectral Image Pansharpening , 2014, IEEE Geoscience and Remote Sensing Letters.

[9]  Milad Niroumand-Jadidi,et al.  OPTIMAL BAND RATIO ANALYSIS OF WORLDVIEW-3 IMAGERY FOR BATHYMETRY OF SHALLOW RIVERS (CASE STUDY: SARCA RIVER, ITALY) , 2016 .

[10]  Luciano Alparone,et al.  Sensitivity of Pansharpening Methods to Temporal and Instrumental Changes Between Multispectral and Panchromatic Data Sets , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Kumar Navulur,et al.  Trends in Optical Commercial Remote Sensing Industry [Industrial Profiles] , 2013, IEEE Geoscience and Remote Sensing Magazine.

[12]  Shutao Li,et al.  A New Pan-Sharpening Method Using a Compressed Sensing Technique , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Jocelyn Chanussot,et al.  Multi-resolution analysis techniques and nonlinear PCA for hybrid pansharpening applications , 2016, Multidimens. Syst. Signal Process..

[14]  Shutao Li,et al.  Pansharpening With Multiscale Normalized Nonlocal Means Filter: A Two-Step Approach , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Liangpei Zhang,et al.  Review of the pansharpening methods for remote sensing images based on the idea of meta-analysis: Practical discussion and challenges , 2019, Inf. Fusion.

[16]  Hassan Ghassemian,et al.  Combining the spectral PCA and spatial PCA fusion methods by an optimal filter , 2016, Inf. Fusion.

[17]  Laurent Tits,et al.  Unmixing-Based Fusion of Hyperspatial and Hyperspectral Airborne Imagery for Early Detection of Vegetation Stress , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[18]  S. Baronti,et al.  Sharpening of very high resolution images with spectral distortion minimization , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[19]  Hassan Ghassemian,et al.  A Compressed-Sensing-Based Pan-Sharpening Method for Spectral Distortion Reduction , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[21]  Johannes R. Sveinsson,et al.  A New Pansharpening Algorithm Based on Total Variation , 2014, IEEE Geoscience and Remote Sensing Letters.

[22]  J. Boardman,et al.  Discrimination among semi-arid landscape endmembers using the Spectral Angle Mapper (SAM) algorithm , 1992 .

[23]  Jocelyn Chanussot,et al.  Fusion of Multispectral and Panchromatic Images Based on Morphological Operators , 2016, IEEE Transactions on Image Processing.

[24]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Hassan Ghassemian,et al.  A review of remote sensing image fusion methods , 2016, Inf. Fusion.

[26]  Jocelyn Chanussot,et al.  Synthesis of Multispectral Images to High Spatial Resolution: A Critical Review of Fusion Methods Based on Remote Sensing Physics , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Luciano Alparone,et al.  Full scale assessment of pansharpening methods and data products , 2014, Remote Sensing.

[28]  Luciano Alparone,et al.  Remote sensing image fusion using the curvelet transform , 2007, Inf. Fusion.

[29]  Mark J. Shensa,et al.  The discrete wavelet transform: wedding the a trous and Mallat algorithms , 1992, IEEE Trans. Signal Process..

[30]  Jocelyn Chanussot,et al.  Pansharpening Quality Assessment Using the Modulation Transfer Functions of Instruments , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Luciano Alparone,et al.  Spatial Methods for Multispectral Pansharpening: Multiresolution Analysis Demystified , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Luciano Alparone,et al.  Spatial Consistency for Full-Scale Assessment of Pansharpening , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[33]  Rabab Kreidieh Ward,et al.  Deep learning for pixel-level image fusion: Recent advances and future prospects , 2018, Inf. Fusion.

[34]  Luciano Alparone,et al.  Haze Correction for Contrast-Based Multispectral Pansharpening , 2017, IEEE Geoscience and Remote Sensing Letters.

[35]  Jocelyn Chanussot,et al.  A Critical Comparison Among Pansharpening Algorithms , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Andrea Garzelli,et al.  Optimal MMSE Pan Sharpening of Very High Resolution Multispectral Images , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Paolo Gamba,et al.  Remote Sensing and Earthquake Damage Assessment: Experiences, Limits, and Perspectives , 2012, Proceedings of the IEEE.

[38]  L. Alparone,et al.  Enhanced Gram-Schmidt Spectral Sharpening Based on Multivariate Regression of MS and Pan Data , 2006, 2006 IEEE International Symposium on Geoscience and Remote Sensing.

[39]  Jocelyn Chanussot,et al.  A Variational Pansharpening Approach Based on Reproducible Kernel Hilbert Space and Heaviside Function , 2018, IEEE Transactions on Image Processing.

[40]  K. Itten,et al.  Advanced radiometry measurements and Earth science applications with the Airborne Prism Experiment (APEX) , 2015 .

[41]  Luciano Alparone,et al.  Bi-cubic interpolation for shift-free pan-sharpening , 2013 .

[42]  Jon Atli Benediktsson,et al.  Pansharpening With Matting Model , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[43]  Huili Gong,et al.  Object-Based Urban Tree Species Classification Using Bi-Temporal WorldView-2 and WorldView-3 Images , 2015, Remote. Sens..

[44]  S. Baronti,et al.  Multispectral and panchromatic data fusion assessment without reference , 2008 .

[45]  Chiman Kwan,et al.  Blind Quality Assessment of Fused WorldView-3 Images by Using the Combinations of Pansharpening and Hypersharpening Paradigms , 2017, IEEE Geoscience and Remote Sensing Letters.

[46]  P. Chavez,et al.  Extracting spectral contrast in landsat thematic mapper image data using selective principal component analysis , 1989 .

[47]  L. Wald,et al.  Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images , 1997 .

[48]  Bruno Aiazzi,et al.  Hyper-Sharpening: A First Approach on SIM-GA Data , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[49]  Luciano Alparone,et al.  A Theoretical Analysis of the Effects of Aliasing and Misregistration on Pansharpened Imagery , 2011, IEEE Journal of Selected Topics in Signal Processing.

[50]  Luciano Alparone,et al.  MTF-tailored Multiscale Fusion of High-resolution MS and Pan Imagery , 2006 .

[51]  Jocelyn Chanussot,et al.  Band Assignment Approaches for Hyperspectral Sharpening , 2017, IEEE Geoscience and Remote Sensing Letters.

[52]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[53]  Luciano Alparone,et al.  Spatial resolution enhancement of ASTER thermal bands , 2005, SPIE Remote Sensing.

[54]  Luciano Alparone,et al.  Intersensor Statistical Matching for Pansharpening: Theoretical Issues and Practical Solutions , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[55]  Fred A. Kruse,et al.  Validation of DigitalGlobe WorldView-3 Earth imaging satellite shortwave infrared bands for mineral mapping , 2015 .

[56]  Rafael García,et al.  Fusion of multispectral and panchromatic images using improved IHS and PCA mergers based on wavelet decomposition , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[57]  Johannes R. Sveinsson,et al.  Quantitative Quality Evaluation of Pansharpened Imagery: Consistency Versus Synthesis , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[58]  Hassan Ghassemian,et al.  Nonlinear IHS: A Promising Method for Pan-Sharpening , 2016, IEEE Geoscience and Remote Sensing Letters.

[59]  E. Feunteun,et al.  VHR coastal bathymetry using WorldView-3: colour versus learner , 2017 .

[60]  Shutao Li,et al.  Pixel-level image fusion: A survey of the state of the art , 2017, Inf. Fusion.

[61]  Bruno Aiazzi,et al.  Improving Component Substitution Pansharpening Through Multivariate Regression of MS $+$Pan Data , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[62]  Andrea Garzelli,et al.  Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis , 2002, IEEE Trans. Geosci. Remote. Sens..

[63]  Naoto Yokoya,et al.  Hyperspectral Pansharpening: A Review , 2015, IEEE Geoscience and Remote Sensing Magazine.

[64]  Jocelyn Chanussot,et al.  A Regression-Based High-Pass Modulation Pansharpening Approach , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[65]  Luciano Alparone,et al.  A global quality measurement of pan-sharpened multispectral imagery , 2004, IEEE Geoscience and Remote Sensing Letters.