Information Loss-Guided Multi-Resolution Image Fusion

Spatial downscaling is an ill-posed, inverse problem, and information loss (IL) inevitably exists in the predictions produced by any downscaling technique. The recently popularized area-to-point kriging (ATPK)-based downscaling approach can account for the size of support and the point spread function (PSF) of the sensor, and moreover, it has the appealing advantage of the perfect coherence property. In this article, based on the advantages of ATPK and the conceptualization of IL, an IL-guided image fusion (ILGIF) approach is proposed. ILGIF uses the fine spatial resolution images acquired in other wavelengths to predict the IL in ATPK predictions based on the geographically weighted regression (GWR) model, which accounts for the spatial variation in land cover. ILGIF inherits all the advantages of ATPK, and its prediction has perfect coherence with the original coarse spatial resolution data which can be demonstrated mathematically. ILGIF was validated using two data sets and was shown in each case to predict downscaled images more accurately than the compared benchmark methods.

[1]  Peter M. Atkinson,et al.  Downscaling in remote sensing , 2013, Int. J. Appl. Earth Obs. Geoinformation.

[2]  Alexandre Boucher,et al.  Super-resolution land cover mapping with indicator geostatistics , 2006 .

[3]  Brian Wenny,et al.  Pre- and Post-Launch Spatial Quality of the Landsat 8 Thermal Infrared Sensor , 2015, Remote. Sens..

[4]  Jon Atli Benediktsson,et al.  Multisource and Multitemporal Data Fusion in Remote Sensing , 2018, ArXiv.

[5]  Luciano Alparone,et al.  MTF-tailored Multiscale Fusion of High-resolution MS and Pan Imagery , 2006 .

[6]  Ranga B. Myneni,et al.  The impact of gridding artifacts on the local spatial properties of MODIS data : Implications for validation, compositing, and band-to-band registration across resolutions , 2006 .

[7]  A. Stewart Fotheringham,et al.  Geographically Weighted Regression: A Method for Exploring Spatial Nonstationarity , 2010 .

[8]  Wenzhong Shi,et al.  Class Allocation for Soft-Then-Hard Subpixel Mapping Algorithms With Adaptive Visiting Order of Classes , 2014, IEEE Geoscience and Remote Sensing Letters.

[9]  Freek D. van der Meer,et al.  Remote-sensing image analysis and geostatistics , 2012 .

[10]  Jocelyn Chanussot,et al.  A Critical Comparison Among Pansharpening Algorithms , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[11]  P. Kyriakidis,et al.  Geostatistical Prediction and Simulation of Point Values from Areal Data , 2005 .

[12]  Jocelyn Chanussot,et al.  Pansharpening Based on Semiblind Deconvolution , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[13]  P. Kyriakidis.  A Geostatistical Framework for Area-to-Point Spatial Interpolation , 2004 .

[14]  G. Foody.  Geographical weighting as a further refinement to regression modelling: An example focused on the NDVI–rainfall relationship , 2003 .

[15]  Bruno Aiazzi,et al.  Improving Component Substitution Pansharpening Through Multivariate Regression of MS $+$Pan Data , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Jingfeng Huang,et al.  A satellite-based geographically weighted regression model for regional PM2.5 estimation over the Pearl River Delta region in China , 2014 .

[17]  G. Foody,et al.  Predictive relations of tropical forest biomass from Landsat TM data and their transferability between regions , 2003 .

[18]  Peter M. Atkinson,et al.  Issues of uncertainty in super-resolution mapping and their implications for the design of an inter-comparison study , 2009 .

[19]  Matthias Drusch,et al.  Sentinel-2: ESA's Optical High-Resolution Mission for GMES Operational Services , 2012 .

[20]  Aline Roumy,et al.  Single-Image Super-Resolution via Linear Mapping of Interpolated Self-Examples , 2014, IEEE Transactions on Image Processing.

[21]  Dorit Hammerling,et al.  Geostatistical inverse modeling for super-resolution mapping of continuous spatial processes , 2013 .

[22]  L. Alparone,et al.  An MTF-based spectral distortion minimizing model for pan-sharpening of very high resolution multispectral images of urban areas , 2003, 2003 2nd GRSS/ISPRS Joint Workshop on Remote Sensing and Data Fusion over Urban Areas.

[23]  Peter M. Atkinson,et al.  The effect of the point spread function on sub-pixel mapping , 2017 .

[24]  S. Baronti,et al.  Multispectral and panchromatic data fusion assessment without reference , 2008 .

[25]  Xavier Otazu,et al.  Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Johannes R. Sveinsson,et al.  Quantitative Quality Evaluation of Pansharpened Imagery: Consistency Versus Synthesis , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[27]  L. Wald,et al.  Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images , 1997 .

[28]  Liangpei Zhang,et al.  Boosting the Accuracy of Multispectral Image Pansharpening by Learning a Deep Residual Network , 2017, IEEE Geoscience and Remote Sensing Letters.

[29]  Wenzhong Shi,et al.  Indicator Cokriging-Based Subpixel Mapping Without Prior Spatial Structure Information , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[30]  D. Civco,et al.  Application of geographically weighted regression to fill gaps in SLC-off Landsat ETM+ satellite imagery , 2014 .

[31]  Bruno Aiazzi,et al.  Hyper-Sharpening: A First Approach on SIM-GA Data , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[32]  M. Charlton,et al.  Geographically Weighted Regression: A Natural Evolution of the Expansion Method for Spatial Data Analysis , 1998 .

[33]  Pierre Goovaerts,et al.  Kriging and Semivariogram Deconvolution in the Presence of Irregular Geographical Units , 2008, Mathematical geology.

[34]  Bruno Aiazzi,et al.  A Comparison Between Global and Context-Adaptive Pansharpening of Multispectral Images , 2009, IEEE Geoscience and Remote Sensing Letters.

[35]  Andrea Garzelli,et al.  Hypercomplex Quality Assessment of Multi/Hyperspectral Images , 2009, IEEE Geoscience and Remote Sensing Letters.

[36]  Jocelyn Chanussot,et al.  Fusion of Multispectral and Panchromatic Images Based on Morphological Operators , 2016, IEEE Transactions on Image Processing.

[37]  Jocelyn Chanussot,et al.  Comparison of Pansharpening Algorithms: Outcome of the 2006 GRS-S Data-Fusion Contest , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Jean-Yves Tourneret,et al.  Hyperspectral and Multispectral Image Fusion Based on a Sparse Representation , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Kiyun Yu,et al.  A New Adaptive Component-Substitution-Based Satellite Image Fusion by Using Partial Replacement , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Jocelyn Chanussot,et al.  Contrast and Error-Based Fusion Schemes for Multispectral Image Pansharpening , 2014, IEEE Geoscience and Remote Sensing Letters.

[41]  V. K. Shettigara,et al.  A generalized component substitution technique for spatial enhancement of multispectral images using , 1992 .

[42]  Bo Du,et al.  Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art , 2016, IEEE Geoscience and Remote Sensing Magazine.

[43]  S. Sides,et al.  Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic , 1991 .

[44]  J. G. Liu,et al.  Smoothing Filter-based Intensity Modulation : a spectral preserve image fusion technique for improving spatial details , 2001 .

[45]  Andrea Garzelli,et al.  Optimal MMSE Pan Sharpening of Very High Resolution Multispectral Images , 2008, IEEE Transactions on Geoscience and Remote Sensing.