Improving Remote Sensing Image Super-Resolution Mapping Based on the Spatial Attraction Model by Utilizing the Pansharpening Technique

The spatial distribution information of remote sensing images can be derived by the super-resolution mapping (SRM) technique. Super-resolution mapping, based on the spatial attraction model (SRMSAM), has been an important SRM method, due to its simplicity and explicit physical meanings. However, the resolution of the original remote sensing image is coarse, and the existing SRMSAM cannot take full advantage of the spatial–spectral information from the original image. To utilize more spatial–spectral information, improving remote sensing image super-resolution mapping based on the spatial attraction model by utilizing the pansharpening technique (SRMSAM-PAN) is proposed. In SRMSAM-PAN, a novel processing path, named the pansharpening path, is added to the existing SRMSAM. The original coarse remote sensing image is first fused with the high-resolution panchromatic image from the same area by the pansharpening technique in the novel pansharpening path, and the improved image is unmixed to obtain the novel fine-fraction images. The novel fine-fraction images from the pansharpening path and the existing fine-fraction images from the existing path are then integrated to produce finer-fraction images with more spatial–spectral information. Finally, the values predicted from the finer-fraction images are utilized to allocate class labels to all subpixels, to achieve the final mapping result. Experimental results show that the proposed SRMSAM-PAN can obtain a higher mapping accuracy than the existing SRMSAM methods.

[1]  Hugh G. Lewis,et al.  Super-resolution mapping using Hopfield Neural Network with panchromatic imagery , 2011 .

[2]  Yu Chen,et al.  Enhancing Land Cover Mapping through Integration of Pixel-Based and Object-Based Classifications from Remotely Sensed Imagery , 2018, Remote. Sens..

[3]  Peter M. Atkinson,et al.  The effect of the point spread function on sub-pixel mapping , 2017 .

[4]  Chunhui Zhao,et al.  Producing Subpixel Resolution Thematic Map From Coarse Imagery: MAP Algorithm-Based Super-Resolution Recovery , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[5]  Jocelyn Chanussot,et al.  Soft-Then-Hard Subpixel Land Cover Mapping Based on Spatial-Spectral Interpolation , 2016, IEEE Geoscience and Remote Sensing Letters.

[6]  P. Atkinson Sub-pixel Target Mapping from Soft-classified, Remotely Sensed Imagery , 2005 .

[7]  Peng Wang,et al.  Soft-then-hard super-resolution mapping based on a spatial attraction model with multiscale sub-pixel shifted images , 2017 .

[8]  Peter M. Atkinson,et al.  A linearised pixel-swapping method for mapping rural linear land cover features from fine spatial resolution remotely sensed imagery , 2007, Comput. Geosci..

[9]  Wenzhong Shi,et al.  Indicator Cokriging-Based Subpixel Mapping Without Prior Spatial Structure Information , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Gong Zhang,et al.  Superresolution mapping based on hybrid interpolation by parallel paths , 2019 .

[11]  Yu Chen,et al.  Super-Resolution Mapping of Impervious Surfaces from Remotely Sensed Imagery with Points-of-Interest , 2018, Remote. Sens..

[12]  Jocelyn Chanussot,et al.  Using Multiple Subpixel Shifted Images With Spatial–Spectral Information in Soft-Then-Hard Subpixel Mapping , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[13]  Liangpei Zhang,et al.  Tensor Discriminative Locality Alignment for Hyperspectral Image Spectral–Spatial Feature Extraction , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Giles M. Foody,et al.  Impact of Land Cover Patch Size on the Accuracy of Patch Area Representation in HNN-Based Super Resolution Mapping , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[15]  Liangpei Zhang,et al.  Sub-Pixel Mapping Based on a MAP Model With Multiple Shifted Hyperspectral Imagery , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[16]  M. Q. Nguyen,et al.  Superresolution mapping using a Hopfield neural network with lidar data , 2005, IEEE Geoscience and Remote Sensing Letters.

[17]  Gerard B. M. Heuvelink,et al.  Object-Based Superresolution Land-Cover Mapping From Remotely Sensed Imagery , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Wenzhong Shi,et al.  Allocating Classes for Soft-Then-Hard Subpixel Mapping Algorithms in Units of Class , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Liguo Wang,et al.  Geometric Method of Fully Constrained Least Squares Linear Spectral Mixture Analysis , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Yang Shao,et al.  Sub-Pixel Mapping of Tree Canopy, Impervious Surfaces, and Cropland in the Laurentian Great Lakes Basin Using MODIS Time-Series Data , 2011, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[21]  Xiaodong Li,et al.  Super-Resolution Land Cover Mapping Using Multiscale Self-Similarity Redundancy , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[22]  Hugh G. Lewis,et al.  Super-resolution target identification from remotely sensed images using a Hopfield neural network , 2001, IEEE Trans. Geosci. Remote. Sens..

[23]  Jocelyn Chanussot,et al.  A Critical Comparison Among Pansharpening Algorithms , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Ying Wang,et al.  Spectral Unmixing Model Based on Least Squares Support Vector Machine With Unmixing Residue Constraints , 2013, IEEE Geoscience and Remote Sensing Letters.

[25]  Jan G. P. W. Clevers,et al.  Possibilities and limitations of artificial neural networks for subpixel mapping of land cover , 2011 .

[26]  Hugh G. Lewis,et al.  Superresolution mapping using a hopfield neural network with fused images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Andrea Garzelli,et al.  Optimal MMSE Pan Sharpening of Very High Resolution Multispectral Images , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Henry Leung,et al.  Improving Super-Resolution Flood Inundation Mapping for Multispectral Remote Sensing Image by Supplying More Spectral Information , 2019, IEEE Geoscience and Remote Sensing Letters.

[29]  Da He,et al.  Multiobjective Subpixel Land-Cover Mapping , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Koen C. Mertens,et al.  A sub‐pixel mapping algorithm based on sub‐pixel/pixel spatial attraction models , 2006 .

[31]  Peter M. Atkinson,et al.  Mapping sub-pixel vector boundaries from remotely sensed images , 1996 .

[32]  Feng Li,et al.  Superresolution Reconstruction of Multispectral Data for Improved Image Classification , 2009, IEEE Geoscience and Remote Sensing Letters.

[33]  Fei Xiao,et al.  Sub-pixel mapping of remotely sensed imagery with hybrid intra- and inter-pixel dependence , 2013 .

[34]  H. Leung,et al.  Utilizing Parallel Networks to Produce Sub-Pixel Shifted Images With Multiscale Spatio-Spectral Information for Soft-Then-Hard Sub-Pixel Mapping , 2018, IEEE Access.

[35]  Danfeng Liu,et al.  Particle swarm optimization-based sub-pixel mapping for remote-sensing imagery , 2012 .

[36]  Jocelyn Chanussot,et al.  Synthesis of Multispectral Images to High Spatial Resolution: A Critical Review of Fusion Methods Based on Remote Sensing Physics , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Wenzhong Shi,et al.  Spatiotemporal Subpixel Mapping of Time-Series Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Peijun Li,et al.  A super-resolution mapping method using local indicator variograms , 2012 .

[39]  P. Atkinson,et al.  Sub-pixel mapping of remote sensing images based on radial basis function interpolation , 2014 .

[40]  P. Fisher The pixel: A snare and a delusion , 1997 .

[41]  Antonio J. Plaza,et al.  A New Genetic Method for Subpixel Mapping Using Hyperspectral Images , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[42]  Henry Leung,et al.  Utilizing Pansharpening Technique to Produce Sub-Pixel Resolution Thematic Map from Coarse Remote Sensing Image , 2018, Remote. Sens..

[43]  Alfred Stein,et al.  Enhanced Subpixel Mapping With Spatial Distribution Patterns of Geographical Objects , 2016, IEEE Transactions on Geoscience and Remote Sensing.