Superresolution Land Cover Mapping Based on Pixel-, Subpixel-, and Superpixel-Scale Spatial Dependence With Pansharpening Technique

In this article, a novel superresolution mapping (SRM) method based on pixel-, subpixel-, and superpixel-scale spatial dependence (PSSSD) with pansharpening technique is proposed. First, an original coarse resolution remote sensing image and a high-resolution panchromatic image are fused by the pansharpening technique to produce a pansharpened result. A segmentation image with numerous superpixels, which represent irregular objects, is generated by adaptively segmenting the pansharpened result. Second, the class proportions of pixels, subpixels, and superpixels are, respectively, obtained from the original image, the pansharpened image, and the segmentation image. Pixel-scale spatial dependence is obtained using a pixel spatial attraction model. Subpixel-scale spatial dependence is derived using a novel subpixel spatial attraction model. Superpixel-scale spatial dependence is obtained through an extended random walker algorithm. Third, the three-scale spatial dependence is integrated into the PSSSD. Finally, a class allocation method based on object units is used to obtain the SRM results according to the PSSSD. Experimental results for three remote sensing images show that the proposed PSSSD outperforms the existing state-of-the-art SRM methods.

[1]  Jon Atli Benediktsson,et al.  Extended Random Walker-Based Classification of Hyperspectral Images , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Fei Xiao,et al.  Burned-Area Mapping at the Subpixel Scale With MODIS Images , 2015, IEEE Geoscience and Remote Sensing Letters.

[3]  Fei Xiao,et al.  Object-based sub-pixel mapping of buildings incorporating the prior shape information from remotely sensed imagery , 2012, Int. J. Appl. Earth Obs. Geoinformation.

[4]  Wenzhong Shi,et al.  Fast Subpixel Mapping Algorithms for Subpixel Resolution Change Detection , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Feng Li,et al.  Superresolution Reconstruction of Multispectral Data for Improved Image Classification , 2009, IEEE Geoscience and Remote Sensing Letters.

[6]  Chunhui Zhao,et al.  Producing Subpixel Resolution Thematic Map From Coarse Imagery: MAP Algorithm-Based Super-Resolution Recovery , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[7]  Fei Xiao,et al.  Sub-pixel mapping of remotely sensed imagery with hybrid intra- and inter-pixel dependence , 2013 .

[8]  P. Atkinson.  Sub-pixel Target Mapping from Soft-classified, Remotely Sensed Imagery , 2005 .

[9]  Henry Leung,et al.  Improving Super-Resolution Flood Inundation Mapping for Multispectral Remote Sensing Image by Supplying More Spectral Information , 2019, IEEE Geoscience and Remote Sensing Letters.

[10]  Gerard B. M. Heuvelink,et al.  Object-Based Superresolution Land-Cover Mapping From Remotely Sensed Imagery , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Lei Zhang,et al.  Exploiting Clustering Manifold Structure for Hyperspectral Imagery Super-Resolution , 2018, IEEE Transactions on Image Processing.

[12]  H. Leung,et al.  Utilizing Parallel Networks to Produce Sub-Pixel Shifted Images With Multiscale Spatio-Spectral Information for Soft-Then-Hard Sub-Pixel Mapping , 2018, IEEE Access.

[13]  Feng Ling,et al.  An Iterative Interpolation Deconvolution Algorithm for Superresolution Land Cover Mapping , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Guangming Shi,et al.  Hyperspectral Image Super-Resolution via Non-Negative Structured Sparse Representation. , 2016, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[15]  Alfred Stein,et al.  Enhanced Subpixel Mapping With Spatial Distribution Patterns of Geographical Objects , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[16]  C. Woodcock,et al.  The factor of scale in remote sensing , 1987 .

[17]  Da He,et al.  Multiobjective Subpixel Land-Cover Mapping , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Ashton M. Shortridge,et al.  Assessing Alternatives for Modeling the Spatial Distribution of Multiple Land-cover Classes at Sub-pixel Scales , 2007 .

[19]  Yang Shao,et al.  Sub-Pixel Mapping of Tree Canopy, Impervious Surfaces, and Cropland in the Laurentian Great Lakes Basin Using MODIS Time-Series Data , 2011, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[20]  Te-Ming Tu,et al.  A fast intensity-hue-saturation fusion technique with spectral adjustment for IKONOS imagery , 2004, IEEE Geoscience and Remote Sensing Letters.

[21]  Jocelyn Chanussot,et al.  A Critical Comparison Among Pansharpening Algorithms , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Gong Zhang,et al.  Subpixel Mapping Based on Hopfield Neural Network With More Prior Information , 2019, IEEE Geoscience and Remote Sensing Letters.

[23]  Wenzhong Shi,et al.  Class Allocation for Soft-Then-Hard Subpixel Mapping Algorithms With Adaptive Visiting Order of Classes , 2014, IEEE Geoscience and Remote Sensing Letters.

[24]  Peter M. Atkinson,et al.  Issues of uncertainty in super-resolution mapping and their implications for the design of an inter-comparison study , 2009 .

[25]  Jocelyn Chanussot,et al.  Using Multiple Subpixel Shifted Images With Spatial–Spectral Information in Soft-Then-Hard Subpixel Mapping , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[26]  Xiaodong Li,et al.  Super-Resolution Land Cover Mapping Using Multiscale Self-Similarity Redundancy , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[27]  Xiuping Jia,et al.  Integration of Soft and Hard Classifications Using Extended Support Vector Machines , 2009, IEEE Geoscience and Remote Sensing Letters.

[28]  Gong Zhang,et al.  Superresolution mapping based on hybrid interpolation by parallel paths , 2019 .

[29]  Liangpei Zhang,et al.  Remote Sensing Image Subpixel Mapping Based on Adaptive Differential Evolution , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[30]  Hugh G. Lewis,et al.  Super-resolution mapping using Hopfield Neural Network with panchromatic imagery , 2011 .

[31]  Jan G. P. W. Clevers,et al.  Possibilities and limitations of artificial neural networks for subpixel mapping of land cover , 2011 .

[32]  Jocelyn Chanussot,et al.  Soft-Then-Hard Super-Resolution Mapping Based on Pansharpening Technique for Remote Sensing Image , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[33]  Wenzhong Shi,et al.  Allocating Classes for Soft-Then-Hard Subpixel Mapping Algorithms in Units of Class , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Wenzhong Shi,et al.  Land Cover Change Detection at Subpixel Resolution With a Hopfield Neural Network , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[35]  Liping Di,et al.  A New Spatial Attraction Model for Improving Subpixel Land Cover Classification , 2017, Remote. Sens..

[36]  Yan Jin,et al.  Subpixel Land Cover Mapping Using Multiscale Spatial Dependence , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Peijun Li,et al.  A super-resolution mapping method using local indicator variograms , 2012 .

[38]  P. Atkinson,et al.  Sub-pixel mapping of remote sensing images based on radial basis function interpolation , 2014 .

[39]  Henry Leung,et al.  Utilizing Pansharpening Technique to Produce Sub-Pixel Resolution Thematic Map from Coarse Remote Sensing Image , 2018, Remote. Sens..

[40]  Xiaohua Tong,et al.  Automated Subpixel Surface Water Mapping from Heterogeneous Urban Environments Using Landsat 8 OLI Imagery , 2016, Remote. Sens..

[41]  Yi Ma,et al.  Superpixel-Based Extended Random Walker for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Jocelyn Chanussot,et al.  Soft-Then-Hard Subpixel Land Cover Mapping Based on Spatial-Spectral Interpolation , 2016, IEEE Geoscience and Remote Sensing Letters.

[43]  Jon Atli Benediktsson,et al.  Spectral Unmixing for the Classification of Hyperspectral Images at a Finer Spatial Resolution , 2011, IEEE Journal of Selected Topics in Signal Processing.

[44]  Xiaodong Li,et al.  Land Cover Change Mapping at the Subpixel Scale With Different Spatial-Resolution Remotely Sensed Imagery , 2011, IEEE Geoscience and Remote Sensing Letters.

[45]  Da He,et al.  Spatial-Temporal Sub-Pixel Mapping Based on Swarm Intelligence Theory , 2016, Remote. Sens..

[46]  Koen C. Mertens,et al.  A sub‐pixel mapping algorithm based on sub‐pixel/pixel spatial attraction models , 2006 .

[47]  Sen Jia,et al.  Spectral and Spatial Complexity-Based Hyperspectral Unmixing , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[48]  Wenzhong Shi,et al.  Indicator Cokriging-Based Subpixel Mapping Without Prior Spatial Structure Information , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[49]  Peter M. Atkinson,et al.  The effect of the point spread function on sub-pixel mapping , 2017 .

[50]  Peng Wang,et al.  Soft-then-hard super-resolution mapping based on a spatial attraction model with multiscale sub-pixel shifted images , 2017 .

[51]  Peter M. Atkinson,et al.  Mapping sub-pixel vector boundaries from remotely sensed images , 1996 .

[52]  M. Q. Nguyen,et al.  Superresolution mapping using a Hopfield neural network with lidar data , 2005, IEEE Geoscience and Remote Sensing Letters.

[53]  Robert De Wulf,et al.  Land cover mapping at sub-pixel scales using linear optimization techniques , 2002 .

[54]  Antonio J. Plaza,et al.  A New Genetic Method for Subpixel Mapping Using Hyperspectral Images , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[55]  Gerard B. M. Heuvelink,et al.  Hybrid Constraints of Pure and Mixed Pixels for Soft-Then-Hard Super-Resolution Mapping With Multiple Shifted Images , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[56]  Peter M. Atkinson,et al.  A linearised pixel-swapping method for mapping rural linear land cover features from fine spatial resolution remotely sensed imagery , 2007, Comput. Geosci..

[57]  Antonio J. Plaza,et al.  Joint Sparse Sub-Pixel Mapping Model with Endmember Variability for Remotely Sensed Imagery , 2016, Remote. Sens..