Utilizing Parallel Networks to Produce Sub-Pixel Shifted Images With Multiscale Spatio-Spectral Information for Soft-Then-Hard Sub-Pixel Mapping

The distribution information of the land-cover classes in remote sensing image can be explored by sub-pixel mapping (SPM) technique. The soft-then-hard sub-pixel mapping (STHSPM) has become an important type of SPM method. The sub-pixel shifted images (SSI) from the same area can be utilized to improve the mapping result. However, the type of information in the fine SSI is insufficient, and the SSI-based STHSPM results are affected. To solve this problem, utilizing parallel networks to produce sub-pixel shifted images with multiscale spatio-spectral information (SSI-MSSI) for STHSPM is proposed. In SSI-MSSI, the fine SSI with multi-scale information and spatio-spectral information are obtained, respectively, from parallel networks, namely the multiscale network and spatio-spectral network. The multiscale network is spectral unmixing followed by mixed spatio attraction model and the spatio-spectral network is projected onto convex sets super-resolution followed by spectral unmixing. There two different kinds of fine SSI are integrated by appropriate weight parameter to produce the fine fractional images. Class allocation method then allocates the class labels into to each sub-pixel by the predicted value from the integrated fine fractional images. Three remote sensing images are tested to show that the proposed SSI-MSSI produces more accurate mapping results than the existing SSI-based STHSPM in the literature. In the quantitative accuracy assessment, the SSI-MSSI shows the best performance with the percentage correctly classified of 99.09% and 74.07% in the experimental results.

[1]  Hugh G. Lewis,et al.  Superresolution mapping using a hopfield neural network with fused images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Paul Scheunders,et al.  Contextual Subpixel Mapping of Hyperspectral Images Making Use of a High Resolution Color Image , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[3]  Wenzhong Shi,et al.  Indicator Cokriging-Based Subpixel Land Cover Mapping With Shifted Images , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[4]  Wenzhong Shi,et al.  Indicator Cokriging-Based Subpixel Mapping Without Prior Spatial Structure Information , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Henry Leung,et al.  Utilizing Pansharpening Technique to Produce Sub-Pixel Resolution Thematic Map from Coarse Remote Sensing Image , 2018, Remote. Sens..

[6]  Peijun Li,et al.  A super-resolution mapping method using local indicator variograms , 2012 .

[7]  P. Atkinson,et al.  Sub-pixel mapping of remote sensing images based on radial basis function interpolation , 2014 .

[8]  Liangpei Zhang,et al.  A sub-pixel mapping method based on an attraction model for multiple shifted remotely sensed images , 2014, Neurocomputing.

[9]  Yong Ge,et al.  Superresolution Land-Cover Mapping Based on High-Accuracy Surface Modeling , 2015, IEEE Geoscience and Remote Sensing Letters.

[10]  Jon Atli Benediktsson,et al.  Spectral Unmixing for the Classification of Hyperspectral Images at a Finer Spatial Resolution , 2011, IEEE Journal of Selected Topics in Signal Processing.

[11]  Xiaodong Li,et al.  Land Cover Change Mapping at the Subpixel Scale With Different Spatial-Resolution Remotely Sensed Imagery , 2011, IEEE Geoscience and Remote Sensing Letters.

[12]  Chein-I Chang,et al.  Random N-Finder (N-FINDR) Endmember Extraction Algorithms for Hyperspectral Imagery , 2011, IEEE Transactions on Image Processing.

[13]  Wenzhong Shi,et al.  Utilizing Multiple Subpixel Shifted Images in Subpixel Mapping With Image Interpolation , 2014, IEEE Geoscience and Remote Sensing Letters.

[14]  Peng Wang,et al.  Soft-then-hard super-resolution mapping based on a spatial attraction model with multiscale sub-pixel shifted images , 2017 .

[15]  Hugh G. Lewis,et al.  Super-resolution target identification from remotely sensed images using a Hopfield neural network , 2001, IEEE Trans. Geosci. Remote. Sens..

[16]  Jocelyn Chanussot,et al.  Using Multiple Subpixel Shifted Images With Spatial–Spectral Information in Soft-Then-Hard Subpixel Mapping , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[17]  Hugh G. Lewis,et al.  Super-resolution mapping using Hopfield Neural Network with panchromatic imagery , 2011 .

[18]  Ying Wang,et al.  Spectral Unmixing Model Based on Least Squares Support Vector Machine With Unmixing Residue Constraints , 2013, IEEE Geoscience and Remote Sensing Letters.

[19]  Lieven Verbeke,et al.  Sub-pixel mapping and sub-pixel sharpening using neural network predicted wavelet coefficients , 2004 .

[20]  Alexandre Boucher,et al.  Super-resolution land cover mapping with indicator geostatistics , 2006 .

[21]  Liguo Wang.  Subpixel Mapping Using Markov Random Field With Multiple Spectral Constraints From Subpixel Shifted Remote Sensing Images , 2013, IEEE Geoscience and Remote Sensing Letters.

[22]  Jocelyn Chanussot,et al.  Soft-Then-Hard Subpixel Land Cover Mapping Based on Spatial-Spectral Interpolation , 2016, IEEE Geoscience and Remote Sensing Letters.

[23]  Fei Xiao,et al.  Interpolation-based super-resolution land cover mapping , 2013 .

[24]  P. Fisher.  The pixel: A snare and a delusion , 1997 .

[25]  Fei Xiao,et al.  Sub-pixel mapping of remotely sensed imagery with hybrid intra- and inter-pixel dependence , 2013 .

[26]  Jan G. P. W. Clevers,et al.  Possibilities and limitations of artificial neural networks for subpixel mapping of land cover , 2011 .

[27]  Giles M. Foody,et al.  Impact of Land Cover Patch Size on the Accuracy of Patch Area Representation in HNN-Based Super Resolution Mapping , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[28]  Liangpei Zhang,et al.  Sub-Pixel Mapping Based on a MAP Model With Multiple Shifted Hyperspectral Imagery , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[29]  M. Q. Nguyen,et al.  Superresolution mapping using a Hopfield neural network with lidar data , 2005, IEEE Geoscience and Remote Sensing Letters.

[30]  Peter M. Atkinson,et al.  A linearised pixel-swapping method for mapping rural linear land cover features from fine spatial resolution remotely sensed imagery , 2007, Comput. Geosci..

[31]  Yang Shao,et al.  Sub-Pixel Mapping of Tree Canopy, Impervious Surfaces, and Cropland in the Laurentian Great Lakes Basin Using MODIS Time-Series Data , 2011, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[32]  Peter M. Atkinson,et al.  Issues of uncertainty in super-resolution mapping and their implications for the design of an inter-comparison study , 2009 .

[33]  Chunhui Zhao,et al.  Producing Subpixel Resolution Thematic Map From Coarse Imagery: MAP Algorithm-Based Super-Resolution Recovery , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[34]  P. Atkinson.  Sub-pixel Target Mapping from Soft-classified, Remotely Sensed Imagery , 2005 .

[35]  Ashton M. Shortridge,et al.  Assessing Alternatives for Modeling the Spatial Distribution of Multiple Land-cover Classes at Sub-pixel Scales , 2007 .

[36]  Wenzhong Shi,et al.  Allocating Classes for Soft-Then-Hard Subpixel Mapping Algorithms in Units of Class , 2014, IEEE Transactions on Geoscience and Remote Sensing.