Integrating Object Boundary in Super-Resolution Land-Cover Mapping

This paper proposes a novel class allocation strategy in units of object (UOO) for soft-then-hard super-resolution mapping (STHSRM). STHSRM involves two processes: 1) subpixel sharpening and 2) class allocation. The UOO is implemented in the second process by integrating the object boundaries as an additional structural constraint. First, UOO obtains the object boundaries from remote-sensing images by image segmentation. The number of subpixels within an object is then calculated for each class to meet the coherence constraint of fractional images imposed by soft classification. Finally, a linear optimization model is built for each object to obtain the optimal hard class labels of subpixels. A synthetic image and two real remote-sensing images are used to evaluate the effectiveness of UOO. The results are compared visually and quantitatively with two existing class allocation methods: 1) the highest attribute values first (HAVF) and 2) units of class (UOC). The experimental results show that UOO performs better than these two methods. UOO can better reduce the salt and pepper effect in resultant maps than both HAVF and UOC when dealing with real remote-sensing images. Moreover, UOO can better maintain the structure of land-cover patches, with smoother boundaries as compared with the two methods.

[1]  P. Atkinson,et al.  Sub-pixel mapping of remote sensing images based on radial basis function interpolation , 2014 .

[2]  P. Atkinson.  Sub-pixel Target Mapping from Soft-classified, Remotely Sensed Imagery , 2005 .

[3]  Alfred Stein,et al.  Quantification of the Effects of Land-Cover-Class Spectral Separability on the Accuracy of Markov-Random-Field-Based Superresolution Mapping , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Xia Wang,et al.  Spectral–spatial based sub-pixel mapping of remotely sensed imagery with multi-scale spatial dependence , 2015 .

[5]  Yong Ge,et al.  Vectorial boundary-based sub-pixel mapping method for remote-sensing imagery , 2014 .

[6]  Wenzhong Shi,et al.  Indicator Cokriging-Based Subpixel Land Cover Mapping With Shifted Images , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[7]  Wenzhong Shi,et al.  Allocating Classes for Soft-Then-Hard Subpixel Mapping Algorithms in Units of Class , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Xiong Xu,et al.  Adaptive MAP sub-pixel mapping model based on regularization curve for multiple shifted hyperspectral imagery , 2014 .

[9]  Xiaodong Li,et al.  Land Cover Change Mapping at the Subpixel Scale With Different Spatial-Resolution Remotely Sensed Imagery , 2011, IEEE Geoscience and Remote Sensing Letters.

[10]  Yu Jiang,et al.  A subpixel mapping algorithm combining pixel-level and subpixel-level spatial dependences with binary integer programming , 2014 .

[11]  Liangpei Zhang,et al.  Sub-Pixel Mapping Based on a MAP Model With Multiple Shifted Hyperspectral Imagery , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[12]  M. Q. Nguyen,et al.  Superresolution mapping using a Hopfield neural network with lidar data , 2005, IEEE Geoscience and Remote Sensing Letters.

[13]  Robert De Wulf,et al.  Land cover mapping at sub-pixel scales using linear optimization techniques , 2002 .

[14]  Ye Zhang,et al.  BP Neural Network Based SubPixel Mapping Method , 2006 .

[15]  Thomas Blaschke,et al.  Object based image analysis for remote sensing , 2010 .

[16]  Gerard B. M. Heuvelink,et al.  Hybrid Constraints of Pure and Mixed Pixels for Soft-Then-Hard Super-Resolution Mapping With Multiple Shifted Images , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[17]  Yong Ge,et al.  Superresolution Land-Cover Mapping Based on High-Accuracy Surface Modeling , 2015, IEEE Geoscience and Remote Sensing Letters.

[18]  Peter M. Atkinson,et al.  A linearised pixel-swapping method for mapping rural linear land cover features from fine spatial resolution remotely sensed imagery , 2007, Comput. Geosci..

[19]  Fei Xiao,et al.  Superresolution Land Cover Mapping With Multiscale Information by Fusing Local Smoothness Prior and Downscaled Coarse Fractions , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Peter M. Atkinson,et al.  Mapping sub-pixel vector boundaries from remotely sensed images , 1996 .

[21]  G. Foody.  Sharpening fuzzy classification output to refine the representation of sub-pixel land cover distribution , 1998 .

[22]  U. Benz,et al.  Multi-resolution, object-oriented fuzzy analysis of remote sensing data for GIS-ready information , 2004 .

[23]  Hugh G. Lewis,et al.  Super-resolution target identification from remotely sensed images using a Hopfield neural network , 2001, IEEE Trans. Geosci. Remote. Sens..

[24]  Yong Ge,et al.  Sub-pixel land-cover mapping with improved fraction images upon multiple-point simulation , 2013, Int. J. Appl. Earth Obs. Geoinformation.

[25]  Brian Johnson,et al.  Unsupervised image segmentation evaluation and refinement using a multi-scale approach , 2011 .

[26]  G. Foody,et al.  Sub-pixel land cover composition estimation using a linear mixture model and fuzzy membership functions , 1994 .

[27]  Yong Ge,et al.  Development and Testing of a Subpixel Mapping Algorithm , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Thomas Blaschke,et al.  Geographic Object-Based Image Analysis – Towards a new paradigm , 2014, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[29]  Jan G. P. W. Clevers,et al.  Possibilities and limitations of artificial neural networks for subpixel mapping of land cover , 2011 .

[30]  Qi Feng,et al.  Superresolution Mapping of Remotely Sensed Image Based on Hopfield Neural Network With Anisotropic Spatial Dependence Model , 2014, IEEE Geoscience and Remote Sensing Letters.

[31]  John Platt,et al.  Probabilistic Outputs for Support vector Machines and Comparisons to Regularized Likelihood Methods , 1999 .

[32]  Giles M. Foody,et al.  Combining Pixel Swapping and Contouring Methods to Enhance Super-Resolution Mapping , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[33]  Lieven Verbeke,et al.  Sub-pixel mapping and sub-pixel sharpening using neural network predicted wavelet coefficients , 2004 .

[34]  Fei Xiao,et al.  Super-resolution land-cover mapping using multiple sub-pixel shifted remotely sensed images , 2010 .

[35]  Fei Xiao,et al.  Object-based sub-pixel mapping of buildings incorporating the prior shape information from remotely sensed imagery , 2012, Int. J. Appl. Earth Obs. Geoinformation.

[36]  Yong Ge,et al.  Super-Resolution Land Cover Mapping Based on Multiscale Spatial Regularization , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[37]  Liangpei Zhang,et al.  An Adaptive Subpixel Mapping Method Based on MAP Model and Class Determination Strategy for Hyperspectral Remote Sensing Imagery , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Alfred Stein,et al.  Markov-random-field-based super-resolution mapping for identification of urban trees in VHR images , 2011 .

[39]  Koen C. Mertens,et al.  A sub‐pixel mapping algorithm based on sub‐pixel/pixel spatial attraction models , 2006 .

[40]  G. M. Foody,et al.  Relating the land-cover composition of mixed pixels to artificial neural network classification outpout , 1996 .

[41]  Liangpei Zhang,et al.  Remote Sensing Image Subpixel Mapping Based on Adaptive Differential Evolution , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[42]  Antônio Miguel Vieira Monteiro,et al.  Parameter selection for region‐growing image segmentation algorithms using spatial autocorrelation , 2006 .

[43]  Wenzhong Shi,et al.  Indicator Cokriging-Based Subpixel Mapping Without Prior Spatial Structure Information , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[44]  E. L. Lawler,et al.  Branch-and-Bound Methods: A Survey , 1966, Oper. Res..

[45]  Fei Xiao,et al.  Interpolation-based super-resolution land cover mapping , 2013 .

[46]  Fei Xiao,et al.  Superresolution Land Cover Mapping Using Spatial Regularization , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[47]  Martin Brown,et al.  Linear spectral mixture models and support vector machines for remote sensing , 2000, IEEE Trans. Geosci. Remote. Sens..

[48]  Ashton M. Shortridge,et al.  Assessing Alternatives for Modeling the Spatial Distribution of Multiple Land-cover Classes at Sub-pixel Scales , 2007 .

[49]  Xiaodong Li,et al.  Spatially Adaptive Superresolution Land Cover Mapping With Multispectral and Panchromatic Images , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[50]  Alexandre Boucher,et al.  Super-resolution land cover mapping with indicator geostatistics , 2006 .

[51]  Pramod K. Varshney,et al.  Super-resolution land cover mapping using a Markov random field based approach , 2005 .