Hybrid Constraints of Pure and Mixed Pixels for Soft-Then-Hard Super-Resolution Mapping With Multiple Shifted Images

Multiple shifted images (MSIs) have been widely applied to many super-resolution mapping (SRM) approaches to improve the accuracy of fine-scale land-cover maps. Most SRM methods with MSIs involve two processes: subpixel sharpening and class allocation. Complementary information from the MSIs has been successfully adopted to produce soft attribute values of subpixels during the subpixel sharpening process. Such information, however, is not used in the second process of class allocation. In this paper, a new class-allocation algorithm, named “hybrid constraints of pure and mixed pixels” (HCPMP), is proposed to allocate land-cover classes to subpixels using MSIs. HCPMP first determines the classes of subpixels that overlap with the pure pixels of auxiliary images in MSIs, after which the remaining subpixels are classified using information derived from the mixed pixels of the base image in MSIs. An artificial image and two remote sensing images were used to evaluate the performance of the proposed HCPMP algorithm. The experimental results demonstrate that HCPMP successfully applied MSIs to produce SRM maps that are visually closer to the reference images and that have greater accuracy than five existing class-allocation algorithms. Especially, it can produce more accurate SRM maps for high-resolution land-cover classes than low-resolution cases. The algorithm takes slightly less runtime than class allocation using linear optimization techniques. Hence, HCPMP provides a valuable new solution for class allocation in SRM using auxiliary data from MSIs.

[1]  Yu Jiang,et al.  A subpixel mapping algorithm combining pixel-level and subpixel-level spatial dependences with binary integer programming , 2014 .

[2]  Alexandre Boucher,et al.  Super-resolution land cover mapping with indicator geostatistics , 2006 .

[3]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[4]  Liguo Wang.  Subpixel Mapping Using Markov Random Field With Multiple Spectral Constraints From Subpixel Shifted Remote Sensing Images , 2013, IEEE Geoscience and Remote Sensing Letters.

[5]  Hugh G. Lewis,et al.  Increasing the spatial resolution of agricultural land cover maps using a Hopfield neural network , 2003, Int. J. Geogr. Inf. Sci..

[6]  Wenzhong Shi,et al.  Utilizing Multiple Subpixel Shifted Images in Subpixel Mapping With Image Interpolation , 2014, IEEE Geoscience and Remote Sensing Letters.

[7]  Liangpei Zhang,et al.  A sub-pixel mapping method based on an attraction model for multiple shifted remotely sensed images , 2014, Neurocomputing.

[8]  Xiaoying Zheng,et al.  Geographical Detectors‐Based Health Risk Assessment and its Application in the Neural Tube Defects Study of the Heshun Region, China , 2010, Int. J. Geogr. Inf. Sci..

[9]  Pramod K. Varshney,et al.  Super-resolution land cover mapping using a Markov random field based approach , 2005 .

[10]  Liangpei Zhang,et al.  Sub-pixel Mapping with Multiple Shifted Remotely Sensed Images Based on Attraction Model , 2011, IScIDE.

[11]  Liangpei Zhang,et al.  Adaptive Subpixel Mapping Based on a Multiagent System for Remote-Sensing Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Robert De Wulf,et al.  Land cover mapping at sub-pixel scales using linear optimization techniques , 2002 .

[13]  Ye Zhang,et al.  BP Neural Network Based SubPixel Mapping Method , 2006 .

[14]  Wenzhong Shi,et al.  Allocating Classes for Soft-Then-Hard Subpixel Mapping Algorithms in Units of Class , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[15]  L. P. C. Verbeke,et al.  Using genetic algorithms in sub-pixel mapping , 2003 .

[16]  Giles M. Foody,et al.  Super-resolution mapping of lakes from imagery with a coarse spatial and fine temporal resolution , 2012, Int. J. Appl. Earth Obs. Geoinformation.

[17]  Liangpei Zhang,et al.  A super-resolution reconstruction algorithm for surveillance images , 2010, Signal Process..

[18]  Peter M. Atkinson,et al.  Mapping sub-pixel vector boundaries from remotely sensed images , 1996 .

[19]  Hugh G. Lewis,et al.  Superresolution mapping using a hopfield neural network with fused images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Xiong Xu,et al.  Adaptive MAP sub-pixel mapping model based on regularization curve for multiple shifted hyperspectral imagery , 2014 .

[21]  P. Atkinson.  Sub-pixel Target Mapping from Soft-classified, Remotely Sensed Imagery , 2005 .

[22]  Alfred Stein,et al.  Quantification of the Effects of Land-Cover-Class Spectral Separability on the Accuracy of Markov-Random-Field-Based Superresolution Mapping , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Yong Ge,et al.  Vectorial boundary-based sub-pixel mapping method for remote-sensing imagery , 2014 .

[24]  Liangpei Zhang,et al.  Remote Sensing Image Subpixel Mapping Based on Adaptive Differential Evolution , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[25]  Liangpei Zhang,et al.  A new sub-pixel mapping algorithm based on a BP neural network with an observation model , 2008, Neurocomputing.

[26]  P. Atkinson,et al.  Sub-pixel mapping of remote sensing images based on radial basis function interpolation , 2014 .

[27]  Peter M. Atkinson,et al.  Issues of uncertainty in super-resolution mapping and their implications for the design of an inter-comparison study , 2009 .

[28]  Wenzhong Shi,et al.  Indicator Cokriging-Based Subpixel Land Cover Mapping With Shifted Images , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[29]  Hugh G. Lewis,et al.  Super-resolution mapping using Hopfield Neural Network with panchromatic imagery , 2011 .

[30]  Giles M. Foody,et al.  Combining Hopfield Neural Network and Contouring Methods to Enhance Super-Resolution Mapping , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[31]  G. Foody.  Sharpening fuzzy classification output to refine the representation of sub-pixel land cover distribution , 1998 .

[32]  Hugh G. Lewis,et al.  Super-resolution land cover pattern prediction using a Hopfield neural network , 2002 .

[33]  Liangpei Zhang,et al.  Sub-Pixel Mapping Based on a MAP Model With Multiple Shifted Hyperspectral Imagery , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[34]  M. Q. Nguyen,et al.  Superresolution mapping using a Hopfield neural network with lidar data , 2005, IEEE Geoscience and Remote Sensing Letters.

[35]  Xiaodong Li,et al.  Using a sub-pixel mapping model to improve the accuracy of landscape pattern indices , 2011 .

[36]  Jan G. P. W. Clevers,et al.  Possibilities and limitations of artificial neural networks for subpixel mapping of land cover , 2011 .

[37]  F. Ling,et al.  Waterline mapping at the subpixel scale from remote sensing imagery with high‐resolution digital elevation models , 2008 .

[38]  Paul Aplin,et al.  Sub-pixel land cover mapping for per-field classification , 2001 .

[39]  Xiaodong Li,et al.  Land Cover Change Mapping at the Subpixel Scale With Different Spatial-Resolution Remotely Sensed Imagery , 2011, IEEE Geoscience and Remote Sensing Letters.

[40]  Liangpei Zhang,et al.  An Adaptive Subpixel Mapping Method Based on MAP Model and Class Determination Strategy for Hyperspectral Remote Sensing Imagery , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Peter M. Atkinson,et al.  A linearised pixel-swapping method for mapping rural linear land cover features from fine spatial resolution remotely sensed imagery , 2007, Comput. Geosci..

[42]  Xiaodong Li,et al.  Spatially Adaptive Superresolution Land Cover Mapping With Multispectral and Panchromatic Images , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[43]  Alfred Stein,et al.  Markov-random-field-based super-resolution mapping for identification of urban trees in VHR images , 2011 .

[44]  Koen C. Mertens,et al.  A sub‐pixel mapping algorithm based on sub‐pixel/pixel spatial attraction models , 2006 .

[45]  P. Atkinson,et al.  Mapping sub-pixel proportional land cover with AVHRR imagery , 1997 .

[46]  Qi Feng,et al.  Superresolution Mapping of Remotely Sensed Image Based on Hopfield Neural Network With Anisotropic Spatial Dependence Model , 2014, IEEE Geoscience and Remote Sensing Letters.

[47]  C. Woodcock,et al.  The factor of scale in remote sensing , 1987 .

[48]  Liangpei Zhang,et al.  Sub-pixel mapping based on artificial immune systems for remote sensing imagery , 2013, Pattern Recognit..

[49]  Xiaodong Li,et al.  Spatially adaptive smoothing parameter selection for Markov random field based sub-pixel mapping of remotely sensed images , 2012 .

[50]  Alexandre Boucher,et al.  Sub-pixel Mapping of Coarse Satellite Remote Sensing Images with Stochastic Simulations from Training Images , 2009 .

[51]  Yong Ge,et al.  Sub-pixel land-cover mapping with improved fraction images upon multiple-point simulation , 2013, Int. J. Appl. Earth Obs. Geoinformation.

[52]  Giles M. Foody,et al.  Status of land cover classification accuracy assessment , 2002 .

[53]  P. Atkinson,et al.  Multiple-class land-cover mapping at the sub-pixel scale using a Hopfield neural network , 2001 .

[54]  Yun Chen,et al.  DEM-based modification of pixel-swapping algorithm for enhancing floodplain inundation mapping , 2014 .

[55]  Giles M. Foody,et al.  Combining Pixel Swapping and Contouring Methods to Enhance Super-Resolution Mapping , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[56]  Danfeng Liu,et al.  Particle swarm optimization-based sub-pixel mapping for remote-sensing imagery , 2012 .

[57]  Sergios Theodoridis,et al.  A Novel Efficient Cluster-Based MLSE Equalizer for Satellite Communication Channels with-QAM Signaling , 2006, EURASIP J. Adv. Signal Process..

[58]  Fei Xiao,et al.  Super-resolution land-cover mapping using multiple sub-pixel shifted remotely sensed images , 2010 .

[59]  Yong Ge,et al.  Development and Testing of a Subpixel Mapping Algorithm , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[60]  P. Atkinson,et al.  Land Cover Mapping at the Sub-pixel Scale using a Hopfield Neural Network , 2000 .

[61]  Danfeng Liu,et al.  Integration of spatial attractions between and within pixels for sub-pixel mapping , 2012 .

[62]  Fei Xiao,et al.  Object-based sub-pixel mapping of buildings incorporating the prior shape information from remotely sensed imagery , 2012, Int. J. Appl. Earth Obs. Geoinformation.

[63]  Yong Ge,et al.  Super-Resolution Land Cover Mapping Based on Multiscale Spatial Regularization , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[64]  Sabine Süsstrunk,et al.  A Frequency Domain Approach to Registration of Aliased Images with Application to Super-resolution , 2006, EURASIP J. Adv. Signal Process..