Super-resolution land-cover mapping based on the selective endmember spectral mixture model in hyperspectral imagery

Hyperspectral imagery contains a large number of mixed pixels, which limits its utility. Super-resolution mapping is a potential solution to this problem, designed to use the proportion of land covers to obtain a sharpened thematic map with higher resolution. Endmember is a fundamental variable in the process, which is a critical issue for decomposing the mixed pixels and sharpening the subpixel level images. In most cases, the forms of the endmember combination in diverse pixels are very distinct. However, traditional soft classification methods neglect this point and model endmembers as fixed composition entities. Due to the reliance on this flawed spectral mixture model, the super-resolution mapping is unable to represent detail in the following result image precisely and effectively. In this work, therefore, endmember variability is considered, focusing on identifying the most suitable form of the endmember combination. This issue is addressed by applying a new selective endmember spectral mixture (SESM) model, which allows the endmember number and type to vary at a per pixel level, and then super-resolution mapping can be subsequently performed according to the produced spectral abundances. Two different types of hyperspectral data are used in our experiments. First, the SESM model is tested individually for validation of its applicability. Then the complete algorithm integrating SESM and super-resolution mapping based on a back-propagation neural network is evaluated. It showed that a more accurate endmember combination in the parent pixel results in a finer representation image. The experimental results prove that the proposed algorithm can effectively improve the accuracy of the super-resolution mapping results compared to the traditional method.

[1]  Chein-I Chang,et al.  Fully constrained least squares linear spectral mixture analysis method for material quantification in hyperspectral imagery , 2001, IEEE Trans. Geosci. Remote. Sens..

[2]  Peter M. Atkinson Super-resolution target mapping from soft classified remotely sensed imagery , 2001 .

[3]  Weiguo Liu,et al.  Comparison of non-linear mixture models: sub-pixel classification , 2005 .

[4]  Antonio J. Plaza,et al.  A quantitative and comparative analysis of endmember extraction algorithms from hyperspectral data , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[5]  John F. Mustard,et al.  Spectral unmixing , 2002, IEEE Signal Process. Mag..

[6]  Sen Jia,et al.  Constrained Nonnegative Matrix Factorization for Hyperspectral Unmixing , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Maurice D. Craig,et al.  Minimum-volume transforms for remotely sensed data , 1994, IEEE Trans. Geosci. Remote. Sens..

[8]  L. P. C. Verbeke,et al.  Using genetic algorithms in sub-pixel mapping , 2003 .

[9]  G. Shaw,et al.  Signal processing for hyperspectral image exploitation , 2002, IEEE Signal Process. Mag..

[10]  David A. Landgrebe,et al.  Hyperspectral image data analysis , 2002, IEEE Signal Process. Mag..

[11]  F. J. A. López,et al.  Restoring SPOT images using PSF-derived deconvolution filters , 2002 .

[12]  Peter M. Atkinson,et al.  Issues of uncertainty in super-resolution mapping and their implications for the design of an inter-comparison study , 2009 .

[13]  G. Foody Sharpening fuzzy classification output to refine the representation of sub-pixel land cover distribution , 1998 .

[14]  Robert De Wulf,et al.  Land cover mapping at sub-pixel scales using linear optimization techniques , 2002 .

[15]  Ye Zhang,et al.  BP Neural Network Based SubPixel Mapping Method , 2006 .

[16]  John R. Schott,et al.  Application of Spectral Mixture Analysis and Image Fusion Techniques for Image Sharpening , 1998 .

[17]  Gail A. Carpenter,et al.  A Neural Network Method for Mixture Estimation for Vegetation Mapping , 1999 .

[18]  P. Atkinson,et al.  Mapping sub-pixel proportional land cover with AVHRR imagery , 1997 .

[19]  D. Roberts,et al.  Hierarchical Multiple Endmember Spectral Mixture Analysis (MESMA) of hyperspectral imagery for urban environments , 2009 .

[20]  Mark L. G. Althouse,et al.  Least squares subspace projection approach to mixed pixel classification for hyperspectral images , 1998, IEEE Trans. Geosci. Remote. Sens..

[21]  Mario Winter,et al.  N-FINDR: an algorithm for fast autonomous spectral end-member determination in hyperspectral data , 1999, Optics & Photonics.

[22]  Fei Xiao,et al.  Super-resolution land-cover mapping using multiple sub-pixel shifted remotely sensed images , 2010 .

[23]  Alexandre Boucher,et al.  Sub-pixel Mapping of Coarse Satellite Remote Sensing Images with Stochastic Simulations from Training Images , 2009 .

[24]  Rama Chellappa,et al.  Hybrid Detectors for Subpixel Targets , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Elisabetta Binaghi,et al.  Comparison of the multilayer perceptron with neuro-fuzzy techniques in the estimation of cover class mixture in remotely sensed data , 2001, IEEE Trans. Geosci. Remote. Sens..

[26]  Bo Du,et al.  Random-Selection-Based Anomaly Detector for Hyperspectral Imagery , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Ye Zhang,et al.  Integration of Spatial–Spectral Information for Resolution Enhancement in Hyperspectral Images , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Chein-I Chang,et al.  A posteriori least squares orthogonal subspace projection approach to desired signature extraction and detection , 1997, IEEE Trans. Geosci. Remote. Sens..

[29]  Robert De Wulf,et al.  Sub-pixel mapping with neural networks : real-world spatial configurations learned from artificial shapes , 2003 .

[30]  Hugh G. Lewis,et al.  Super-resolution target identification from remotely sensed images using a Hopfield neural network , 2001, IEEE Trans. Geosci. Remote. Sens..

[31]  T. Kemper,et al.  A new tool for variable multiple endmember spectral mixture analysis (VMESMA) , 2005 .

[32]  Liangpei Zhang,et al.  A new sub-pixel mapping algorithm based on a BP neural network with an observation model , 2008, Neurocomputing.

[33]  Bo Du,et al.  Hybrid Detectors Based on Selective Endmembers , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Michael Egmont-Petersen,et al.  Image processing with neural networks - a review , 2002, Pattern Recognit..

[35]  Lieven Verbeke,et al.  Sub-pixel mapping and sub-pixel sharpening using neural network predicted wavelet coefficients , 2004 .

[36]  Chein-I Chang,et al.  Estimation of number of spectrally distinct signal sources in hyperspectral imagery , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Alexandre Boucher,et al.  Geostatistical Solutions for Super-Resolution Land Cover Mapping , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Paul Aplin,et al.  Sub-pixel land cover mapping for per-field classification , 2001 .

[39]  David A. Landgrebe,et al.  Signal Theory Methods in Multispectral Remote Sensing , 2003 .

[40]  Hugh G. Lewis,et al.  Superresolution mapping using a hopfield neural network with fused images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Wim Bakker,et al.  CCSM: Cross correlogram spectral matching , 1997 .

[42]  D. Roberts,et al.  Sub-pixel mapping of urban land cover using multiple endmember spectral mixture analysis: Manaus, Brazil , 2007 .

[43]  J. Settle,et al.  Linear mixing and the estimation of ground cover proportions , 1993 .