Regional Clustering-Based Spatial Preprocessing for Hyperspectral Unmixing

Abstract Hyperspectral unmixing is an important technique for remote sensing image exploitation. It aims to decompose a mixed pixel into a collection of spectrally pure components (called endmembers ), and their corresponding proportions (called fractional abundances ). In recent years, many studies have revealed that unmixing using spectral information alone does not sufficiently incorporate the spatial information in the remotely sensed hyperspectral image, as the pixels are treated as isolated entities without taking into account the existing local correlation among them. To address this issue, several spatial preprocessing methods have been developed to include spatial information in the spectral unmixing process. In this paper, we present a new spatial preprocessing method which presents several advantages over existing methods. The proposed method is derived from the Simple Linear Iterative Clustering (SLIC) method, which adapts the global search scope of the clustering into local regions. As a result, the spatial correlation and the spectral similarity are intrinsically incorporated at the clustering step, which results in O ( N ) computational complexity of the clustering procedure with N being the number of pixels in the image. First, a regional clustering is iteratively performed by using spatial and spectral information simultaneously. The obtained result is a set of clustered partitions that exhibit both spectral similarity and spatial correlation. Then, for each partition we select a subset of candidate pixels with high spectral purity. Finally, the obtained candidate pixels are gathered together and fed to a spectral-based endmember extraction method to extract the final endmembers and their corresponding fractional abundances. Our newly developed method naturally integrates the spatial and the spectral information to retain the most relevant endmember candidates. Our experimental results, conducted using both synthetic and real hyperspectral scenes, indicate that the proposed method can obtain accurate unmixing results with less than 0.5% of the number of pixels used by other state-of-the-art methods. This confirms the advantages of integrating spatial and spectral information for hyperspectral unmixing purposes.

[1]  P. Switzer,et al.  A transformation for ordering multispectral data in terms of image quality with implications for noise removal , 1988 .

[2]  Geoffrey H. Ball,et al.  ISODATA, A NOVEL METHOD OF DATA ANALYSIS AND PATTERN CLASSIFICATION , 1965 .

[3]  K. C. Ho,et al.  Endmember Variability in Hyperspectral Analysis: Addressing Spectral Variability During Spectral Unmixing , 2014, IEEE Signal Processing Magazine.

[4]  Derek Rogge,et al.  Integration of spatial–spectral information for the improved extraction of endmembers , 2007 .

[5]  Michalis Vazirgiannis,et al.  Quality Scheme Assessment in the Clustering Process , 2000, PKDD.

[6]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[7]  Antonio J. Plaza,et al.  Sparse Unmixing of Hyperspectral Data , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Mario Winter,et al.  N-FINDR: an algorithm for fast autonomous spectral end-member determination in hyperspectral data , 1999, Optics & Photonics.

[9]  Mario Parente,et al.  Uniformity-Based Superpixel Segmentation of Hyperspectral Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Antonio J. Plaza,et al.  Spatial-Spectral Preprocessing Prior to Endmember Identification and Unmixing of Remotely Sensed Hyperspectral Data , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[11]  Derek M. Rogge,et al.  Iterative Spectral Unmixing for Optimizing Per-Pixel Endmember Sets , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[12]  A. French,et al.  Effect of image spatial and spectral characteristics on mapping semi-arid rangeland vegetation using multiple endmember spectral mixture analysis (MESMA) , 2013 .

[13]  D. Roberts,et al.  Green vegetation, nonphotosynthetic vegetation, and soils in AVIRIS data , 1993 .

[14]  Jeffrey H. Bowles,et al.  Hyperspectral image segmentation using spatial-spectral graphs , 2012, Defense + Commercial Sensing.

[15]  J. Tilton,et al.  Analysis of hierarchically related image segmentations , 2003, IEEE Workshop on Advances in Techniques for Analysis of Remotely Sensed Data, 2003.

[16]  Xiaojun Yang,et al.  Mapping vegetation in an urban area with stratified classification and multiple endmember spectral mixture analysis , 2013 .

[17]  Csaba Legány,et al.  Cluster validity measurement techniques , 2006 .

[18]  Chein-I Chang,et al.  Estimation of number of spectrally distinct signal sources in hyperspectral imagery , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Bo Du,et al.  An Image-Based Endmember Bundle Extraction Algorithm Using Both Spatial and Spectral Information , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[20]  D. Roberts,et al.  Comparing endmember selection techniques for accurate mapping of plant species and land cover using imaging spectrometer data , 2012 .

[21]  Shaohui Mei,et al.  Spatial Purity Based Endmember Extraction for Spectral Mixture Analysis , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Maria C. Torres-Madronero,et al.  Integrating Spatial Information in Unsupervised Unmixing of Hyperspectral Imagery Using Multiscale Representation , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[23]  Ben Somers,et al.  Multi-temporal hyperspectral mixture analysis and feature selection for invasive species mapping in rainforests , 2013 .

[24]  David R. Thompson,et al.  Superpixel Endmember Detection , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Antonio J. Plaza,et al.  Minimum Volume Simplex Analysis: A Fast Algorithm for Linear Hyperspectral Unmixing , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Le Wang,et al.  Incorporating spatial information in spectral unmixing: A review , 2014 .

[27]  Sven J. Dickinson,et al.  TurboPixels: Fast Superpixels Using Geometric Flows , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Paul D. Gader,et al.  Superpixel Estimation for Hyperspectral Imagery , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[29]  Antonio J. Plaza,et al.  Automated Extraction of Image-Based Endmember Bundles for Improved Spectral Unmixing , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[30]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  John F. Mustard,et al.  Spectral unmixing , 2002, IEEE Signal Process. Mag..

[32]  Sen Jia,et al.  Constrained Nonnegative Matrix Factorization for Hyperspectral Unmixing , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Liangpei Zhang,et al.  A Hybrid Automatic Endmember Extraction Algorithm Based on a Local Window , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[34]  D. Roberts,et al.  Endmember selection for multiple endmember spectral mixture analysis using endmember average RMSE , 2003 .

[35]  Gregory Asner,et al.  Endmember bundles: a new approach to incorporating endmember variability into spectral mixture analysis , 2000, IEEE Trans. Geosci. Remote. Sens..

[36]  D. Roberts,et al.  Multiple Endmember Spectral Mixture Analysis (MESMA) to map burn severity levels from Landsat images in Mediterranean countries , 2013 .

[37]  Ce Zhang,et al.  Performance Evaluation of Cluster Validity Indices (CVIs) on Multi/Hyperspectral Remote Sensing Datasets , 2016, Remote. Sens..

[38]  Dar A. Roberts,et al.  Mapping Plant Functional Types at Multiple Spatial Resolutions Using Imaging Spectrometer Data , 2011 .

[39]  J. Boardman,et al.  Mapping target signatures via partial unmixing of AVIRIS data: in Summaries , 1995 .

[40]  Antonio J. Plaza,et al.  Collaborative Sparse Regression for Hyperspectral Unmixing , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Alfonso Fernández-Manso,et al.  Evaluation of potential of multiple endmember spectral mixture analysis (MESMA) for surface coal mining affected area mapping in different world forest ecosystems , 2012 .

[42]  Antonio J. Plaza,et al.  A New Preprocessing Technique for Fast Hyperspectral Endmember Extraction , 2013, IEEE Geoscience and Remote Sensing Letters.

[43]  Antonio J. Plaza,et al.  Spatial/spectral endmember extraction by multidimensional morphological operations , 2002, IEEE Trans. Geosci. Remote. Sens..

[44]  Hassan Ghassemian,et al.  Enhancing Hyperspectral Endmember Extraction Using Clustering and Oversegmentation-Based Preprocessing , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[45]  Pol Coppin,et al.  Endmember variability in Spectral Mixture Analysis: A review , 2011 .

[46]  D. Roberts,et al.  Sub-pixel mapping of urban land cover using multiple endmember spectral mixture analysis: Manaus, Brazil , 2007 .

[47]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[48]  Antonio J. Plaza,et al.  Region-Based Spatial Preprocessing for Endmember Extraction and Spectral Unmixing , 2011, IEEE Geoscience and Remote Sensing Letters.

[49]  Y. C. Pati,et al.  Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[50]  José M. Bioucas-Dias,et al.  Hyperspectral Subspace Identification , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[51]  Stefano Soatto,et al.  Quick Shift and Kernel Methods for Mode Seeking , 2008, ECCV.

[52]  Gregory S. Okin,et al.  Comparison of methods for estimation of absolute vegetation and soil fractional cover using MODIS normalized BRDF-adjusted reflectance data , 2013 .

[53]  Shunlin Liang,et al.  Earth system science related imaging spectroscopy — an assessment , 2009 .

[54]  D. Roberts,et al.  Hierarchical Multiple Endmember Spectral Mixture Analysis (MESMA) of hyperspectral imagery for urban environments , 2009 .

[55]  Hassan Ghassemian,et al.  A Fast Spatial–Spectral Preprocessing Module for Hyperspectral Endmember Extraction , 2016, IEEE Geoscience and Remote Sensing Letters.

[56]  Chein-I. Chang,et al.  New Hyperspectral Discrimination Measure for Spectral Characterization , 2004 .

[57]  Ben Somers,et al.  Heathland conservation status mapping through integration of hyperspectral mixture analysis and decision tree classifiers , 2012 .

[58]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[59]  David W. Messinger,et al.  Spatially Adaptive Hyperspectral Unmixing , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[60]  José M. Bioucas-Dias,et al.  Vertex component analysis: a fast algorithm to unmix hyperspectral data , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[61]  Maria C. Torres-Madronero,et al.  Unmixing Analysis of a Time Series of Hyperion Images Over the Guánica Dry Forest in Puerto Rico , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[62]  Jon Atli Benediktsson,et al.  Recent Advances in Techniques for Hyperspectral Image Processing , 2009 .

[63]  Benoit Rivard,et al.  The Successive Projection Algorithm (SPA), an Algorithm with a Spatial Constraint for the Automatic Search of Endmembers in Hyperspectral Data , 2008, Sensors.

[64]  Chein-I Chang,et al.  Hyperspectral image classification and dimensionality reduction: an orthogonal subspace projection approach , 1994, IEEE Trans. Geosci. Remote. Sens..

[65]  D. Roberts,et al.  Spectral and Structural Measures of Northwest Forest Vegetation at Leaf to Landscape Scales , 2004, Ecosystems.

[66]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[67]  Antonio J. Plaza,et al.  Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[68]  Lucas J. van Vliet,et al.  Recursive implementation of the Gaussian filter , 1995, Signal Process..

[69]  Antonio J. Plaza,et al.  Spatial Preprocessing for Endmember Extraction , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[70]  Margaret E. Gardner,et al.  Mapping Chaparral in the Santa Monica Mountains Using Multiple Endmember Spectral Mixture Models , 1998 .

[71]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[72]  Derek Anderson,et al.  Earth Movers Distance-Based Simultaneous Comparison of Hyperspectral Endmembers and Proportions , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[73]  Margaret E. Gardner,et al.  Spectrometry for urban area remote sensing—Development and analysis of a spectral library from 350 to 2400 nm , 2004 .