Local-Manifold-Learning-Based Graph Construction for Semisupervised Hyperspectral Image Classification

Graph construction, which is at the heart of graph-based semisupervised learning (SSL), is investigated by using manifold learning (ML) approaches. Since each ML method can be demonstrated to correspond to a specific graph, we build the relation between ML and SSL via the graph, where ML methods are employed for graph construction. Moreover, sparsity is important for the efficiency of SSL algorithms, and therefore, local ML (LML)-method-based sparse graphs are utilized. The LML-based graphs are able to capture the local geometric properties of hyperspectral data and, thus, are beneficial for classification of data with complex geometry and multiple submanifolds. In experiments with Hyperion and AVIRIS hyperspectral data, graphs constructed by two LML methods, namely, locally linear embedding and local tangent space alignment (LTSA), performed better than several popular graph construction methods, and the highest accuracies were obtained by using graphs provided by LTSA.

[1]  Fei Wang,et al.  Label Propagation through Linear Neighborhoods , 2008, IEEE Trans. Knowl. Data Eng..

[2]  A. Neuenschwander.  Remote sensing of vegetation dynamics in response to flooding and fire in the Okavango Delta, Botswana , 2007 .

[3]  Thomas L. Ainsworth,et al.  Improved Manifold Coordinate Representations of Large-Scale Hyperspectral Scenes , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Okan K. Ersoy,et al.  Spherical Stochastic Neighbor Embedding of Hyperspectral Data , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Honggang Zhang,et al.  Local Sparse Representation Based Classification , 2010, 2010 20th International Conference on Pattern Recognition.

[6]  Hong Cheng,et al.  Sparsity induced similarity measure for label propagation , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[7]  Luis Gómez-Chova,et al.  Semisupervised Image Classification With Laplacian Support Vector Machines , 2008, IEEE Geoscience and Remote Sensing Letters.

[8]  Hongyuan Zha,et al.  Adaptive Manifold Learning , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Thomas L. Ainsworth,et al.  Exploiting manifold geometry in hyperspectral imagery , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Robert D. Nowak,et al.  Multi-Manifold Semi-Supervised Learning , 2009, AISTATS.

[11]  Nicolas Le Roux,et al.  Efficient Non-Parametric Function Induction in Semi-Supervised Learning , 2004, AISTATS.

[12]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[13]  Shuicheng Yan,et al.  Semi-supervised Learning by Sparse Representation , 2009, SDM.

[14]  Shih-Fu Chang,et al.  Graph construction and b-matching for semi-supervised learning , 2009, ICML '09.

[15]  Xin Yang,et al.  Semi-supervised nonlinear dimensionality reduction , 2006, ICML.

[16]  Tian Han,et al.  Investigation of Nonlinearity in Hyperspectral Imagery Using Surrogate Data Methods , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Mikhail Belkin,et al.  Manifold Regularization: A Geometric Framework for Learning from Labeled and Unlabeled Examples , 2006, J. Mach. Learn. Res..

[18]  Zoubin Ghahramani,et al.  Learning from labeled and unlabeled data with label propagation , 2002 .

[19]  Lawrence K. Saul,et al.  Think Globally, Fit Locally: Unsupervised Learning of Low Dimensional Manifold , 2003, J. Mach. Learn. Res..

[20]  Liangpei Zhang,et al.  On Combining Multiple Features for Hyperspectral Remote Sensing Image Classification , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Daniel D. Lee,et al.  Semisupervised alignment of manifolds , 2005, AISTATS.

[22]  Gustavo Camps-Valls,et al.  Semi-Supervised Graph-Based Hyperspectral Image Classification , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Li Ma,et al.  Local Manifold Learning-Based $k$ -Nearest-Neighbor for Hyperspectral Image Classification , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Stephen Lin,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Melba M. Crawford,et al.  Adaptive Classification for Hyperspectral Image Data Using Manifold Regularization Kernel Machines , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Jun Guo,et al.  An Evaluation on Different Graphs for Semi-supervised Learning , 2011, IScIDE.

[27]  Hongyuan Zha,et al.  Principal Manifolds and Nonlinear Dimension Reduction via Local Tangent Space Alignment , 2002, ArXiv.

[28]  Zoubin Ghahramani,et al.  Combining active learning and semi-supervised learning using Gaussian fields and harmonic functions , 2003, ICML 2003.

[29]  Bernhard Schölkopf,et al.  Transductive Classification via Local Learning Regularization , 2007, AISTATS.

[30]  Li Ma,et al.  Exploring Nonlinear Manifold Learning for Classification of Hyperspectral Data , 2011 .

[31]  Bernhard Schölkopf,et al.  Learning with Local and Global Consistency , 2003, NIPS.

[32]  Hong Huo,et al.  Hierarchical Manifold Learning With Applications to Supervised Classification for High-Resolution Remotely Sensed Images , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[34]  H. Zha,et al.  Principal manifolds and nonlinear dimensionality reduction via tangent space alignment , 2004, SIAM J. Sci. Comput..

[35]  Jinwen Tian,et al.  Generalised supervised local tangent space alignment for hyperspectral image classification , 2010 .

[36]  Li Ma,et al.  Anomaly Detection for Hyperspectral Images Based on Robust Locally Linear Embedding , 2010 .

[37]  Kai Feng,et al.  L1-graph semisupervised learning for hyperspectral image classification , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[38]  Liangpei Zhang,et al.  Sparse Transfer Manifold Embedding for Hyperspectral Target Detection , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Melba M. Crawford,et al.  Manifold-Learning-Based Feature Extraction for Classification of Hyperspectral Data: A Review of Advances in Manifold Learning , 2014, IEEE Signal Processing Magazine.

[40]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[41]  Xiaojin Zhu,et al.  --1 CONTENTS , 2006 .

[42]  Lorenzo Bruzzone,et al.  A Novel Transductive SVM for Semisupervised Classification of Remote-Sensing Images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[43]  Melba M. Crawford,et al.  Manifold learning based feature extraction for classification of hyper-spectral data , 2013 .

[44]  Thomas L. Ainsworth,et al.  Bathymetric Retrieval From Hyperspectral Imagery Using Manifold Coordinate Representations , 2009, IEEE Transactions on Geoscience and Remote Sensing.