Active Learning via Multi-View and Local Proximity Co-Regularization for Hyperspectral Image Classification

A novel co-regularization framework for active learning is proposed for hyperspectral image classification. The first regularizer explores the intrinsic multi-view information embedded in the hyperspectral data. By adaptively and quantitatively measuring the disagreement level, it focuses only on samples with high uncertainty and builds a contention pool which is a small subset of the overall unlabeled data pool, thereby mitigating the computational cost. The second regularizer is based on the “consistency assumption” and designed on a spatial or the spectral based manifold space. It serves to further focus on the most informative samples within the contention pool by penalizing rapid changes in the classification function evaluated on proximally close samples in a local region. Such changes may be due to the lack of capability of the current learner to describe the unlabeled data. Incorporating manifold learning into the active learning process enforces the clustering assumption and avoids the degradation of the distance measure associated with the original high-dimensional spectral features. One spatial and two local spectral embedding methods are considered in this study, in conjunction with the support vector machine (SVM) classifier implemented with a radial basis function (RBF) kernel. Experiments show excellent performance on AVIRIS and Hyperion hyperspectral data as compared to random sampling and the state-of-the-art SVMSIMPLE.

[1]  Virginia R. de Sa,et al.  Learning Classification with Unlabeled Data , 1993, NIPS.

[2]  John A. Richards,et al.  Segmented principal components transformation for efficient hyperspectral remote-sensing image display and classification , 1999, IEEE Trans. Geosci. Remote. Sens..

[3]  Jonathan Goldstein,et al.  When Is ''Nearest Neighbor'' Meaningful? , 1999, ICDT.

[4]  D. Keim,et al.  What Is the Nearest Neighbor in High Dimensional Spaces? , 2000, VLDB.

[5]  Greg Schohn,et al.  Less is More: Active Learning with Support Vector Machines , 2000, ICML.

[6]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[7]  Joydeep Ghosh,et al.  Best-bases feature extraction algorithms for classification of hyperspectral data , 2001, IEEE Trans. Geosci. Remote. Sens..

[8]  Daphne Koller,et al.  Support Vector Machine Active Learning with Applications to Text Classification , 2000, J. Mach. Learn. Res..

[9]  Craig A. Knoblock,et al.  Active + Semi-supervised Learning = Robust Multi-View Learning , 2002, ICML.

[10]  Steven P. Abney,et al.  Bootstrapping , 2002, ACL.

[11]  Matthias Hein,et al.  Measure Based Regularization , 2003, NIPS.

[12]  张振跃,et al.  Principal Manifolds and Nonlinear Dimensionality Reduction via Tangent Space Alignment , 2004 .

[13]  Luis Alonso,et al.  Robust support vector method for hyperspectral data classification and knowledge discovery , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Sankar K. Pal,et al.  Segmentation of multispectral remote sensing images using active support vector machines , 2004, Pattern Recognit. Lett..

[15]  Joydeep Ghosh,et al.  Investigation of the random forest framework for classification of hyperspectral data , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Xiaojin Zhu,et al.  --1 CONTENTS , 2006 .

[17]  Boaz Leskes,et al.  The Value of Agreement, a New Boosting Algorithm , 2005, COLT.

[18]  Tian Han,et al.  Nonlinear feature extraction of hyperspectral data based on locally linear embedding (LLE) , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[19]  Thomas L. Ainsworth,et al.  Exploiting manifold geometry in hyperspectral imagery , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Marin Ferecatu,et al.  Interactive Remote-Sensing Image Retrieval Using Active Relevance Feedback , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Michel Verleysen,et al.  Nonlinear Dimensionality Reduction , 2021, Computer Vision.

[22]  A. Neuenschwander Remote sensing of vegetation dynamics in response to flooding and fire in the Okavango Delta, Botswana , 2007 .

[23]  Joydeep Ghosh,et al.  An Active Learning Approach to Hyperspectral Data Classification , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Ion Muslea,et al.  Active Learning with Multiple Views , 2009, Encyclopedia of Data Warehousing and Mining.

[25]  William J. Emery,et al.  Active Learning Methods for Remote Sensing Image Classification , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Burr Settles,et al.  Active Learning Literature Survey , 2009 .

[27]  Fredrik Olsson,et al.  A literature survey of active machine learning in the context of natural language processing , 2009 .

[28]  Goo Jun,et al.  A self-training approach to cost sensitive uncertainty sampling , 2009, Machine Learning.

[29]  Songcan Chen,et al.  Multi-view kernel machine on single-view data , 2009, Neurocomputing.

[30]  Melba M. Crawford,et al.  Adaptive Classification for Hyperspectral Image Data Using Manifold Regularization Kernel Machines , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Melba M. Crawford,et al.  Multi-view adaptive disagreement based active learning for hyperspectral image classification , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.

[32]  Lorenzo Bruzzone,et al.  Mean Map Kernel Methods for Semisupervised Cloud Classification , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Melba M. Crawford,et al.  Locally consistent graph regularization based active learning for hyperspectral image classification , 2010, 2010 2nd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[34]  Li Ma,et al.  Local Manifold Learning-Based $k$ -Nearest-Neighbor for Hyperspectral Image Classification , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.