Jointly Informative and Manifold Structure Representative Sampling Based Active Learning for Remote Sensing Image Classification

Active learning (AL) methods that select unlabeled samples only querying by informative measures (i.e., uncertainty and/or diversity criteria) have been extensively investigated. However, these methods usually do not exploit the manifold structure of the unlabeled data from the geometrical point of view, a choice that might lead to a sample bias and consequently undesirable performances. To control and possibly overcome such drawbacks, this paper explores AL methods based on joint informative and manifold structure representative sampling (JI-MSRS). In JI-MSRS, a portion of the unlabeled samples that are added at each iteration is selected according to the informative measures, whereas another portion is selected according to their capability to represent the data cluster structure. Four popular manifold learning methods, namely, principle component analysis (PCA), linear discriminant analysis, kernel PCA, and neighborhood preserving embedding, are used to model the data structure. Then, Delaunay triangulation nets are used to build a discrete approximation of the geometrical structure of the unlabeled data cloud in a low-dimensional space. To show the effectiveness of this novel sampling strategy, results on three real multi-/hyperspectral data sets are presented, adding a thorough comparison with other state-of-the-art AL techniques. In comparison to conventional AL heuristics, the proposed techniques are able to obtain competitive or even better classification accuracy values.

[1]  Tong Zhang,et al.  A Framework for Learning Predictive Structures from Multiple Tasks and Unlabeled Data , 2005, J. Mach. Learn. Res..

[2]  Li Ma,et al.  Exploring Nonlinear Manifold Learning for Classification of Hyperspectral Data , 2011 .

[3]  Shuicheng Yan,et al.  Learning With $\ell ^{1}$-Graph for Image Analysis , 2010, IEEE Transactions on Image Processing.

[4]  Thomas L. Ainsworth,et al.  Exploiting manifold geometry in hyperspectral imagery , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Jieping Ye,et al.  Querying discriminative and representative samples for batch mode active learning , 2013, KDD.

[6]  Burr Settles,et al.  Active Learning Literature Survey , 2009 .

[7]  Marin Ferecatu,et al.  Interactive Remote-Sensing Image Retrieval Using Active Relevance Feedback , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Maarten Löffler,et al.  Generating Realistic Terrains with Higher-Order Delaunay Triangulations , 2005, ESA.

[9]  Shuicheng Yan,et al.  Neighborhood preserving embedding , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[10]  Michael J. Holst,et al.  Feature-preserving surface mesh smoothing via suboptimal Delaunay triangulation , 2013, Graph. Model..

[11]  Naoki Abe,et al.  Query Learning Strategies Using Boosting and Bagging , 1998, ICML.

[12]  Hans-Peter Kriegel,et al.  Integrating structured biological data by Kernel Maximum Mean Discrepancy , 2006, ISMB.

[13]  Greg Schohn,et al.  Less is More: Active Learning with Support Vector Machines , 2000, ICML.

[14]  Mikhail F. Kanevski,et al.  A Survey of Active Learning Algorithms for Supervised Remote Sensing Image Classification , 2011, IEEE Journal of Selected Topics in Signal Processing.

[15]  Steve Oudot,et al.  Provably good sampling and meshing of surfaces , 2005, Graph. Model..

[16]  James F. O'Brien,et al.  Spectral surface reconstruction from noisy point clouds , 2004, SGP '04.

[17]  Zhi-Hua Zhou,et al.  On multi-view active learning and the combination with semi-supervised learning , 2008, ICML '08.

[18]  Jon Atli Benediktsson,et al.  Advances in Hyperspectral Image Classification: Earth Monitoring with Statistical Learning Methods , 2013, IEEE Signal Processing Magazine.

[19]  Melba M. Crawford,et al.  View Generation for Multiview Maximum Disagreement Based Active Learning for Hyperspectral Image Classification , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Lawrence O. Hall,et al.  Active learning to recognize multiple types of plankton , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[21]  Jun Li,et al.  ${{\rm E}^{2}}{\rm LMs}$ : Ensemble Extreme Learning Machines for Hyperspectral Image Classification , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[22]  Yong Jae Lee,et al.  Object-Graphs for Context-Aware Visual Category Discovery , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Alexander F. H. Goetz,et al.  Three decades of hyperspectral remote sensing of the Earth: a personal view. , 2009 .

[24]  Melba M. Crawford,et al.  Manifold-Learning-Based Feature Extraction for Classification of Hyperspectral Data: A Review of Advances in Manifold Learning , 2014, IEEE Signal Processing Magazine.

[25]  William J. Emery,et al.  A neural network approach using multi-scale textural metrics from very high-resolution panchromatic imagery for urban land-use classification , 2009 .

[26]  Antonio J. Plaza,et al.  Semisupervised Hyperspectral Image Segmentation Using Multinomial Logistic Regression With Active Learning , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Stephen Lin,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  William J. Emery,et al.  Active Learning Methods for Remote Sensing Image Classification , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Edwin R. Hancock,et al.  Structural Matching with Active Triangulations , 1998, Comput. Vis. Image Underst..

[30]  Klaus Brinker,et al.  Incorporating Diversity in Active Learning with Support Vector Machines , 2003, ICML.

[31]  J. S. Lee,et al.  Polarimetric SAR characterization of man-made structures in urban areas using normalized circular-pol correlation coefficients , 2008 .

[32]  Vikas Sindhwani,et al.  On Manifold Regularization , 2005, AISTATS.

[33]  W. Schaap DTFE : the Delaunay Tessellation Field Estimator , 2007 .

[34]  Steven Fortune,et al.  Voronoi Diagrams and Delaunay Triangulations , 2004, Handbook of Discrete and Computational Geometry, 2nd Ed..

[35]  Peijun Du,et al.  Random Forest and Rotation Forest for fully polarized SAR image classification using polarimetric and spatial features , 2015 .

[36]  Victor J. D. Tsai,et al.  Delaunay Triangulations in TIN Creation: An Overview and a Linear-Time Algorithm , 1993, Int. J. Geogr. Inf. Sci..

[37]  Jon Atli Benediktsson,et al.  Advances in Very-High-Resolution Remote Sensing [Scanning the Issue] , 2013, Proc. IEEE.

[38]  Cheng Li,et al.  Active learning on manifolds , 2014, Neurocomputing.

[39]  Lorenzo Bruzzone,et al.  Batch-Mode Active-Learning Methods for the Interactive Classification of Remote Sensing Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[40]  S. Sloan A fast algorithm for constructing Delaunay triangulations in the plane , 1987 .

[41]  Mikhail Belkin,et al.  Manifold Regularization: A Geometric Framework for Learning from Labeled and Unlabeled Examples , 2006, J. Mach. Learn. Res..

[42]  Richard G. Baraniuk,et al.  Multiscale image processing using normal triangulated meshes , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[43]  Advances in Very-High-Resolution Remote Sensing , .

[44]  Liangpei Zhang,et al.  An SVM Ensemble Approach Combining Spectral, Structural, and Semantic Features for the Classification of High-Resolution Remotely Sensed Imagery , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[45]  Peijun Du,et al.  Polarimetric SAR image classification by Boosted Multiple-Kernel Extreme Learning Machines with polarimetric and spatial features , 2014 .

[46]  Jon Atli Benediktsson,et al.  Recent Advances in Techniques for Hyperspectral Image Processing , 2009 .

[47]  Juan José Rodríguez Diez,et al.  Rotation Forest: A New Classifier Ensemble Method , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  Melba M. Crawford,et al.  Active Learning via Multi-View and Local Proximity Co-Regularization for Hyperspectral Image Classification , 2011, IEEE Journal of Selected Topics in Signal Processing.

[49]  Rong Jin,et al.  Active Learning by Querying Informative and Representative Examples , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  Arnold W. M. Smeulders,et al.  Active learning using pre-clustering , 2004, ICML.

[51]  Paul N. Bennett,et al.  Dual Strategy Active Learning , 2007, ECML.

[52]  Giles M. Foody,et al.  Training set size requirements for the classification of a specific class , 2006 .

[53]  Giles M. Foody,et al.  Toward intelligent training of supervised image classifications: directing training data acquisition for SVM classification , 2004 .