Active Learning: Any Value for Classification of Remotely Sensed Data?

Active learning, which has a strong impact on processing data prior to the classification phase, is an active research area within the machine learning community, and is now being extended for remote sensing applications. To be effective, classification must rely on the most informative pixels, while the training set should be as compact as possible. Active learning heuristics provide capability to select unlabeled data that are the “most informative” and to obtain the respective labels, contributing to both goals. Characteristics of remotely sensed image data provide both challenges and opportunities to exploit the potential advantages of active learning. We present an overview of active learning methods, then review the latest techniques proposed to cope with the problem of interactive sampling of training pixels for classification of remotely sensed data with support vector machines (SVMs). We discuss remote sensing specific approaches dealing with multisource and spatially and time-varying data, and provide examples for high-dimensional hyperspectral imagery.

[1]  F. J. Gallego,et al.  Stratified sampling of satellite images with a systematic grid of points , 2005 .

[2]  Virginia R. de Sa,et al.  Learning Classification with Unlabeled Data , 1993, NIPS.

[3]  Luísa Castro,et al.  Hierarchical clustering of multispectral images using combined spectral and spatial criteria , 2005, IEEE Geoscience and Remote Sensing Letters.

[4]  William J. Emery,et al.  Improving active learning methods using spatial information , 2011, 2011 IEEE International Geoscience and Remote Sensing Symposium.

[5]  F. Achard,et al.  Determination of Deforestation Rates of the World's Humid Tropical Forests , 2002, Science.

[6]  Luis Alonso,et al.  Robust support vector method for hyperspectral data classification and knowledge discovery , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Devis Tuia,et al.  Active learning for monitoring network optimization , 2012 .

[8]  Fredrik Olsson,et al.  A literature survey of active machine learning in the context of natural language processing , 2009 .

[9]  Mikhail F. Kanevski,et al.  A Survey of Active Learning Algorithms for Supervised Remote Sensing Image Classification , 2011, IEEE Journal of Selected Topics in Signal Processing.

[10]  Brian W. Kernighan,et al.  An Effective Heuristic Algorithm for the Traveling-Salesman Problem , 1973, Oper. Res..

[11]  Gustavo Camps-Valls,et al.  Semisupervised Classification of Remote Sensing Images With Active Queries , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Farid Melgani,et al.  Support Vector Machine Active Learning Through Significance Space Construction , 2011, IEEE Geoscience and Remote Sensing Letters.

[13]  Gregory Piatetsky-Shapiro,et al.  High-Dimensional Data Analysis: The Curses and Blessings of Dimensionality , 2000 .

[14]  Devis Tuia,et al.  Learning User's Confidence for Active Learning , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[15]  David A. Landgrebe,et al.  Hyperspectral Image Data Analysis as a High Dimensional Signal Processing Problem , 2002 .

[16]  Luc Pronzato,et al.  Beyond space-filling: An illustrative case , 2011 .

[17]  Ali M. Mosammam Spatio-temporal design: advances in efficient data acquisition , 2014 .

[18]  G. Fitzgerald,et al.  Directed sampling using remote sensing with a response surface sampling design for site-specific agriculture , 2006 .

[19]  Melba M. Crawford,et al.  Active Learning via Multi-View and Local Proximity Co-Regularization for Hyperspectral Image Classification , 2011, IEEE Journal of Selected Topics in Signal Processing.

[20]  Tin Kam Ho,et al.  The Random Subspace Method for Constructing Decision Forests , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  D. J. Brus,et al.  Sampling for Natural Resource Monitoring , 2006 .

[22]  Lorenzo Bruzzone,et al.  Toward the Automatic Updating of Land-Cover Maps by a Domain-Adaptation SVM Classifier and a Circular Validation Strategy , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Joydeep Ghosh,et al.  An Active Learning Approach to Hyperspectral Data Classification , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[24]  G. F. Hughes,et al.  On the mean accuracy of statistical pattern recognizers , 1968, IEEE Trans. Inf. Theory.

[25]  Lorenzo Bruzzone,et al.  Unsupervised retraining of a maximum-likelihood classifier for the analysis of multitemporal remote sensing images , 1999, Remote Sensing.

[26]  Burr Settles,et al.  Active Learning Literature Survey , 2009 .

[27]  Francesca Bovolo,et al.  Discovering single classes in remote sensing images with active learning , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[28]  Daphne Koller,et al.  Support Vector Machine Active Learning with Applications to Text Classification , 2000, J. Mach. Learn. Res..

[29]  Lorenzo Bruzzone,et al.  A Fast Cluster-Assumption Based Active-Learning Technique for Classification of Remote Sensing Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Melba M. Crawford,et al.  View Generation for Multiview Maximum Disagreement Based Active Learning for Hyperspectral Image Classification , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Naif Alajlan,et al.  Active Learning Methods for Biophysical Parameter Estimation , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Goo Jun,et al.  Spatially Adaptive Classification of Land Cover With Remote Sensing Data , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[33]  A.J. Plaza,et al.  Automated selection of results in hierarchical segmentations of remotely sensed hyperspectral images , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[34]  William J. Emery,et al.  Using active learning to adapt remote sensing image classifiers , 2011 .

[35]  Melba M. Crawford,et al.  Unsupervised multistage image classification using hierarchical clustering with a bayesian similarity measure , 2005, IEEE Transactions on Image Processing.

[36]  Luis Gómez-Chova,et al.  Graph Matching for Adaptation in Remote Sensing , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[37]  William J. Emery,et al.  Active Learning Methods for Remote Sensing Image Classification , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[38]  G.J. Dobeck,et al.  Active learning for detection of mine-like objects in side-scan sonar imagery , 2005, IEEE Journal of Oceanic Engineering.

[39]  Johannes R. Sveinsson,et al.  Classification of hyperspectral data from urban areas based on extended morphological profiles , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Mikhail F. Kanevski,et al.  SVM-Based Boosting of Active Learning Strategies for Efficient Domain Adaptation , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[41]  Werner G. Müller,et al.  Collecting Spatial Data: Optimum Design of Experiments for Random Fields , 1998 .

[42]  David A. Landgrebe,et al.  Hyperspectral image data analysis , 2002, IEEE Signal Process. Mag..

[43]  Timothy C. Coburn J. de Gruijter, D. Brus, M. Bierkens, and M. Knotters: Sampling for Natural Resource Monitoring , 2008 .

[44]  Jungho Im,et al.  ISPRS Journal of Photogrammetry and Remote Sensing , 2022 .

[45]  Marin Ferecatu,et al.  Interactive Remote-Sensing Image Retrieval Using Active Relevance Feedback , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[46]  Ishwar K. Sethi,et al.  Confidence-based active learning , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[47]  Leen Torenvliet,et al.  The value of agreement a new boosting algorithm , 2008, J. Comput. Syst. Sci..

[48]  Lorenzo Bruzzone,et al.  A cost-sensitive active learning technique for the definition of effective training sets for supervised classifiers , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[49]  Alexander Y. Liu,et al.  Active Learning with Spatially Sensitive Labeling Costs , 2008 .

[50]  Julien Michel,et al.  Object based and geospatial image analysis: a semi-automatic pre-operational system , 2010, Remote Sensing.

[51]  Goo Jun,et al.  An Efficient Active Learning Algorithm with Knowledge Transfer for Hyperspectral Data Analysis , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[52]  Giles M. Foody,et al.  Training set size requirements for the classification of a specific class , 2006 .

[53]  Johannes R. Sveinsson,et al.  Spectral and spatial classification of hyperspectral data using SVMs and morphological profiles , 2008, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[54]  Lorenzo Bruzzone,et al.  Active Learning for Domain Adaptation in the Supervised Classification of Remote Sensing Images , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[55]  James C. Tilton,et al.  Image segmentation by region growing and spectral clustering with a natural convergence criterion , 1998, IGARSS '98. Sensing and Managing the Environment. 1998 IEEE International Geoscience and Remote Sensing. Symposium Proceedings. (Cat. No.98CH36174).

[56]  Zhi-Hua Zhou,et al.  Semi-supervised learning by disagreement , 2010, Knowledge and Information Systems.

[57]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[58]  Melba M. Crawford,et al.  Critical class oriented active learning for hyperspectral image classification , 2011, 2011 IEEE International Geoscience and Remote Sensing Symposium.

[59]  Lorenzo Bruzzone,et al.  A Multilevel Context-Based System for Classification of Very High Spatial Resolution Images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[60]  William J. Emery,et al.  A neural network approach using multi-scale textural metrics from very high-resolution panchromatic imagery for urban land-use classification , 2009 .

[61]  Klaus Brinker,et al.  Incorporating Diversity in Active Learning with Support Vector Machines , 2003, ICML.

[62]  Francesca Bovolo,et al.  Updating Land-Cover Maps by Classification of Image Time Series: A Novel Change-Detection-Driven Transfer Learning Approach , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[63]  André Stumpf,et al.  Active learning in the spatial-domain for landslide mapping in remote sensing images , 2012 .

[64]  Melba M. Crawford,et al.  Adaptive Classification for Hyperspectral Image Data Using Manifold Regularization Kernel Machines , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[65]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[66]  Francesca Bovolo,et al.  Detection of Land-Cover Transitions in Multitemporal Remote Sensing Images With Active-Learning-Based Compound Classification , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[67]  Greg Schohn,et al.  Less is More: Active Learning with Support Vector Machines , 2000, ICML.

[68]  Mikhail F. Kanevski,et al.  Memory-Based Cluster Sampling for Remote Sensing Image Classification , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[69]  R. M. Hoffer,et al.  Computer-Aided Analysis of Landsat-1 MSS Data: A Comparison of Three Approaches, Including a "Modified Clustering" Approach-1 MSS Data: A Comparison of Three Approaches, Including a "Modified Clustering" Approach , 1975 .

[70]  Sankar K. Pal,et al.  Segmentation of multispectral remote sensing images using active support vector machines , 2004, Pattern Recognit. Lett..

[71]  Eugene L. Lawler,et al.  The Traveling Salesman Problem: A Guided Tour of Combinatorial Optimization , 1985 .

[72]  H. Sebastian Seung,et al.  Query by committee , 1992, COLT '92.

[73]  Lorenzo Bruzzone,et al.  A Novel Approach to the Selection of Spatially Invariant Features for the Classification of Hyperspectral Images With Improved Generalization Capability , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[74]  Lorenzo Bruzzone,et al.  Batch-Mode Active-Learning Methods for the Interactive Classification of Remote Sensing Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[75]  Antonio J. Plaza,et al.  Hyperspectral Image Segmentation Using a New Bayesian Approach With Active Learning , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[76]  F. Achard,et al.  Monitoring Forest Areas from Continental to Territorial Levels Using a Sample of Medium Spatial Resolution Satellite Imagery , 2010 .

[77]  Mohamed S. Kamel,et al.  Enhanced bisecting k-means clustering using intermediate cooperation , 2009, Pattern Recognit..