An active learning heuristic using spectral and spatial information for MRF-based classification

A heuristic utilizing both spectral and spatial information is proposed for active learning. It addresses the issue of iteratively querying most informative training samples with a special focus on spatial-contextual image classification. With the aim to utilize all information during the learning process, the proposed heuristic queries unlabeled pixels considering spectral-spatial inconsistency (SSI), i.e., the unlabeled pixels whose spectral and spatial information indicate different class labels are favored in the active selection. To model spectral-spatial information, a Markov random field (MRF), in which the unary term is defined using the output of a support vector machine and the pairwise term is defined by a multilevel logistic model, is adopted. A new approach to the estimation of the parameters of this MRF model is also incorporated in the proposed method. It aims at taking benefit of spatial information by using the pixels which are representative of the inter-class spatial transitions. A high resolution remotely sensed image is used in the experiments, and the proposed method is proved to be feasible and accurate.

[1]  Marin Ferecatu,et al.  Interactive Remote-Sensing Image Retrieval Using Active Relevance Feedback , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[3]  Chih-Jen Lin,et al.  Probability Estimates for Multi-class Classification by Pairwise Coupling , 2003, J. Mach. Learn. Res..

[4]  Haluk Derin,et al.  Modeling and Segmentation of Noisy and Textured Images Using Gibbs Random Fields , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Antonio J. Plaza,et al.  Hyperspectral Image Segmentation Using a New Bayesian Approach With Active Learning , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[6]  J. Besag On the Statistical Analysis of Dirty Pictures , 1986 .

[7]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[8]  Stan Z. Li Markov Random Field Modeling in Image Analysis , 2009, Advances in Pattern Recognition.

[9]  Gabriele Moser,et al.  Weight Parameter Optimization by the Ho–Kashyap Algorithm in MRF Models for Supervised Image Classification , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Mikhail F. Kanevski,et al.  A Survey of Active Learning Algorithms for Supervised Remote Sensing Image Classification , 2011, IEEE Journal of Selected Topics in Signal Processing.

[11]  J. Besag Statistical Analysis of Non-Lattice Data , 1975 .

[12]  André Stumpf,et al.  Active Learning in the Spatial Domain for Remote Sensing Image Classification , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[13]  John Platt,et al.  Probabilistic Outputs for Support vector Machines and Comparisons to Regularized Likelihood Methods , 1999 .

[14]  William J. Emery,et al.  SVM Active Learning Approach for Image Classification Using Spatial Information , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Antonio J. Plaza,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING 1 Spectral–Spatial Classification of Hyperspectral Data Usi , 2022 .

[16]  Antonio J. Plaza,et al.  Semisupervised Hyperspectral Image Segmentation Using Multinomial Logistic Regression With Active Learning , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[17]  William J. Emery,et al.  Active Learning Methods for Remote Sensing Image Classification , 2009, IEEE Transactions on Geoscience and Remote Sensing.