Active extreme learning machines for quad-polarimetric SAR imagery classification

Abstract Supervised classification of quad-polarimetric SAR images is often constrained by the availability of reliable training samples. Active learning (AL) provides a unique capability at selecting samples with high representation quality and low redundancy. The most important part of AL is the criterion for selecting the most informative candidates (pixels) by ranking. In this paper, class supports based on the posterior probability function are approximated by ensemble learning and majority voting. This approximation is statistically meaningful when a large enough classifier ensemble is exploited. In this work, we propose to use extreme learning machines and apply AL to quad-polarimetric SAR image classification. Extreme learning machines are ideal because of their fast operation, straightforward solution and strong generalization. As inputs to the so-called active extreme learning machines, both polarimetric and spatial features (morphological profiles) are considered. In order to validate the proposed method, results and performance are compared with random sampling and state-of-the-art AL methods, such as margin sampling, normalized entropy query-by-bagging and multiclass level uncertainty. Experimental results for four quad-polarimetric SAR images collected by RADARSAT-2, AirSAR and EMISAR indicate that the proposed method achieves promising results in different scenarios. Moreover, the proposed method is faster than existing techniques in both the learning and the classification phases.

[1]  Boaz Leskes,et al.  The Value of Agreement, a New Boosting Algorithm , 2005, COLT.

[2]  Jong-Sen Lee,et al.  Classification comparisons between dual-pol, compact polarimetric and quad-pol SAR imagery , 2009 .

[3]  J. Kong,et al.  Identification of Terrain Cover Using the Optimum Polarimetric Classifier , 2012 .

[4]  Yasser Maghsoudi,et al.  Nonparametric feature selection and support vector machine for polarimetric SAR data classification , 2011, 2011 IEEE International Geoscience and Remote Sensing Symposium.

[5]  Peijun Du,et al.  Ensemble Learning with Multiple Classifiers and Polarimetric Features for Polarized SAR Image Classification , 2014 .

[6]  Björn Waske,et al.  Classifier ensembles for land cover mapping using multitemporal SAR imagery , 2009 .

[7]  Antonio J. Serrano,et al.  BELM: Bayesian Extreme Learning Machine , 2011, IEEE Transactions on Neural Networks.

[8]  Marco Martorella,et al.  Point Target Classification via Fast Lossless and Sufficient $\Omega$–$\Psi$ –$\Phi$ Invariant Decomposition of High-Resolution and Fully Polarimetric SAR/ISAR Data , 2013, Proceedings of the IEEE.

[9]  Ron Kwok,et al.  Classification of multi-look polarimetric SAR imagery based on complex Wishart distribution , 1994 .

[10]  Chee Kheong Siew,et al.  Universal Approximation using Incremental Constructive Feedforward Networks with Random Hidden Nodes , 2006, IEEE Transactions on Neural Networks.

[11]  Heather McNairn,et al.  The Contribution of ALOS PALSAR Multipolarization and Polarimetric Data to Crop Classification , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Mingsheng Liao,et al.  Texture Classification of PolSAR Data Based on Sparse Coding of Wavelet Polarization Textons , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[13]  H. Sebastian Seung,et al.  Query by committee , 1992, COLT '92.

[14]  Lorenzo Bruzzone,et al.  Batch-Mode Active-Learning Methods for the Interactive Classification of Remote Sensing Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Pierre Soille,et al.  Advances in mathematical morphology applied to geoscience and remote sensing , 2002, IEEE Trans. Geosci. Remote. Sens..

[16]  R. Venkatesh Babu,et al.  No-reference image quality assessment using modified extreme learning machine classifier , 2009, Appl. Soft Comput..

[17]  Mahesh Pal Extreme‐learning‐machine‐based land cover classification , 2008, ArXiv.

[18]  Mikhail F. Kanevski,et al.  A Survey of Active Learning Algorithms for Supervised Remote Sensing Image Classification , 2011, IEEE Journal of Selected Topics in Signal Processing.

[19]  Jon Atli Benediktsson,et al.  A new approach for the morphological segmentation of high-resolution satellite imagery , 2001, IEEE Trans. Geosci. Remote. Sens..

[20]  Ching Y. Suen,et al.  Application of majority voting to pattern recognition: an analysis of its behavior and performance , 1997, IEEE Trans. Syst. Man Cybern. Part A.

[21]  Robert K. L. Gay,et al.  Error Minimized Extreme Learning Machine With Growth of Hidden Nodes and Incremental Learning , 2009, IEEE Transactions on Neural Networks.

[22]  H. Sebastian Seung,et al.  Selective Sampling Using the Query by Committee Algorithm , 1997, Machine Learning.

[23]  Michele Volpi,et al.  Unbiased query-by-bagging active learning for VHR image classification , 2010, Remote Sensing.

[24]  Jean-Claude Souyris,et al.  Support Vector Machine for Multifrequency SAR Polarimetric Data Classification , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Matthieu Molinier,et al.  Polarimetric SAR Data in Land Cover Mapping in Boreal Zone , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Hiroyoshi Yamada,et al.  Four-component scattering model for polarimetric SAR image decomposition , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[28]  Q. M. Jonathan Wu,et al.  Human action recognition using extreme learning machine based on visual vocabularies , 2010, Neurocomputing.

[29]  Farid Melgani,et al.  Support Vector Machine Active Learning Through Significance Space Construction , 2011, IEEE Geoscience and Remote Sensing Letters.

[30]  Zhi-Hua Zhou,et al.  Ensemble Methods: Foundations and Algorithms , 2012 .

[31]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[32]  Yoav Freund,et al.  Boosting the margin: A new explanation for the effectiveness of voting methods , 1997, ICML.

[33]  Jun Li,et al.  ${{\rm E}^{2}}{\rm LMs}$ : Ensemble Extreme Learning Machines for Hyperspectral Image Classification , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[34]  Rama Chellappa,et al.  Unsupervised segmentation of polarimetric SAR data using the covariance matrix , 1992, IEEE Trans. Geosci. Remote. Sens..

[35]  William J. Emery,et al.  Active Learning Methods for Remote Sensing Image Classification , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Xia Li,et al.  A novel algorithm for land use and land cover classification using RADARSAT-2 polarimetric SAR data , 2012 .

[37]  Joydeep Ghosh,et al.  An Active Learning Approach to Hyperspectral Data Classification , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[39]  Lawrence O. Hall,et al.  Active learning to recognize multiple types of plankton , 2004, ICPR 2004.

[40]  Johannes R. Sveinsson,et al.  Classification of hyperspectral data from urban areas based on extended morphological profiles , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Laurent Ferro-Famil,et al.  Unsupervised classification of multifrequency and fully polarimetric SAR images based on the H/A/Alpha-Wishart classifier , 2001, IEEE Trans. Geosci. Remote. Sens..

[42]  Knut Conradsen,et al.  A test statistic in the complex Wishart distribution and its application to change detection in polarimetric SAR data , 2003, IEEE Trans. Geosci. Remote. Sens..

[43]  Daphne Koller,et al.  Support Vector Machine Active Learning with Applications to Text Classification , 2000, J. Mach. Learn. Res..

[44]  Subhash C. Bagui,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2005, Technometrics.

[45]  Timothy A. Warner,et al.  Kernel-based extreme learning machine for remote-sensing image classification , 2013 .

[46]  William J. Emery,et al.  Using active learning to adapt remote sensing image classifiers , 2011 .

[47]  Jon Atli Benediktsson,et al.  Morphological Attribute Profiles for the Analysis of Very High Resolution Images , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[48]  C. A. Murthy,et al.  A probabilistic active support vector learning algorithm , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  Torbjørn Eltoft,et al.  Classification With a Non-Gaussian Model for PolSAR Data , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[50]  Eric Pottier,et al.  A review of target decomposition theorems in radar polarimetry , 1996, IEEE Trans. Geosci. Remote. Sens..

[51]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[52]  Jakob J. van Zyl,et al.  Model-Based Decomposition of Polarimetric SAR Covariance Matrices Constrained for Nonnegative Eigenvalues , 2011, IEEE Transactions on Geoscience and Remote Sensing.