New methods of H-SVMs for the classification of multi-spectral remote sensing imagery

Through systematically analysises of existing multi-class SVMs (M-SVMs) methods, it is shown that hierarchy multi-class SVMs (H-SVMs) can be relatively effective. Further analysis shown that existing methods that measure separability between different classes are not suitable for kernel feature space. A new method is presented for separability measure in feature space based on the characters of RBF kernel function and SVMs. Based on the new separability measure, two kinds of H-SVMs, Binary Tree SVMs (BT SVMs) and Single Layer Clustering SVMs (SLC SVMs) are presented. They are both implements of following ideal: the higher a pair of two sub-classes is in the hierarchy, the easier to separate them. In this way, we can not only achieve classification accuracy by alleviate error accumulation from top to bottom, but also rise classification speed by reduce support vectors in classifier. Experimental results justify the rationality of the new separability measure and effectiveness of BT SVMs and SLC SVMs.

[1]  Shang-Liang Chen,et al.  Orthogonal least squares learning algorithm for radial basis function networks , 1991, IEEE Trans. Neural Networks.

[2]  Edoardo Amaldi,et al.  On the Approximability of Minimizing Nonzero Variables or Unsatisfied Relations in Linear Systems , 1998, Theor. Comput. Sci..

[3]  Li Ping-xiang,et al.  Classification of High Spatial Resolution Remotely Sensed Imagery Based on the Fusion of Spectral and Shape Features , 2007, National Remote Sensing Bulletin.

[4]  Ye Zhang,et al.  A kernel based nonlinear subspace projection method for reduction of hyperspectral image dimensionality , 2002, Proceedings. International Conference on Image Processing.

[5]  Li Ping-xiang Classification of High Spatial Resolution Remotely Sensed Imagery Based Upon Fusion of Multiscale Features and SVM , 2007 .

[6]  M.R. Azimi-Sadjadi,et al.  Cloud classification using support vector machines , 2000, IGARSS 2000. IEEE 2000 International Geoscience and Remote Sensing Symposium. Taking the Pulse of the Planet: The Role of Remote Sensing in Managing the Environment. Proceedings (Cat. No.00CH37120).

[7]  Li Jing The High Spatial Resolution RS Image Classification Based on SVM Method with the Multi-Source Data , 2006 .

[8]  David A. Landgrebe,et al.  Covariance Matrix Estimation and Classification With Limited Training Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Davide Anguita,et al.  Automatic Hyperparameter Tuning for Support Vector Machines , 2002, ICANN.

[10]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[11]  Sergios Theodoridis,et al.  Pattern Recognition , 1998, IEEE Trans. Neural Networks.