论文信息 - Multiple Parameter Selection for LS-SVM Using Smooth Leave-One-Out Error

Multiple Parameter Selection for LS-SVM Using Smooth Leave-One-Out Error

In least squares support vector (LS-SVM), the key challenge lies in the selection of free parameters such as kernel parameters and tradeoff parameter. However, when a large number of free parameters are involved in LS-SVM, the commonly used grid search method for model selection is intractable. In this paper, SLOO-MPS is proposed for tuning multiple parameters for LS-SVM to overcome this problem. This method is based on optimizing the smooth leave- one-out error via a gradient descent algorithm and feasible to compute. Extensive empirical comparisons confirm the feasibility and validation of the SLOO-MPS.

Licheng Jiao | Ling Wang | Liefeng Bo

[1] Chih-Jen Lin,et al. A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[2] Miguel Figueroa,et al. Competitive learning with floating-gate circuits , 2002, IEEE Trans. Neural Networks.

[3] Corinna Cortes,et al. Support-Vector Networks , 1995, Machine Learning.

[4] Ming-Hsuan Yang,et al. Kernel Eigenfaces vs. Kernel Fisherfaces: Face recognition using kernel methods , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[5] Vladimir N. Vapnik,et al. The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[6] Catherine Blake,et al. UCI Repository of machine learning databases , 1998 .

[7] Vladimir Vapnik,et al. Statistical learning theory , 1998 .

[8] S. S. Keerthi,et al. Predictive Approaches for Choosing Hyperparameters in , 2001 .

[9] Johan A. K. Suykens,et al. Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[10] Bernhard E. Boser,et al. A training algorithm for optimal margin classifiers , 1992, COLT '92.

[11] Johan A. K. Suykens,et al. Bayesian Framework for Least-Squares Support Vector Machine Classifiers, Gaussian Processes, and Kernel Fisher Discriminant Analysis , 2002, Neural Computation.