论文信息 - Parameter selection of support vector regression based on hybrid optimization algorithm and its application

Parameter selection of support vector regression based on hybrid optimization algorithm and its application

Choosing optimal parameters for support vector regression (SVR) is an important step in SVR design, which strongly affects the performance of SVR. In this paper, based on the analysis of influence of SVR parameters on generalization error, a new approach with two steps is proposed for selecting SVR parameters. First the kernel function and SVM parameters are optimized roughly through genetic algorithm, then the kernel parameter is finely adjusted by local linear search. This approach has been successfully applied to the prediction model of the sulfur content in hot metal. The experiment results show that the proposed approach can yield better generalization performance of SVR than other methods.

[1] Vladimir N. Vapnik,et al. The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[2] K. R. Al-Balushi,et al. Artificial neural networks and support vector machines with genetic algorithm for bearing fault detection , 2003 .

[3] Pavel Laskov,et al. Feasible Direction Decomposition Algorithms for Training Support Vector Machines , 2002, Machine Learning.

[4] Chih-Jen Lin,et al. Decomposition Methods for Linear Support Vector Machines , 2004, Neural Computation.

[5] Zbigniew Michalewicz,et al. Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[6] Abdul Rahman Mohamed,et al. Neural networks for the identification and control of blast furnace hot metal quality , 2000 .

[7] Wenjian Wang,et al. Determination of the spread parameter in the Gaussian kernel for classification and regression , 2003, Neurocomputing.

[8] Gary William Flake,et al. Efficient SVM Regression Training with SMO , 2002, Machine Learning.

[9] Pavel Laskov,et al. An Improved Decomposition Algorithm for Regression Support Vector Machines , 1999, NIPS.

[10] Vladimir Vapnik,et al. An overview of statistical learning theory , 1999, IEEE Trans. Neural Networks.

[11] Yunqian Ma,et al. Practical selection of SVM parameters and noise estimation for SVM regression , 2004, Neural Networks.