Parameter Selection of Support Vector Regression Based on Particle Swarm Optimization

Parameters selection of support vector machine is the key issue that impacts its accurate performance. A method for support vector regression machine with basic particle swarm optimization (BPSO) algorithm is proposed in this paper. Furthermore, in order to improve the efficiency of the PSO algorithm, a linear decreasing strategy is used to dynamically change the weight. So, an improve PSO (IPSO) algorithm was also proposed in this paper. Then, two different models using BPSO and IPSO respectively were used to forecast the density of the acid-lead battery electrolyte. The experimental results indicate that both BPSO and IPSO have high prediction accuracy and efficiency. the time of the parametric searching by IPSO is obviously decreased to that of BPSO. The mean squared error (MSE) of the prediction model using BPSO is about 2.46684*10^(-4), Meanwhile, the MSE of the model using IPSO is only about 2.01948*10^(-4). So, the IPSO algorithm has more superior performance on convergence speed and global optimization.

[1]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[2]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[3]  R. Eberhart,et al.  Empirical study of particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[4]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[5]  Andries Petrus Engelbrecht,et al.  A study of particle swarm optimization particle trajectories , 2006, Inf. Sci..

[6]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[7]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[8]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[9]  Vladimir Vapnik,et al.  The Nature of Statistical Learning , 1995 .

[10]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.