PSO Algorithm for Support Vector Machine

Statistical Learning Theory focuses on the machine learning theory for small samples. Support vector machine (SVM) are new methods based on statistical learning theory. There are many kinds of function can be used for kernel of SVM. Wavelet function is a set of bases that can approximate arbitrary functions in arbitrary precision. So Marr wavelet was used to construct wavelet kernel. On the other hand, the parameter selection should to be done before training WSVM. Modified chaotic particle swarm optimization (CPOS) was adpoted to select parameters of SVM. It is shown by simulation that the CPOS algorithm can derive a set of optimal parameters of WSVM, and WSVM model possess some advantages such as simple structure, fast convergence speed with high generalization ability.

[1]  Bernhard Schölkopf,et al.  The connection between regularization operators and support vector kernels , 1998, Neural Networks.

[2]  Gary William Flake,et al.  Efficient SVM Regression Training with SMO , 2002, Machine Learning.

[3]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[4]  Chih-Jen Lin,et al.  A Study on SMO-Type Decomposition Methods for Support Vector Machines , 2006, IEEE Transactions on Neural Networks.

[5]  S. Mallat A wavelet tour of signal processing , 1998 .

[6]  Li Zhang,et al.  Wavelet support vector machine , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[7]  Constantin Zopounidis,et al.  Additive Support Vector Machines for Pattern Classification , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[8]  M. Clerc,et al.  The swarm and the queen: towards a deterministic and adaptive particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[9]  Joseph Kee-Yin Ng,et al.  Location Estimation via Support Vector Regression , 2007, IEEE Transactions on Mobile Computing.