论文信息 - Creating an ensemble of diverse support vector machines using Adaboost

Creating an ensemble of diverse support vector machines using Adaboost

Support vector machines are one of the most employed methods of pattern classification, and the Adaboost algorithm is an effective way of improving the performance of the weak learners that compose the ensemble. In this article, we propose to create an Adaboost-based ensemble of SVM, by altering the Gaussian width parameter of the RBF-SVM. Using data sets from the UCI repository, we made tests to evaluate the algorithm.

[1] Lei Wang,et al. A study of AdaBoost with SVM based weak learners , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[2] R. Schapire. The Strength of Weak Learnability , 1990, Machine Learning.

[3] Vladimir Vapnik,et al. Statistical learning theory , 1998 .

[4] Ludmila I. Kuncheva,et al. Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy , 2003, Machine Learning.

[5] Yoav Freund,et al. A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[6] Clodoaldo A. M. Lima,et al. Comite de maquinas : uma abordagem unificada empregando maquinas de vetores-suporte , 2004 .

[7] Fernando Lozano,et al. Boosting of support vector machines with application to editing , 2005, Fourth International Conference on Machine Learning and Applications (ICMLA'05).

[8] Robert E. Schapire,et al. The Boosting Approach to Machine Learning An Overview , 2003 .

[9] Vladimir Vapnik,et al. Chervonenkis: On the uniform convergence of relative frequencies of events to their probabilities , 1971 .

[10] Yoav Freund,et al. A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.