Particle swarm optimization for linear support vector machines based classifier selection

Particle swarm optimization is a metaheuristic technique widely applied to solve various optimization problems as well as parameter selection problems for various classification techniques. This paper presents an approach for linear support vector machines classifier optimization combining its selection from a family of similar classifiers with parameter optimization. Experimental results indicate that proposed heuristics can help obtain competitive or even better results compared to similar techniques and approaches and can be used as a solver for various classification tasks.

[1]  Andries P. Engelbrecht,et al.  Computational Intelligence: An Introduction , 2002 .

[2]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[3]  Chih-Jen Lin,et al.  Trust Region Newton Method for Logistic Regression , 2008, J. Mach. Learn. Res..

[4]  Chen yongqi.  LS_SVM Parameters Selection Based on Hybrid Complex Particle Swarm Optimization , 2012 .

[5]  Andreas Christmann,et al.  Support vector machines , 2008, Data Mining and Knowledge Discovery Handbook.

[6]  L. Balthazar.  From Basel 1 to Basel 3 : the integration of state-of-the-art risk modeling in banking regulation , 2006 .

[7]  Jun-Mei Li,et al.  A model based on factor analysis and Support Vector Machine for Credit Risk Identification in small-and-medium enterprises , 2009, 2009 International Conference on Machine Learning and Cybernetics.

[8]  Paulius Danenas,et al.  PSO-based Linear SVM Classifier Selection for Credit Risk Evaluation Modeling Process , 2012, ICEIS.

[9]  Saulius Gudas,et al.  Credit Risk Evaluation Model Development Using Support Vector Based Classifiers , 2011, ICCS.

[10]  Chih-Jen Lin,et al.  LIBLINEAR: A Library for Large Linear Classification , 2008, J. Mach. Learn. Res..

[11]  Adel Al-Jumaily,et al.  A novel partially connected cooperative parallel PSO-SVM algorithm: Study based on sleep apnea detection , 2012, 2012 IEEE Congress on Evolutionary Computation.

[12]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .

[13]  Chih-Hung Wu,et al.  A real-valued genetic algorithm to optimize the parameters of support vector machine for predicting bankruptcy , 2007, Expert Syst. Appl..

[14]  Zheng Rong Yang,et al.  Biological applications of support vector machines , 2004, Briefings Bioinform..

[15]  Mu-Yen Chen,et al.  Bankruptcy prediction in firms with statistical and intelligent techniques and a comparison of evolutionary computation approaches , 2011, Comput. Math. Appl..

[16]  Wolfgang Karl Härdle,et al.  Estimation of Default Probabilities with Support Vector Machines , 2006 .

[17]  Ratna Babu Chinnam,et al.  mr2PSO: A maximum relevance minimum redundancy feature selection method based on swarm intelligence for support vector machine classification , 2011, Inf. Sci..

[18]  Xinli Wang.  Corporate Financial Warning Model Based on PSO and SVM , 2010, 2010 2nd International Conference on Information Engineering and Computer Science.

[19]  Paulius Danenas,et al.  Credit Risk Evaluation Using SVM-Based Classifier , 2010, BIS.

[20]  Kin Keung Lai,et al.  Weighted LS-SVM Credit Scoring Models with AUC Maximization by Direct Search , 2009, 2009 International Joint Conference on Computational Sciences and Optimization.

[21]  Jianxin Wu,et al.  A Fast Dual Method for HIK SVM Learning , 2010, ECCV.

[22]  Paulius Danenas,et al.  Credit risk evaluation modeling using evolutionary linear SVM classifiers and sliding window approach , 2012, ICCS.

[23]  Mauro Birattari,et al.  Swarm Intelligence , 2012, Lecture Notes in Computer Science.

[24]  Kyoung-jae Kim,et al.  Global Optimization of Support Vector Machines Using Genetic Algorithms for Bankruptcy Prediction , 2006, ICONIP.

[25]  Li Li,et al.  Support Vector Machines , 2015 .

[26]  Kin Keung Lai,et al.  Credit Risk Evaluation with Least Square Support Vector Machine , 2006, RSKT.

[27]  Vicente Alarcón Aquino,et al.  A Biometric System Based on Neural Networks and SVM Using Morphological Feature Extraction from Hand-Shape Images , 2011, Informatica.

[28]  Wei-Yang Lin,et al.  Machine Learning in Financial Crisis Prediction: A Survey , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[29]  Feng-Chia Li,et al.  Combination of feature selection approaches with SVM in credit scoring , 2010, Expert Syst. Appl..

[30]  Thorsten Joachims,et al.  Text Categorization with Support Vector Machines: Learning with Many Relevant Features , 1998, ECML.

[31]  Chih-Jen Lin,et al.  A dual coordinate descent method for large-scale linear SVM , 2008, ICML '08.

[32]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[33]  Vladimir Vapnik,et al.  The Nature of Statistical Learning , 1995 .

[34]  Gunnar Rätsch,et al.  Support Vector Machines and Kernels for Computational Biology , 2008, PLoS Comput. Biol..

[35]  Chih-Jen Lin,et al.  Training and Testing Low-degree Polynomial Data Mappings via Linear SVM , 2010, J. Mach. Learn. Res..

[36]  Liu Li-xia,et al.  Tax forecasting theory and model based on SVM optimized by PSO , 2011, Expert Syst. Appl..

[37]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[38]  Yun Ling,et al.  Application of the PSO-SVM Model for Credit Scoring , 2011, 2011 Seventh International Conference on Computational Intelligence and Security.

[39]  Jie Cai,et al.  Simultaneous Feature Selection and LS-SVM Parameters Optimization Algorithm Based on PSO , 2009, 2009 WRI World Congress on Computer Science and Information Engineering.

[40]  Patrick Haffner,et al.  Support vector machines for histogram-based image classification , 1999, IEEE Trans. Neural Networks.

[41]  Khairullah Khan,et al.  A Review of Machine Learning Algorithms for Text-Documents Classification , 2010 .

[42]  Vojislav Kecman,et al.  Kernel Based Algorithms for Mining Huge Data Sets: Supervised, Semi-supervised, and Unsupervised Learning , 2006, Studies in Computational Intelligence.