Research on parameter selection method for support vector machines

The kernel parameter and penalty parameter C are the main factors that affect the learning performance of the support vector machine. However, there are many deficiencies in the existing kernel parameters and penalty parameters C. These methods do not have high accuracy when it comes to classifying multi-category samples, and even ignore some of the samples to conduct training, which violates the integrity of the experimental data. In contrast, this paper improves the selection method of support vector machine kernel parameters and penalty parameters in two ways. First, it obtains the kernel parameter value by optimizing the maximum separation interval between the samples. Second, it optimizes the generalization ability estimation via the influence of the non-boundary support vector on the stability of the support vector machine. The method takes full account of all the training sample data, which is applicable to most sample types, and has the characteristics of low initialization requirements and high-test accuracy. The paper finally uses multiple sets of UCI sample data sets and facial image recognition to verify the method. The experimental results show that the method is feasible, effective and stable.

[1]  S. Abe.  Fuzzy support vector machines for multilabel classification , 2015, Pattern Recognit..

[2]  Dacheng Tao,et al.  Multi-task proximal support vector machine , 2015, Pattern Recognit..

[3]  Mohamed Cheriet,et al.  Support Vector Machine , 2009, Encyclopedia of Biometrics.

[4]  A. Atiya,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2005, IEEE Transactions on Neural Networks.

[5]  Elmer Andrés Fernández,et al.  SVMTOCP: A Binary Tree Base SVM Approach through Optimal Multi-class Binarization , 2012, CIARP.

[6]  Yuan-Hai Shao,et al.  Least squares twin parametric-margin support vector machine for classification , 2013, Applied Intelligence.

[7]  Florian Yger,et al.  Learning with infinitely many features , 2012, Machine Learning.

[8]  Muhammad Tanveer,et al.  An efficient regularized K-nearest neighbor based weighted twin support vector regression , 2016, Knowl. Based Syst..

[9]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[10]  Izhar Ahmad,et al.  One norm linear programming support vector regression , 2016, Neurocomputing.

[11]  Pedro Antonio Gutiérrez,et al.  Parameter estimation of q-Gaussian Radial Basis Functions Neural Networks with a Hybrid Algorithm for binary classification , 2012, Neurocomputing.

[12]  Ling Guan,et al.  Covariance-guided One-Class Support Vector Machine , 2014, Pattern Recognit..

[13]  Reshma Khemchandani,et al.  Multi-category laplacian least squares twin support vector machine , 2016, Applied Intelligence.

[14]  Mohamad T. Musavi,et al.  On the training of radial basis function classifiers , 1992, Neural Networks.

[15]  Y. Iwahori,et al.  Defect Classification of Electronic Board Using Multiple Classifiers and Grid Search of SVM Parameters , 2013 .

[16]  Srujana Rongali,et al.  Parameter Optimization of Support Vector Machine by Improved Ant Colony Optimization , 2016 .

[17]  Yang Zhang,et al.  Feature selection for support vector machines with RBF kernel , 2011, Artificial Intelligence Review.

[18]  M. Narasimha Murty,et al.  On Improving the Generalization of SVM Classifier , 2011 .

[19]  Minh Le Nguyen,et al.  Feature weighting and SVM parameters optimization based on genetic algorithms for classification problems , 2016, Applied Intelligence.

[20]  Yuan-Hai Shao,et al.  Nonparallel hyperplane support vector machine for binary classification problems , 2014, Inf. Sci..

[21]  Abhisek Ukil,et al.  Support Vector Machine , 2007 .

[22]  Nickolas Savarimuthu,et al.  Enhancing the Performance of LibSVM Classifier by Kernel F-Score Feature Selection , 2009, IC3.

[23]  Hong-Bin Shen,et al.  A supervised particle swarm algorithm for real-parameter optimization , 2015, Applied Intelligence.

[24]  Jalal A. Nasiri,et al.  Least squares twin multi-class classification support vector machine , 2015, Pattern Recognit..

[25]  Sheng-De Wang,et al.  Choosing the kernel parameters for support vector machines by the inter-cluster distance in the feature space , 2009, Pattern Recognit..

[26]  Gary Doran,et al.  A theoretical and empirical analysis of support vector machine methods for multiple-instance classification , 2014, Machine Learning.

[27]  Shifei Ding,et al.  Research of granular support vector machine , 2011, Artificial Intelligence Review.