Evolution of Kernels for Support Vector Machine Classification on Large Datasets

Kernel selection is a main factor in the designing of support vector machines. Evolutionary techniques have been applied to select the fittest kernel for specific classification problems. However, technical issues emerge when attempting to apply this methodology to deal with large datasets. On the other hand, a new method for improving the training time of support vector machines was recently developed. In this chapter, the new method is integrated in a kernel evolution scheme. Ten benchmark datasets are tested. Results indicate that the new method speeds up the evolution process when datasets are greater than 1000 instances.

[1]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[2]  Vineet Sahula,et al.  Efficient kernel functions for support vector machine regression model for analog circuits’ performance evaluation , 2011 .

[3]  Shigeo Abe.  Support Vector Machines for Pattern Classification , 2010, Advances in Pattern Recognition.

[4]  Bernd Bischl,et al.  Tuning and evolution of support vector kernels , 2012, Evol. Intell..

[5]  Asdrúbal López Chau,et al.  Support vector machine classification for large datasets using decision tree and Fisher linear discriminant , 2014, Future Gener. Comput. Syst..

[6]  Ivor W. Tsang,et al.  Core Vector Machines: Fast SVM Training on Very Large Data Sets , 2005, J. Mach. Learn. Res..

[7]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[8]  Ethem Alpaydin,et al.  Multiple Kernel Learning Algorithms , 2011, J. Mach. Learn. Res..

[9]  Xinhua Zhang.  Support Vector Machines , 2017, Encyclopedia of Machine Learning and Data Mining.

[10]  Vince D. Calhoun,et al.  A multiple kernel learning approach to perform classification of groups from complex-valued fMRI data analysis: Application to schizophrenia , 2014, NeuroImage.

[11]  Juan Martín Carpio Valadez,et al.  Multiple Kernel Support Vector Machine Problem Is NP-Complete , 2014, MICAI.

[12]  Laura Diosan,et al.  Learning SVM with Complex Multiple Kernels Evolved by Genetic Programming , 2010, Int. J. Artif. Intell. Tools.

[13]  Hamza Turabieh,et al.  New empirical nonparametric kernels for support vector machine classification , 2013, Appl. Soft Comput..

[14]  J. Mercer.  Functions of Positive and Negative Type, and their Connection with the Theory of Integral Equations , 1909 .

[15]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[16]  Vineet Sahula,et al.  Exploring Efficient Kernel Functions for Support Vector Machine Based Feasibility Models for Analog Circuits , 2011 .