Adapting multiple kernel parameters for support vector machines using genetic algorithms

Kernel parameterization is a key design step in the application of support vector machines (SVM) for supervised learning problems. A grid-search with a cross-validation criteria is often conducted to choose the kernel parameters but it is computationally unfeasible for a large number of them. Here we describe a genetic algorithm (GA) as a method for tuning kernels of multiple parameters for classification tasks, with application to the weighted radial basis function (RBF) kernel. In this type of kernels the number of parameters equals the dimension of the input patterns which is usually high for biological datasets. We show preliminary experimental results where adapted weighted RBF kernels for SVM achieve classification performance over 98% in human serum proteomic profile data. Further improvements to this method may lead to discovery of relevant biomarkers in biomedical applications

[1]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[3]  Erick Cantú-Paz,et al.  Feature Subset Selection, Class Separability, and Genetic Algorithms , 2004, GECCO.

[4]  Sayan Mukherjee,et al.  Choosing Multiple Parameters for Support Vector Machines , 2002, Machine Learning.

[5]  Thorsten Joachims,et al.  Making large scale SVM learning practical , 1998 .

[6]  Christian Igel,et al.  Evolutionary tuning of multiple SVM parameters , 2005, ESANN.

[7]  Bernhard Schölkopf,et al.  Feature selection for support vector machines by means of genetic algorithm , 2003, Proceedings. 15th IEEE International Conference on Tools with Artificial Intelligence.

[8]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[9]  Bernhard Schölkopf,et al.  New Support Vector Algorithms , 2000, Neural Computation.

[10]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[11]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[12]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[13]  Thorsten Joachims,et al.  Transductive Inference for Text Classification using Support Vector Machines , 1999, ICML.

[14]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[15]  Hava T. Siegelmann,et al.  Support Vector Clustering , 2002, J. Mach. Learn. Res..

[16]  Tom Fawcett,et al.  ROC Graphs: Notes and Practical Considerations for Researchers , 2007 .

[17]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[18]  Timothy Planche,et al.  A novel and accurate diagnostic test for human African trypanosomiasis , 2004, The Lancet.