Support Vector Machines in High Energy Physics

This lecture will introduce the Support Vector algorithms for classification and regression. They are an application of the so called kernel trick, which allows the extension of a certain class of linear algorithms to the non linear case. The kernel trick will be introduced and in the context of structural risk minimization, large margin algorithms for classification and regression will be presented. Current applications in high energy physics will be discussed.

[1]  Hans Burkhardt,et al.  Invariance in Kernel Methods by Haar-Integration Kernels , 2005, SCIA.

[2]  S. Brendle,et al.  Calculus of Variations , 1927, Nature.

[3]  Chih-Jen Lin,et al.  Asymptotic Behaviors of Support Vector Machines with Gaussian Kernel , 2003, Neural Computation.

[4]  B. Brunt The calculus of variations , 2003 .

[5]  J. Mercer Functions of Positive and Negative Type, and their Connection with the Theory of Integral Equations , 1909 .

[6]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[7]  J. Weston,et al.  Support vector regression with ANOVA decomposition kernels , 1999 .

[8]  Massimiliano Pontil,et al.  Support vector machines vs multi-layer perceptrons in particle identification , 1999, ESANN.

[9]  Sayan Mukherjee,et al.  Choosing Multiple Parameters for Support Vector Machines , 2002, Machine Learning.

[10]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2003, ICTAI.

[11]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[12]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[13]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[14]  P. Vannerem,et al.  Classifying LEP data with support vector algorithms. , 1999 .

[15]  Vladimir Vapnik,et al.  The Nature of Statistical Learning , 1995 .

[16]  A. Vaiciulis,et al.  Support vector machines in analysis of top quark production , 2002 .