Evaluating the Generalization Ability of Support Vector Machines through the Bootstrap

The well-known bounds on the generalizationability of learning machines, based on the Vapnik–Chernovenkis (VC) dimension,are very loose when applied to Support Vector Machines (SVMs).In this work we evaluate the validity of the assumption that these bounds are,nevertheless, good indicators of the generalization ability of SVMs.We show that this assumption is, in general, true and assessits correctness, in a statistical sense, on several pattern recognition benchmarks throughthe use of the bootstrap technique.

[1]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[2]  Juan-Manuel Torres-Moreno,et al.  Characterization of the Sonar Signals Benchmark , 1998, Neural Processing Letters.

[3]  Davide Anguita,et al.  Support Vector Machines: A Comparison of Some Kernel Functions , 1999, IIA/SOCO.

[4]  Davide Anguita,et al.  High Performance Neurocomputing: Industrial and Medical Applications of the RAIN System , 1998, HPCN Europe.

[5]  Thomas G. Dietterich.  Approximate Statistical Tests for Comparing Supervised Classification Learning Algorithms , 1998, Neural Computation.

[6]  Nello Cristianini,et al.  Dynamically Adapting Kernels in Support Vector Machines , 1998, NIPS.

[7]  Marti A. Hearst.  Trends & Controversies: Support Vector Machines , 1998, IEEE Intell. Syst..

[8]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[9]  John Shawe-Taylor,et al.  Generalization Performance of Support Vector Machines and Other Pattern Classifiers , 1999 .

[10]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[11]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[12]  Marti A. Hearst.  Intelligent Connections: Battling with GA-Joe. , 1998 .

[13]  Anil K. Jain,et al.  Bootstrap Techniques for Error Estimation , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.