A tutorial on n-support vector machines

SUMMARY We briefly describe the main ideas of statistical learning theory, support vector machines (SVMs), and kernel feature spaces. We place particular emphasis on a description of the so-called n-SVM, including details of the algorithm and its implementation, theoretical results, and practical applications. Copyright # 2005 John Wiley & Sons, Ltd.

[1]  Mordecai Avriel,et al.  Nonlinear programming , 1976 .

[2]  Ingo Steinwart,et al.  On the Optimal Parameter Choice for v-Support Vector Machines , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  David J. Crisp,et al.  A Geometric Interpretation of ?-SVM Classifiers , 1999, NIPS 2000.

[4]  John C. Platt,et al.  Fast training of support vector machines using sequential minimal optimization, advances in kernel methods , 1999 .

[5]  Ingo Steinwart,et al.  Support Vector Machines are Universally Consistent , 2002, J. Complex..

[6]  Noga Alon,et al.  Scale-sensitive dimensions, uniform convergence, and learnability , 1997, JACM.

[7]  Chih-Jen Lin,et al.  Formulations of Support Vector Machines: A Note from an Optimization Point of View , 2001, Neural Computation.

[8]  Chih-Jen Lin,et al.  Decomposition Methods for Linear Support Vector Machines , 2004, Neural Computation.

[9]  Hector A. Rosales-Macedo.  Nonlinear Programming: Theory and Algorithms (2nd Edition) , 1993 .

[10]  Ole Winther,et al.  Gaussian processes and SVM: Mean field and leave-one-out estimator , 2000 .

[11]  Bernhard Schölkopf,et al.  New Support Vector Algorithms , 2000, Neural Computation.

[12]  G. Wahba.  Spline models for observational data , 1990 .

[13]  David J. Spiegelhalter,et al.  Machine Learning, Neural and Statistical Classification , 2009 .

[14]  Bernhard Schölkopf,et al.  Extension of the nu-SVM range for classification , 2003 .

[15]  Thorsten Joachims,et al.  Making large scale SVM learning practical , 1998 .

[16]  Bernhard Schölkopf,et al.  Improving the Accuracy and Speed of Support Vector Machines , 1996, NIPS.

[17]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[18]  V. Vapnik.  Estimation of Dependences Based on Empirical Data , 2006 .

[19]  M. Aizerman,et al.  Theoretical Foundations of the Potential Function Method in Pattern Recognition Learning , 1964 .

[20]  Jitendra Malik,et al.  Learning to Detect Natural Image Boundaries Using Brightness and Texture , 2002, NIPS.

[21]  Bernhard Schölkopf,et al.  Generalization Performance of Regularization Networks and Support Vector Machines via Entropy Numbers of Compact Operators , 1998 .

[22]  Bernhard Schölkopf,et al.  Kernel Dependency Estimation , 2002, NIPS.

[23]  Cheng-Chew Lim,et al.  Dual /spl nu/-support vector machine with error rate and training size biasing , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[24]  Cheng-Chew Lim,et al.  An Implementation of Training Dual-nu Support Vector Machines , 2005 .

[25]  Chih-Jen Lin,et al.  On the convergence of the decomposition method for support vector machines , 2001, IEEE Trans. Neural Networks.

[26]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[27]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[28]  John Shawe-Taylor,et al.  Generalization Performance of Support Vector Machines and Other Pattern Classifiers , 1999 .

[29]  Bernhard Schölkopf,et al.  Support vector learning , 1997 .

[30]  V. Vapnik.  Pattern recognition using generalized portrait method , 1963 .

[31]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[32]  Bernhard Schölkopf,et al.  Improving the accuracy and speed of support vector learning machines , 1997, NIPS 1997.

[33]  Mokhtar S. Bazaraa,et al.  Nonlinear Programming: Theory and Algorithms , 1993 .

[34]  V. Vapnik,et al.  Bounds on Error Expectation for Support Vector Machines , 2000, Neural Computation.

[35]  Alexander J. Smola,et al.  Advances in Large Margin Classifiers , 2000 .

[36]  Carl Staelin,et al.  A Personal Email Assistant , 2002 .

[38]  Ingo Steinwart,et al.  Sparseness of Support Vector Machines , 2003, J. Mach. Learn. Res..

[39]  P. Wolfe.  A duality theorem for non-linear programming , 1961 .

[40]  Kristin P. Bennett,et al.  Duality and Geometry in SVM Classifiers , 2000, ICML.

[41]  Arthur Gretton,et al.  Estimating the Leave-One-Out Error for Classification Learning with SVMs , 2001 .

[42]  J. Mercer.  Functions of positive and negative type, and their connection with the theory of integral equations , 1909 .

[43]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.