Probabilistic SVM outputs for pattern recognition using analytical geometry

We present an alternative way of interpreting and modifying the outputs of the support vector machine (SVM) classifiers. Stemming from the geometrical interpretation of the SVM outputs as a distance of individual patterns from the hyperplane, allows us to calculate its posterior probability, i.e. to construct a probability-based measure of belonging to one of the classes, depending on the vector's relative distance from the hyperplane. We illustrate the results by providing suitable analysis of three classification problems and comparing them with an already published method for modifying SVM outputs.

[1]  Alexander J. Smola,et al.  Advances in Large Margin Classifiers , 2000 .

[2]  Barak A. Pearlmutter,et al.  Equivalence Proofs for Multi-Layer Perceptron Classifiers and the Bayesian Discriminant Function , 1991 .

[3]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[4]  A. Madevska-Bogdanova,et al.  A new approach of modifying SVM outputs , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[6]  Ingo Steinwart,et al.  On the Influence of the Kernel on the Consistency of Support Vector Machines , 2002, J. Mach. Learn. Res..

[7]  Richard Lippmann,et al.  Neural Network Classifiers Estimate Bayesian a posteriori Probabilities , 1991, Neural Computation.

[8]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[9]  Ana Madevska Bogdanova,et al.  A New Approach of Modifying SVM Outputs , 2000, IJCNN.

[10]  G. Wahba.  Support vector machines, reproducing kernel Hilbert spaces, and randomized GACV , 1999 .

[11]  Melcher P. Fobes,et al.  Calculus and analytic geometry , 1963 .

[12]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[13]  John Platt,et al.  Probabilistic Outputs for Support vector Machines and Comparisons to Regularized Likelihood Methods , 1999 .

[14]  Grace Wahba.  The Multicategory Support Vector Machine, with Application to the Classification of Simulated and Real MODIS Data into Clear, Ice Cloud and Water Cloud Categories. , 2003 .