Classification on proximity data with LP-machines

We provide a new linear program to deal with classification of data in the case of data given in terms of pairwise proximities. This allows to avoid the problems inherent in using feature spaces with indefinite metric in support vector machines, since the notion of a margin is purely needed in input space where the classification actually occurs. Moreover in our approach we can enforce sparsity in the proximity representation by sacrificing training error. This turns out to be favorable for proximity data. Similar to /spl nu/-SV methods, the only parameter needed in the algorithm is the (asymptotical) number of data points being classified with a margin. Finally, the algorithm is successfully compared with /spl nu/-SV learning in proximity space and K-nearest-neighbors on real world data from neuroscience and molecular biology.

[1]  Joseph L. Zinnes,et al.  Theory and Methods of Scaling. , 1958 .

[2]  M. V. Rossum,et al.  In Neural Computation , 2022 .

[3]  C. Blakemore,et al.  Analysis of connectivity in the cat cerebral cortex , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[4]  John Shawe-Taylor,et al.  A framework for structural risk minimisation , 1996, COLT '96.

[5]  Bernhard Schölkopf,et al.  Support vector learning , 1997 .

[6]  R. C. Williamson,et al.  Support vector regression with automatic accuracy control. , 1998 .

[7]  Bernhard Schölkopf,et al.  Generalization Bounds for Convex Combinations of Kernel Functions , 1998 .

[8]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[9]  Paul S. Bradley,et al.  Feature Selection via Mathematical Programming , 1997, INFORMS J. Comput..

[10]  Olvi L. Mangasarian,et al.  Generalized Support Vector Machines , 1998 .

[11]  Klaus Obermayer,et al.  Classi cation on Pairwise Proximity , 2007 .

[12]  Klaus Obermayer,et al.  A Stochastic Self-Organizing Map for Proximity Data , 1999, Neural Computation.

[13]  Olvi L. Mangasarian,et al.  Arbitrary-norm separating plane , 1999, Oper. Res. Lett..

[14]  Kristin P. Bennett,et al.  Combining support vector and mathematical programming methods for classification , 1999 .

[15]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[16]  Bernhard Schölkopf,et al.  New Support Vector Algorithms , 2000, Neural Computation.