Separating theorem of samples in Banach space for support vector machine learning

The theory of machine learning in Banach space is a new research topic and has drawn much attention in recent years. The theoretical foundation of this topic is that under what conditions two sample sets can be separated in Banach space. In this paper, motivated by developing new support vector machine (SVM) in Banach space, we present a necessary and sufficient condition of separating two finite classes of samples by a hyper-plane in Banach space. We also present an attainable expression of maximal margin of the separating hyper-planes which includes some cases of the classes of infinite samples in Banach space.

[1]  J. Partington,et al.  Introduction to Functional Analysis , 1981, The Mathematical Gazette.

[2]  W. Congxin,et al.  Embedding problem of fuzzy number space: part II , 1992 .

[3]  Thomas Hofmann,et al.  Learning Over Compact Metric Spaces , 2004, COLT.

[4]  Vladimir Vapnik,et al.  An overview of statistical learning theory , 1999, IEEE Trans. Neural Networks.

[5]  Daniel Lee,et al.  Large-Margin Classification in Banach Spaces , 2007, AISTATS.

[6]  Bernhard Schölkopf,et al.  Learning with kernels , 2001 .

[7]  Kristin P. Bennett,et al.  Duality and Geometry in SVM Classifiers , 2000, ICML.

[8]  Bernhard Schölkopf,et al.  Maximal margin classification for metric spaces , 2005, J. Comput. Syst. Sci..

[9]  Guang-Bin Huang,et al.  Classification ability of single hidden layer feedforward neural networks , 2000, IEEE Trans. Neural Networks Learn. Syst..

[10]  Dengyong Zhou,et al.  Global Geometry of SVM Classifiers , 2002 .

[11]  Angus E. Taylor,et al.  Introduction to functional analysis, 2nd ed. , 1986 .

[12]  Osberth De Castro,et al.  Convex Hull in Feature Space for Support Vector Machines , 2002, IBERAMIA.

[13]  Lotfi A. Zadeh,et al.  Outline of a New Approach to the Analysis of Complex Systems and Decision Processes , 1973, IEEE Trans. Syst. Man Cybern..

[14]  Hongming Zhou,et al.  Optimization method based extreme learning machine for classification , 2010, Neurocomputing.

[15]  H. H. Schaefer,et al.  Topological Vector Spaces , 1967 .

[16]  Ulrike von Luxburg,et al.  Distance-Based Classification with Lipschitz Functions , 2004, J. Mach. Learn. Res..

[17]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[18]  Christopher J. C. Burges,et al.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998, Data Mining and Knowledge Discovery.

[19]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[20]  David Eppstein,et al.  Optimization over Zonotopes and Training Support Vector Machines , 2001, WADS.