Fuzzy one-class support vector machines

In one-class classification, the problem is to distinguish one class of data from the rest of the feature space. It is important in many applications where one of the classes is characterized well, while no measurements are available for the other class. Scholkopf et al. first introduced a method of adapting the support vector machine (SVM) methodology to the one-class classification problem, called one-class SVM. In this paper, we incorporate the concept of fuzzy set theory into the one-class SVM. We apply a fuzzy membership to each input point and reformulate the one-class SVM such that different input points can make different contributions to the learning of decision surface. Besides, the parameters to be identified in one-class SVM, such as the components within the weight vector and the bias term, are fuzzy numbers. This integration preserves the benefits of SVM learning theory and fuzzy set theory, where the SVM learning theory characterizes the properties of learning machines which enable them to effectively generalize the unseen data and the fuzzy set theory might be very useful for finding a fuzzy structure in an evaluation system.

[1]  D. Eisenberg,et al.  Detecting protein function and protein-protein interactions from genome sequences. , 1999, Science.

[2]  Jung-Hsien Chiang,et al.  Recognition of handprinted numerals in VISA® card application forms , 1997, Machine Vision and Applications.

[3]  Bernhard Schölkopf,et al.  The connection between regularization operators and support vector kernels , 1998, Neural Networks.

[4]  D. Dubois,et al.  Operations on fuzzy numbers , 1978 .

[5]  Peter Secretan Learning , 1965, Mental Health.

[6]  Jonathan J. Hull,et al.  A Database for Handwritten Text Recognition Research , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Nello Cristianini,et al.  Advances in Kernel Methods - Support Vector Learning , 1999 .

[8]  Jung-Hsien Chiang,et al.  Handwritten word recognition with character and inter-character neural networks , 1997, IEEE Trans. Syst. Man Cybern. Part B.

[9]  Sayan Mukherjee,et al.  Choosing Multiple Parameters for Support Vector Machines , 2002, Machine Learning.

[10]  Malik Yousef,et al.  One-Class SVMs for Document Classification , 2002, J. Mach. Learn. Res..

[11]  Sheng-De Wang,et al.  Fuzzy support vector machines , 2002, IEEE Trans. Neural Networks.

[12]  Ronald R. Yager,et al.  On Solving Fuzzy Mathematical Relationships , 1979, Inf. Control..

[13]  Jung-Hsien Chiang,et al.  Support vector learning mechanism for fuzzy rule-based modeling: a new approach , 2004, IEEE Trans. Fuzzy Syst..

[14]  Bernhard Schölkopf,et al.  Estimating the Support of a High-Dimensional Distribution , 2001, Neural Computation.

[15]  Siegfried Gottwald,et al.  Applications of Fuzzy Sets to Systems Analysis , 1975 .

[16]  George J. Klir,et al.  Fuzzy sets and fuzzy logic - theory and applications , 1995 .

[17]  Robert P. W. Duin,et al.  Support Vector Data Description , 2004, Machine Learning.

[18]  M. Gerstein,et al.  A Bayesian Networks Approach for Predicting Protein-Protein Interactions from Genomic Data , 2003, Science.

[19]  Dug Hun Hong,et al.  Support vector fuzzy regression machines , 2003, Fuzzy Sets Syst..

[20]  Robert P. W. Duin,et al.  Support vector domain description , 1999, Pattern Recognit. Lett..

[21]  Lotfi A. Zadeh,et al.  The Concepts of a Linguistic Variable and its Application to Approximate Reasoning , 1975 .

[22]  M. Niranjan,et al.  Sequential support vector machines , 1999, Neural Networks for Signal Processing IX: Proceedings of the 1999 IEEE Signal Processing Society Workshop (Cat. No.98TH8468).

[23]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[24]  Didier Dubois,et al.  Fuzzy sets and systems ' . Theory and applications , 2007 .

[25]  J. Chiang,et al.  A new kernel-based fuzzy clustering approach: support vector clustering with cell growing , 2003, IEEE Trans. Fuzzy Syst..

[26]  M. M. Moya,et al.  One-class classifier networks for target recognition applications , 1993 .

[27]  Isabelle Guyon,et al.  Automatic Capacity Tuning of Very Large VC-Dimension Classifiers , 1992, NIPS.

[28]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[29]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[30]  B. Snel,et al.  Comparative assessment of large-scale data sets of protein–protein interactions , 2002, Nature.