Positive definite kernel functions on fuzzy sets

Embedding non-vectorial data into a vector space is very common in machine learning, aiming to perform tasks such as classification, regression or clustering. Fuzzy datasets or datasets whose observations are fuzzy sets, are examples of non-vectorial data and, several fuzzy pattern recognition algorithms analyze them in the space formed by the set of fuzzy sets. However, the analysis of fuzzy data in such space has the limitation of not being a vector space. To overcome such limitation, we propose the embedding of fuzzy data into a proper Hilbert space of functions called the Reproducing Kernel Hilbert Space (RKHS). This embedding is possible by using a positive definite kernel function on fuzzy sets. We present a formulation of a real-valued kernels on fuzzy sets, in particular, we define the intersection kernel and the cross product kernel on fuzzy sets giving some examples of them using T-norm operators. Also, we analyze the nonsingleton TSK fuzzy kernel and, finally, we give some examples of kernels on fuzzy sets that can be easily constructed from the previous ones.

[1]  Inés Couso,et al.  Diagnosis of dyslexia with low quality data with genetic fuzzy systems , 2010, Int. J. Approx. Reason..

[2]  R. Viertl.  Statistical Methods for Fuzzy Data , 2011 .

[3]  Yixin Chen,et al.  Support vector learning for fuzzy rule-based classification systems , 2003, IEEE Trans. Fuzzy Syst..

[4]  Witold Pedrycz,et al.  Fuzzy Systems Engineering - Toward Human-Centric Computing , 2007 .

[5]  Yixin Chen,et al.  Support Vector Machines and Fuzzy Systems , 2008, Soft Computing for Knowledge Discovery and Data Mining.

[6]  Jorge Casillas,et al.  Genetic learning of fuzzy rules based on low quality data , 2009, Fuzzy Sets Syst..

[7]  A. Atiya,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2005, IEEE Transactions on Neural Networks.

[8]  A. Berlinet,et al.  Reproducing kernel Hilbert spaces in probability and statistics , 2004 .

[9]  Chua Teck Wee,et al.  EFSVM-FCM: Evolutionary fuzzy rule-based support vector machines classifier with FCM clustering , 2008, 2008 IEEE International Conference on Fuzzy Systems (IEEE World Congress on Computational Intelligence).

[10]  Lotfi A. Zadeh,et al.  Fuzzy logic = computing with words , 1996, IEEE Trans. Fuzzy Syst..

[11]  Chia-Feng Juang,et al.  A Self-Organizing TS-Type Fuzzy Network With Support Vector Learning and its Application to Classification Problems , 2007, IEEE Transactions on Fuzzy Systems.

[12]  Kenji Fukumizu,et al.  Semigroup Kernels on Measures , 2005, J. Mach. Learn. Res..

[13]  ÁNCHEZ,et al.  Future performance modeling in athletism with low quality data-based genetic fuzzy systems , 2010 .

[14]  Lotfi A. Zadeh,et al.  Soft computing and fuzzy logic , 1994, IEEE Software.

[15]  Stéphane Canu,et al.  Kernel functions in Takagi-Sugeno-Kang fuzzy system with nonsingleton fuzzy input , 2013, 2013 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[16]  Frank Chung-Hoon Rhee,et al.  Interval type-2 approach to kernel possibilistic C-means clustering , 2012, 2012 IEEE International Conference on Fuzzy Systems.

[17]  Alexander J. Smola,et al.  Learning with non-positive kernels , 2004, ICML.

[18]  Tony Jebara,et al.  Probability Product Kernels , 2004, J. Mach. Learn. Res..

[19]  Paul D. Gader,et al.  Robust kernel discriminant analysis using fuzzy memberships , 2011, Pattern Recognit..

[20]  Bernhard Schölkopf,et al.  One-Class Support Measure Machines for Group Anomaly Detection , 2013, UAI.

[21]  Bernhard Schölkopf,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2005, IEEE Transactions on Neural Networks.

[22]  Yves Grandvalet,et al.  Y.: SimpleMKL , 2008 .

[23]  Robert P. W. Duin,et al.  Support Vector Data Description , 2004, Machine Learning.

[24]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[25]  Thomas Gärtner,et al.  Kernels for structured data , 2008, Series in Machine Perception and Artificial Intelligence.

[26]  Xiaowei Yang,et al.  A Kernel Fuzzy c-Means Clustering-Based Fuzzy Support Vector Machine Algorithm for Classification Problems With Outliers or Noises , 2011, IEEE Transactions on Fuzzy Systems.

[27]  R. Ash,et al.  Probability and measure theory , 1999 .

[28]  Paul P. Wang.  Computing with Words , 2001 .

[29]  Bernhard Schölkopf,et al.  Learning from Distributions via Support Measure Machines , 2012, NIPS.

[30]  Xiaoping Xue,et al.  Design of Natural Classification Kernels Using Prior Knowledge , 2012, IEEE Transactions on Fuzzy Systems.

[31]  Bernhard Moser,et al.  On Representing and Generating Kernels by Fuzzy Equivalence Relations , 2006, J. Mach. Learn. Res..

[32]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2004 .

[33]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[34]  Jesús Alcalá-Fdez,et al.  Mining fuzzy association rules from low-quality data , 2012, Soft Comput..

[35]  Grace Wahba,et al.  Spline Models for Observational Data , 1990 .

[36]  Sadaaki Miyamoto,et al.  On kernel fuzzy c-means for data with tolerance using explicit mapping for kernel data analysis , 2010, FUZZ-IEEE.

[37]  Chin-Teng Lin,et al.  Support-vector-based fuzzy neural network for pattern classification , 2006, IEEE Transactions on Fuzzy Systems.

[38]  Panos M. Pardalos,et al.  Handbook of Massive Data Sets , 2002, Massive Computing.

[39]  John Q. Gan,et al.  Constructing L2-SVM-Based Fuzzy Classifiers in High-Dimensional Space With Automatic Model Selection and Fuzzy Rule Ranking , 2007, IEEE Transactions on Fuzzy Systems.

[40]  Chia-Feng Juang,et al.  An incremental support vector machine-trained TS-type fuzzy system for online classification problems , 2011, Fuzzy Sets Syst..

[41]  D. Ralescu,et al.  Statistical Modeling, Analysis and Management of Fuzzy Data , 2001 .

[42]  Nello Cristianini,et al.  Classification using String Kernels , 2000 .

[43]  N. Aronszajn.  Theory of Reproducing Kernels. , 1950 .

[44]  Jin-Tsong Jeng,et al.  Support vector machines for the fuzzy neural networks , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[45]  Jacek M. Łski.  On support vector regression machines with linguistic interpretation of the kernel matrix , 2006 .

[46]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[47]  Yung-Yu Chuang,et al.  Multiple Kernel Fuzzy Clustering , 2012, IEEE Transactions on Fuzzy Systems.

[48]  Jianguo Wang,et al.  Fuzzy maximum scatter discriminant analysis with kernel methods , 2010, 2010 Seventh International Conference on Fuzzy Systems and Knowledge Discovery.

[49]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.