Geometrical interpretation and applications of membership functions with fuzzy rough sets

Fuzzy rough sets are a generalization of crisp rough sets for measuring inconsistency between conditional attributes and decision attributes for many decision systems. In many classification problems a membership function for the training sample belonging to a certain class can be computed by methods in fuzzy rough sets. In this paper, we present a geometrical interpretation and its applications of this kind of membership functions. First, we prove that every fuzzy similarity relation in fuzzy rough sets is a reproducing kernel which is related to a Krein space, thus, fuzzy similarity relations can be geometrically explained in a Krein space. Second, we will present the interpretation of several types of membership functions geometrically by using the lower approximations in fuzzy rough sets, in terms of square distances in Krein spaces. As practical applications of these membership functions, we develop a new algorithm to find reducts and reformulate soft margin support vector machines by taking the membership degree for every training sample into considerations. Experimental results also demonstrate the effectiveness of the work proposed in this paper.

[1]  Xizhao Wang,et al.  FRSVMs: Fuzzy rough set based support vector machines , 2010, Fuzzy Sets Syst..

[2]  Didier Dubois,et al.  Putting Rough Sets and Fuzzy Sets Together , 1992, Intelligent Decision Support.

[3]  Bernhard Moser,et al.  On Representing and Generating Kernels by Fuzzy Equivalence Relations , 2006, J. Mach. Learn. Res..

[4]  Guilong Liu,et al.  Generalized rough sets over fuzzy lattices , 2008, Inf. Sci..

[5]  Xiao-Ping Yang,et al.  Minimization of axiom sets on fuzzy approximation operators , 2007, Inf. Sci..

[6]  Xizhao Wang,et al.  On the generalization of fuzzy rough sets , 2005, IEEE Transactions on Fuzzy Systems.

[7]  I. Hatono,et al.  Fuzzy decision trees by fuzzy ID3 algorithm and its application to diagnosis systems , 1994, Proceedings of 1994 IEEE 3rd International Fuzzy Systems Conference.

[8]  Jesús Manuel Fernández Salido,et al.  Rough set analysis of a general type of fuzzy data using transitive aggregations of fuzzy similarity relations , 2003, Fuzzy Sets Syst..

[9]  Degang Chen,et al.  Local reduction of decision system with fuzzy rough sets , 2010, Fuzzy Sets Syst..

[10]  S. Tsumoto,et al.  Rough set methods and applications: new developments in knowledge discovery in information systems , 2000 .

[11]  Wen-Xiu Zhang,et al.  Rough fuzzy approximations on two universes of discourse , 2008, Inf. Sci..

[12]  Qiang Shen,et al.  Selecting informative features with fuzzy-rough sets and its application for complex systems monitoring , 2004, Pattern Recognit..

[13]  Xizhao Wang,et al.  Attributes Reduction Using Fuzzy Rough Sets , 2008, IEEE Transactions on Fuzzy Systems.

[14]  Andrzej Skowron,et al.  The Discernibility Matrices and Functions in Information Systems , 1992, Intelligent Decision Support.

[15]  Nehad N. Morsi,et al.  Axiomatics for fuzzy rough sets , 1998, Fuzzy Sets Syst..

[16]  Richard Weber,et al.  Fuzzy-ID3: A class of methods for automatic knowledge acquisition , 1992 .

[17]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[18]  Qiang Shen,et al.  Fuzzy-Rough Sets Assisted Attribute Selection , 2007, IEEE Transactions on Fuzzy Systems.

[19]  Chris Cornelis,et al.  Attribute selection with fuzzy decision reducts , 2010, Inf. Sci..

[20]  J. Bognár,et al.  Indefinite Inner Product Spaces , 1974 .

[21]  D. Dubois,et al.  ROUGH FUZZY SETS AND FUZZY ROUGH SETS , 1990 .

[22]  Qinghua Hu,et al.  Information-preserving hybrid data reduction based on fuzzy-rough techniques , 2006, Pattern Recognit. Lett..

[23]  R. Słowiński Intelligent Decision Support: Handbook of Applications and Advances of the Rough Sets Theory , 1992 .

[24]  Alexander J. Smola,et al.  Learning with non-positive kernels , 2004, ICML.

[25]  Wei-Zhi Wu,et al.  Generalized fuzzy rough sets , 2003, Inf. Sci..

[26]  Janusz Zalewski,et al.  Rough sets: Theoretical aspects of reasoning about data , 1996 .

[27]  Hui Wang,et al.  Granular Computing Based on Fuzzy Similarity Relations , 2007, 2007 International Conference on Machine Learning and Cybernetics.

[28]  Qiang Shen,et al.  Centre for Intelligent Systems and Their Applications Fuzzy Rough Attribute Reduction with Application to Web Categorization Fuzzy Rough Attribute Reduction with Application to Web Categorization Fuzzy Sets and Systems ( ) – Fuzzy–rough Attribute Reduction with Application to Web Categorization , 2022 .

[29]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[30]  Qinghua Hu,et al.  Parameterized attribute reduction with Gaussian kernel based fuzzy rough sets , 2011, Inf. Sci..

[31]  Bernard Haasdonk,et al.  Feature space interpretation of SVMs with indefinite kernels , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Wen-Xiu Zhang,et al.  An axiomatic characterization of a fuzzy generalization of rough sets , 2004, Inf. Sci..

[33]  Anna Maria Radzikowska,et al.  A comparative study of fuzzy rough sets , 2002, Fuzzy Sets Syst..

[34]  Chen Degang,et al.  Local reduction of decision system with fuzzy rough sets , 2010 .

[35]  Qiang Shen,et al.  Semantics-preserving dimensionality reduction: rough and fuzzy-rough-based approaches , 2004, IEEE Transactions on Knowledge and Data Engineering.

[36]  Lei Zhang,et al.  Sample Pair Selection for Attribute Reduction with Rough Set , 2012, IEEE Transactions on Knowledge and Data Engineering.

[37]  Laurent Schwartz,et al.  Sous-espaces hilbertiens d’espaces vectoriels topologiques et noyaux associés (Noyaux reproduisants) , 1964 .

[38]  Qionghai Dai,et al.  A novel approach to fuzzy rough sets based on a fuzzy covering , 2007, Inf. Sci..

[39]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[40]  Rajen B. Bhatt,et al.  On fuzzy-rough sets approach to feature selection , 2005, Pattern Recognit. Lett..

[41]  Daoliang Li,et al.  Original paper: Classification of foreign fibers in cotton lint using machine vision and multi-class support vector machine , 2010 .

[42]  Qiang Shen,et al.  Fuzzy-rough data reduction with ant colony optimization , 2005, Fuzzy Sets Syst..

[43]  Witold Pedrycz,et al.  Gaussian kernel based fuzzy rough sets: Model, uncertainty measures and applications , 2010, Int. J. Approx. Reason..

[44]  Elzbieta Pekalska,et al.  Kernel Discriminant Analysis for Positive Definite and Indefinite Kernels , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Wei-Zhi Wu,et al.  Constructive and axiomatic approaches of fuzzy approximation operators , 2004, Inf. Sci..

[46]  Yiyu Yao,et al.  Discernibility matrix simplification for constructing attribute reducts , 2009, Inf. Sci..

[47]  Qiang Shen,et al.  New Approaches to Fuzzy-Rough Feature Selection , 2009, IEEE Transactions on Fuzzy Systems.