An improved algorithm for calculating fuzzy attribute reducts

Fuzzy rough attribute reduct has been widely used to remove redundant real-valued attributes without discretizing. By now, there are two existing fuzzy rough attribute reduct methods, one is based on dependency function and another based on discernibility matrix. The former proposed by Shen in 2002 can deal with fuzzy decision table FDT with real-valued condition attributes and fuzzy decision attributes. However, this algorithm is not convergent on many real datasets, and the computational complexity of the algorithm increases exponentially with the number of input variables. The latter proposed by Tsang in 2008 can only deal with fuzzy decision table with real-valued condition attributes and symbol-valued decision attributes. In this paper, we extend the latter method and propose two algorithms for calculating all fuzzy rough attribute reducts to deal with fuzzy decision table with real-valued condition and decision attributes. The first algorthim is designed for computing all fuzzy attribute reducts, yet the computation complexity of this algorithm increases exponentially with the number of attributes. The second one which can find one near-optimal reduct is a heuristic variant of the first algorithm. The experimental results show the proposed method is feasible and effective.

[1]  Ju-Sheng Mi,et al.  Attribute reduction based on generalized fuzzy evidence theory in fuzzy decision systems , 2011, Fuzzy Sets Syst..

[2]  De-gang Chen,et al.  The Model of Fuzzy Variable Precision Rough Sets , 2007, 2007 International Conference on Machine Learning and Cybernetics.

[3]  Slavka Bodjanova,et al.  Approximation of fuzzy concepts in decision making , 1997, Fuzzy Sets Syst..

[4]  Xizhao Wang,et al.  Maximum Ambiguity-Based Sample Selection in Fuzzy Decision Tree Induction , 2012, IEEE Transactions on Knowledge and Data Engineering.

[5]  Qinghua Hu,et al.  Fuzzy preference based rough sets , 2010, Inf. Sci..

[6]  Xizhao Wang,et al.  FRSVMs: Fuzzy rough set based support vector machines , 2010, Fuzzy Sets Syst..

[7]  Qinghua Hu,et al.  Robust fuzzy rough classifiers , 2011, Fuzzy Sets Syst..

[8]  S. Nanda,et al.  Fuzzy rough sets , 1992 .

[9]  Xizhao Wang,et al.  Building a Rule-Based Classifier—A Fuzzy-Rough Set Approach , 2010, IEEE Transactions on Knowledge and Data Engineering.

[10]  Nehad N. Morsi,et al.  Axiomatics for fuzzy rough sets , 1998, Fuzzy Sets Syst..

[11]  Christopher J. Merz,et al.  UCI Repository of Machine Learning Databases , 1996 .

[12]  Hong-Jie Xing,et al.  Two-stage dimensionality reduction approach based on 2DLDA and fuzzy rough sets technique , 2011, Neurocomputing.

[13]  Yiyu Yao Combination of Rough and Fuzzy Sets Based on α-Level Sets , 1997 .

[14]  Jesús Manuel Fernández Salido,et al.  Rough set analysis of a general type of fuzzy data using transitive aggregations of fuzzy similarity relations , 2003, Fuzzy Sets Syst..

[15]  Qinghua Hu,et al.  Information-preserving hybrid data reduction based on fuzzy-rough techniques , 2006, Pattern Recognit. Lett..

[16]  Qiang Shen,et al.  A Distance Measure Approach to Exploring the Rough Set Boundary Region for Attribute Reduction , 2010, IEEE Transactions on Knowledge and Data Engineering.

[17]  Manish Sarkar,et al.  Fuzzy-rough nearest neighbor algorithms in classification , 2007, Fuzzy Sets Syst..

[18]  Qinghua Hu,et al.  A Novel Algorithm for Finding Reducts With Fuzzy Rough Sets , 2012, IEEE Transactions on Fuzzy Systems.

[19]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[20]  Miroslav Ciric,et al.  Fuzzy equivalence relations and their equivalence classes , 2007, Fuzzy Sets Syst..

[21]  Aboul Ella Hassanien,et al.  Fuzzy rough sets hybrid scheme for breast cancer detection , 2007, Image Vis. Comput..

[22]  Qinghua Hu,et al.  Hybrid attribute reduction based on a novel fuzzy-rough model and information granulation , 2007, Pattern Recognit..

[23]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[24]  Qiang Shen,et al.  New Approaches to Fuzzy-Rough Feature Selection , 2009, IEEE Transactions on Fuzzy Systems.

[25]  Qinghua Hu,et al.  Soft fuzzy rough sets for robust feature evaluation and selection , 2010, Inf. Sci..

[26]  Rajen B. Bhatt,et al.  FRCT: fuzzy-rough classification trees , 2007, Pattern Analysis and Applications.

[27]  Qinghua Hu,et al.  Parameterized attribute reduction with Gaussian kernel based fuzzy rough sets , 2011, Inf. Sci..

[28]  Qiang Shen,et al.  Fuzzy-rough data reduction with ant colony optimization , 2005, Fuzzy Sets Syst..

[29]  D. Dubois,et al.  ROUGH FUZZY SETS AND FUZZY ROUGH SETS , 1990 .

[30]  Qiang Shen,et al.  Selecting informative features with fuzzy-rough sets and its application for complex systems monitoring , 2004, Pattern Recognit..

[31]  Wen-Xiu Zhang,et al.  An axiomatic characterization of a fuzzy generalization of rough sets , 2004, Inf. Sci..

[32]  Anna Maria Radzikowska,et al.  A comparative study of fuzzy rough sets , 2002, Fuzzy Sets Syst..

[33]  D. S. Yeung,et al.  Improving learning accuracy of fuzzy decision trees by hybrid neural networks , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[34]  Giangiacomo Gerla,et al.  On the concept of fuzzy point , 1986 .

[35]  Rajen B. Bhatt,et al.  On fuzzy-rough sets approach to feature selection , 2005, Pattern Recognit. Lett..

[36]  Xizhao Wang,et al.  Attributes Reduction Using Fuzzy Rough Sets , 2008, IEEE Transactions on Fuzzy Systems.

[37]  Wei-Zhi Wu,et al.  Constructive and axiomatic approaches of fuzzy approximation operators , 2004, Inf. Sci..

[38]  A. Bárdossy Note on fuzzy regression , 1990 .

[39]  L. Kuncheva Fuzzy rough sets: application to feature selection , 1992 .

[40]  Xizhao Wang,et al.  On the generalization of fuzzy rough sets , 2005, IEEE Transactions on Fuzzy Systems.

[41]  Jung-Hsien Chiang,et al.  Fuzzy Regression Analysis by Support Vector Learning Approach , 2008, IEEE Transactions on Fuzzy Systems.

[42]  Degang Chen,et al.  Local reduction of decision system with fuzzy rough sets , 2010, Fuzzy Sets Syst..

[43]  Xizhao Wang,et al.  A comparative study on heuristic algorithms for generating fuzzy decision trees , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[44]  Wang Xi-zhao Fuzzy Rough Set Based Soft Margin Support Vector Machines , 2011 .

[45]  Xi-Zhao Wang,et al.  Learning optimization in simplifying fuzzy rules , 1999, Fuzzy Sets Syst..

[46]  Chen Degang,et al.  Local reduction of decision system with fuzzy rough sets , 2010 .

[47]  Witold Pedrycz,et al.  Gaussian kernel based fuzzy rough sets: Model, uncertainty measures and applications , 2010, Int. J. Approx. Reason..

[48]  Jun-Hai Zhai,et al.  Fuzzy decision tree based on fuzzy-rough technique , 2011, Soft Comput..

[49]  Jun-Hai Zhai,et al.  Face recognition based on 2DPCA and fuzzy-rough technique , 2010, 2010 International Conference on Machine Learning and Cybernetics.

[50]  Qiang Shen,et al.  Fuzzy-rough sets for descriptive dimensionality reduction , 2002, 2002 IEEE World Congress on Computational Intelligence. 2002 IEEE International Conference on Fuzzy Systems. FUZZ-IEEE'02. Proceedings (Cat. No.02CH37291).

[51]  Yadong Wang,et al.  A new approach to fuzzy rule generation: fuzzy extension matrix , 2001, Fuzzy Sets Syst..