Cooperative fuzzy rulebase construction based on a novel fuzzy decision tree

Fuzzy Inference Systems (FIS) are much considerable due to their interpretability and uncertainty factors. Hence, Fuzzy Rule-Based Classifier Systems (FRBCS) are widely investigated in aspects of construction and parameter learning. Also, decision trees are recursive structures which are not only simple and accurate, but also are fast in classification due to partitioning the feature space in a multi-stage process. Combination of fuzzy reasoning and decision trees gathers capabilities of both systems in an integrated one. In this paper, a novel fuzzy decision tree (FDT) is proposed for extracting fuzzy rules which are both accurate and cooperative due to dependency structure of decision tree. Furthermore, a weighting method is used to emphasize the corporation of the rules. Finally, the proposed method is compared with a well-known rule construction method named SRC on 8 UCI datasets. Experiments show a significant improvement on classification performance of the proposed method in comparison with SRC.

[1]  David A. Landgrebe,et al.  A survey of decision tree classifier methodology , 1991, IEEE Trans. Syst. Man Cybern..

[2]  Tao Wang,et al.  A survey of fuzzy decision tree classifier , 2009 .

[3]  OlaruCristina,et al.  A complete fuzzy decision tree technique , 2003 .

[4]  Lior Rokach,et al.  Top-down induction of decision trees classifiers - a survey , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[5]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[6]  Hisao Ishibuchi,et al.  Rule weight specification in fuzzy rule-based classification systems , 2005, IEEE Transactions on Fuzzy Systems.

[7]  Hisao Ishibuchi,et al.  Three-objective genetics-based machine learning for linguistic rule extraction , 2001, Inf. Sci..

[8]  Cezary Z. Janikow,et al.  Fuzzy decision trees: issues and methods , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[9]  Hisao Ishibuchi,et al.  Effect of rule weights in fuzzy rule-based classification systems , 2000, Ninth IEEE International Conference on Fuzzy Systems. FUZZ- IEEE 2000 (Cat. No.00CH37063).

[10]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[11]  Mansoor Zolghadri Jahromi,et al.  A proposed method for learning rule weights in fuzzy rule-based classification systems , 2008, Fuzzy Sets Syst..

[12]  Hisao Ishibuchi,et al.  Fuzzy rule selection by multi-objective genetic local search algorithms and rule evaluation measures in data mining , 2004, Fuzzy Sets Syst..

[13]  Hisao Ishibuchi,et al.  Voting in fuzzy rule-based systems for pattern classification problems , 1999, Fuzzy Sets Syst..

[14]  Louis Wehenkel,et al.  A complete fuzzy decision tree technique , 2003, Fuzzy Sets Syst..

[15]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[16]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[17]  Eghbal G. Mansoori,et al.  Weighting fuzzy classification rules using receiver operating characteristics (ROC) analysis , 2007, Inf. Sci..

[18]  Aiko M. Hormann,et al.  Programs for Machine Learning. Part I , 1962, Inf. Control..

[19]  A. Floren,et al.  ' " ' " ' " . " ' " " " " " ' " ' " " " " " : ' " 1 , 2001 .

[20]  J. Ross Quinlan,et al.  Learning decision tree classifiers , 1996, CSUR.

[21]  Hisao Ishibuchi,et al.  Analysis of interpretability-accuracy tradeoff of fuzzy systems by multiobjective fuzzy genetics-based machine learning , 2007, Int. J. Approx. Reason..