A proposed method for learning rule weights in fuzzy rule-based classification systems

In fuzzy rule-based classification systems (FRBCSs), rule weighting has often been used as a simple mechanism to tune the classifier. In past research, a number of heuristic rule weight specification methods have been proposed for this purpose. A learning algorithm based on reward and punishment has also been proposed to adjust the weights of each fuzzy rule in the rule-base. In this paper, a new method of learning rule weight in FRBCSs is proposed. The method can be used when single winner or weighted vote methods of reasoning is used. Compared with reward and punishment scheme, the proposed method is much faster and more effective. Another advantage of the proposed method is that, during the learning process, redundant rules are removed (i.e., by setting their weights to zero). The final rule-base usually contains much fewer rules than the initial one. This feature is very useful since a compact rule-base is usually desired from the point of efficiency and interpretability. A number of UCI data sets are used to assess the performance of the proposed method in comparison with reward and punishment scheme.

[1]  Rudolf Kruse,et al.  How the learning of rule weights affects the interpretability of fuzzy systems , 1998, 1998 IEEE International Conference on Fuzzy Systems Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36228).

[2]  Yi-Chung Hu,et al.  Elicitation of classification rules by fuzzy data mining , 2003 .

[3]  Antonio González Muñoz,et al.  SLAVE: a genetic learning system based on an iterative approach , 1999, IEEE Trans. Fuzzy Syst..

[4]  Eghbal G. Mansoori,et al.  A weighting function for improving fuzzy classification systems performance , 2007, Fuzzy Sets Syst..

[5]  Constantin V. Negoita,et al.  On Fuzzy Systems , 1978 .

[6]  Shigeo Abe,et al.  A fuzzy classifier with ellipsoidal regions , 1997, IEEE Trans. Fuzzy Syst..

[7]  María José del Jesús,et al.  Genetic feature selection in a fuzzy rule-based classification system learning process for high-dimensional problems , 2001, Inf. Sci..

[8]  Inés Couso,et al.  Combining GP operators with SA search to evolve fuzzy rule based classifiers , 2001, Inf. Sci..

[9]  Tom Fawcett,et al.  ROC Graphs: Notes and Practical Considerations for Researchers , 2007 .

[10]  Chris Cornelis,et al.  Elicitation of fuzzy association rules from positive and negative examples , 2005, Fuzzy Sets Syst..

[11]  Hisao Ishibuchi,et al.  Rule weight specification in fuzzy rule-based classification systems , 2005, IEEE Transactions on Fuzzy Systems.

[12]  Ramakrishnan Srikant,et al.  Fast Algorithms for Mining Association Rules in Large Databases , 1994, VLDB.

[13]  Hisao Ishibuchi,et al.  Three-objective genetics-based machine learning for linguistic rule extraction , 2001, Inf. Sci..

[14]  L. Kuncheva,et al.  Improving classification performance using fuzzy MLP and two-level selective partitioning of the feature space , 1995 .

[15]  Hisao Ishibuchi,et al.  Adaptive fuzzy rule-based classification systems , 1996, IEEE Trans. Fuzzy Syst..

[16]  Hisao Ishibuchi,et al.  Comparison of Heuristic Criteria for Fuzzy Rule Selection in Classification Problems , 2004, Fuzzy Optim. Decis. Mak..

[17]  F. Herrera,et al.  A proposal on reasoning methods in fuzzy rule-based classification systems , 1999 .

[18]  Hisao Ishibuchi,et al.  Fuzzy rule selection by multi-objective genetic local search algorithms and rule evaluation measures in data mining , 2004, Fuzzy Sets Syst..

[19]  Antonio F. Gómez-Skarmeta,et al.  Approximative fuzzy rules approaches for classification with hybrid-GA techniques , 2001, Inf. Sci..

[20]  Rudolf Kruse,et al.  A neuro-fuzzy method to learn fuzzy classification rules from data , 1997, Fuzzy Sets Syst..

[21]  Hisao Ishibuchi,et al.  Voting in fuzzy rule-based systems for pattern classification problems , 1999, Fuzzy Sets Syst..

[22]  Eghbal G. Mansoori,et al.  Weighting fuzzy classification rules using receiver operating characteristics (ROC) analysis , 2007, Inf. Sci..

[23]  Shigeo Abe,et al.  A neural-network-based fuzzy classifier , 1995, IEEE Trans. Syst. Man Cybern..

[24]  János Abonyi,et al.  Learning fuzzy classification rules from labeled data , 2003, Inf. Sci..

[25]  H. Ishibuchi,et al.  Distributed representation of fuzzy rules and its application to pattern classification , 1992 .

[26]  Rakesh Agarwal,et al.  Fast Algorithms for Mining Association Rules , 1994, VLDB 1994.

[27]  Shigeo Abe,et al.  A method for fuzzy rules extraction directly from numerical data and its application to pattern classification , 1995, IEEE Trans. Fuzzy Syst..

[28]  Peter A. Flach,et al.  Improving Accuracy and Cost of Two-class and Multi-class Probabilistic Classifiers Using ROC Curves , 2003, ICML.