A reinforcement learning algorithm for adjusting antecedent parameters and weights of fuzzy rules in a fuzzy classifier

This paper proposes a new fuzzy classifier based on reinforcement learning. A fuzzy rule based classification system is a special type of fuzzy modeling where its output is a discrete crisp value. The main challenging issue in designing fuzzy classifiers is constructing fuzzy rule base. Here, each fuzzy rule is considered as an agent who has to select the suitable class between candidate classes. It is considered a weight for each candidate class in each rule. These weights are adjusted using the proposed reinforcement learning algorithm. For each sample of training data, if the final result is true, the winner rule (agent) is rewarded and some other rules are punished based on the criteria which are defined in this paper. If the result is false, the winner rule is punished and the rules with high firing strength that have selected correct class are rewarded. Moreover, the input membership functions of rules are adjusted regarding the defined criteria which depend on punishment frequency of rules. The proposed approach is assessed on some UCI datasets. We compare our ideas in comparison with conventional reward and punishment scheme and multi-layer perceptron network. The experimental results show that our proposed approach outperforms both mentioned approaches in the terms of quality of classification and precision.

[1]  Rudolf Kruse,et al.  A neuro-fuzzy method to learn fuzzy classification rules from data , 1997, Fuzzy Sets Syst..

[2]  Shigeo Abe,et al.  A fuzzy classifier with ellipsoidal regions , 1997, IEEE Trans. Fuzzy Syst..

[3]  Patrick Gallinari,et al.  Sequential approaches for learning datum-wise sparse representations , 2012, Machine Learning.

[4]  Chris Cornelis,et al.  Elicitation of fuzzy association rules from positive and negative examples , 2005, Fuzzy Sets Syst..

[5]  Yunis Torun,et al.  Designing simulated annealing and subtractive clustering based fuzzy classifier , 2011, Appl. Soft Comput..

[6]  Hisao Ishibuchi,et al.  Adaptive fuzzy rule-based classification systems , 1996, IEEE Trans. Fuzzy Syst..

[7]  Francisco Herrera,et al.  A genetic tuning to improve the performance of Fuzzy Rule-Based Classification Systems with Interval-Valued Fuzzy Sets: Degree of ignorance and lateral position , 2011, Int. J. Approx. Reason..

[8]  Eleonora D'Andrea,et al.  A hierarchical approach to multi-class fuzzy classifiers , 2013, Expert Syst. Appl..

[9]  Sushmita Mitra,et al.  Neuro-fuzzy rule generation: survey in soft computing framework , 2000, IEEE Trans. Neural Networks Learn. Syst..

[10]  Mansoor Zolghadri Jahromi,et al.  A proposed method for learning rule weights in fuzzy rule-based classification systems , 2008, Fuzzy Sets Syst..

[11]  Seok-Beom Roh,et al.  A design of granular fuzzy classifier , 2014, Expert Syst. Appl..

[12]  Dan Xia,et al.  Learning classifier system with average reward reinforcement learning , 2013, Knowl. Based Syst..

[13]  Hisao Ishibuchi,et al.  Fuzzy rule selection by multi-objective genetic local search algorithms and rule evaluation measures in data mining , 2004, Fuzzy Sets Syst..

[14]  Antonio F. Gómez-Skarmeta,et al.  Approximative fuzzy rules approaches for classification with hybrid-GA techniques , 2001, Inf. Sci..

[15]  Hisao Ishibuchi,et al.  Voting in fuzzy rule-based systems for pattern classification problems , 1999, Fuzzy Sets Syst..

[16]  H. Ishibuchi,et al.  Distributed representation of fuzzy rules and its application to pattern classification , 1992 .

[17]  Min Han,et al.  An improved fuzzy neural network based on T-S model , 2008, Expert Syst. Appl..

[18]  Vali Derhami,et al.  Applying reinforcement learning for web pages ranking algorithms , 2013, Appl. Soft Comput..