Fuzzy rule weight modification with particle swarm optimisation

The most challenging problem in developing fuzzy rule-based classification systems is the construction of a fuzzy rule base for the target problem. In many practical applications, fuzzy sets that are of particular linguistic meanings, are often predefined by domain experts and required to be maintained in order to ensure interpretability of any subsequent inference results. However, learning fuzzy rules using fixed fuzzy quantity space without any qualification will restrict the accuracy of the resulting rules. Fortunately, adjusting the weights of fuzzy rules can help improve classification accuracy without degrading the interpretability. There have been different proposals for fuzzy rule weight tuning through the use of various heuristics with limited success. This paper proposes an alternative approach using Particle Swarm Optimisation in the search of a set of optimal rule weights, entailing high classification accuracy. Systematic experimental studies are carried out using common benchmark data sets, in comparison to popular rule based learning classifiers. The results demonstrate that the proposed approach can boost classification performance, especially when the size of the initially built rule base is relatively small, and is competitive to popular rule-based learning classifiers.

[1]  Ian H. Witten,et al.  Weka: Practical machine learning tools and techniques with Java implementations , 1999 .

[2]  Khairul A. Rasmani,et al.  Weighted linguistic modelling based on fuzzy subsethood values , 2003, The 12th IEEE International Conference on Fuzzy Systems, 2003. FUZZ '03..

[3]  Rudolf Kruse,et al.  How the learning of rule weights affects the interpretability of fuzzy systems , 1998, 1998 IEEE International Conference on Fuzzy Systems Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36228).

[4]  Chris Cornelis,et al.  Hybrid fuzzy-rough rule induction and feature selection , 2009, 2009 IEEE International Conference on Fuzzy Systems.

[5]  Yufei Yuan,et al.  A genetic algorithm for generating fuzzy classification rules , 1996, Fuzzy Sets Syst..

[6]  Simon C. K. Shiu,et al.  An auto-adaptive convex map generating path-finding algorithm: Genetic Convex A* , 2013, Int. J. Mach. Learn. Cybern..

[7]  Eyke Hüllermeier,et al.  Top-Down Induction of Fuzzy Pattern Trees , 2011, IEEE Transactions on Fuzzy Systems.

[8]  Hisao Ishibuchi,et al.  Voting in fuzzy rule-based systems for pattern classification problems , 1999, Fuzzy Sets Syst..

[9]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..

[10]  Hideo Tanaka,et al.  Construction of fuzzy classification systems with rectangular fuzzy rules using genetic algorithms , 1994, CVPR 1994.

[11]  A. Rezaee Jordehi,et al.  Parameter selection in particle swarm optimisation: a survey , 2013, J. Exp. Theor. Artif. Intell..

[12]  Eghbal G. Mansoori,et al.  A weighting function for improving fuzzy classification systems performance , 2007, Fuzzy Sets Syst..

[13]  H. Ishibuchi,et al.  Distributed representation of fuzzy rules and its application to pattern classification , 1992 .

[14]  Qiang Shen,et al.  A rough-fuzzy approach for generating classification rules , 2002, Pattern Recognit..

[15]  Francisco Herrera,et al.  A three-stage evolutionary process for learning descriptive and approximate fuzzy-logic-controller knowledge bases from examples , 1997, Int. J. Approx. Reason..

[16]  Qiang Shen,et al.  Feature Selection With Harmony Search , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[17]  Hisao Ishibuchi,et al.  Effect of rule weights in fuzzy rule-based classification systems , 2001, IEEE Trans. Fuzzy Syst..

[18]  Sushmita Mitra,et al.  Neuro-fuzzy rule generation: survey in soft computing framework , 2000, IEEE Trans. Neural Networks Learn. Syst..

[19]  Hisao Ishibuchi,et al.  Single-objective and two-objective genetic algorithms for selecting linguistic rules for pattern classification problems , 1997, Fuzzy Sets Syst..

[20]  Qiang Shen,et al.  From approximative to descriptive fuzzy classifiers , 2002, IEEE Trans. Fuzzy Syst..

[21]  Qiang Shen,et al.  A harmony search based approach to hybrid fuzzy-rough rule induction , 2012, 2012 IEEE International Conference on Fuzzy Systems.

[22]  Michelle Galea,et al.  Simultaneous Ant Colony Optimization Algorithms for Learning Linguistic Fuzzy Rules , 2006, Swarm Intelligence in Data Mining.

[23]  Moshe Sipper,et al.  A fuzzy-genetic approach to breast cancer diagnosis , 1999, Artif. Intell. Medicine.

[24]  F. Herrera,et al.  A proposal on reasoning methods in fuzzy rule-based classification systems , 1999 .

[25]  Imtiaz Ahmad,et al.  Particle swarm optimization for task assignment problem , 2002, Microprocess. Microsystems.

[26]  Daniel Sánchez,et al.  Fuzzy association rules: general model and applications , 2003, IEEE Trans. Fuzzy Syst..

[27]  Hisao Ishibuchi,et al.  Performance evaluation of fuzzy classifier systems for multidimensional pattern classification problems , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[28]  Eghbal G. Mansoori,et al.  Weighting fuzzy classification rules using receiver operating characteristics (ROC) analysis , 2007, Inf. Sci..

[29]  Manoj Kumar Tiwari,et al.  Multiobjective Particle Swarm Algorithm With Fuzzy Clustering for Electrical Power Dispatch , 2008, IEEE Transactions on Evolutionary Computation.

[30]  Tamás D. Gedeon,et al.  Pattern Trees Induction: A New Machine Learning Method , 2008, IEEE Transactions on Fuzzy Systems.

[31]  Hisao Ishibuchi,et al.  Rule weight specification in fuzzy rule-based classification systems , 2005, IEEE Transactions on Fuzzy Systems.

[32]  Khairul A. Rasmani,et al.  Linguistic rulesets extracted from a quantifier-based fuzzy classification system , 2009, 2009 IEEE International Conference on Fuzzy Systems.

[33]  Mansoor Zolghadri Jahromi,et al.  A proposed method for learning rule weights in fuzzy rule-based classification systems , 2008, Fuzzy Sets Syst..

[34]  Russell C. Eberhart,et al.  Implementation of evolutionary fuzzy systems , 1999, IEEE Trans. Fuzzy Syst..

[35]  Hisao Ishibuchi,et al.  Adaptive fuzzy rule-based classification systems , 1996, IEEE Trans. Fuzzy Syst..