FURIA: an algorithm for unordered fuzzy rule induction

This paper introduces a novel fuzzy rule-based classification method called FURIA, which is short for Fuzzy Unordered Rule Induction Algorithm. FURIA extends the well-known RIPPER algorithm, a state-of-the-art rule learner, while preserving its advantages, such as simple and comprehensible rule sets. In addition, it includes a number of modifications and extensions. In particular, FURIA learns fuzzy rules instead of conventional rules and unordered rule sets instead of rule lists. Moreover, to deal with uncovered examples, it makes use of an efficient rule stretching method. Experimental results show that FURIA significantly outperforms the original RIPPER, as well as other classifiers such as C4.5, in terms of classification accuracy.

[1]  Eyke Hüllermeier,et al.  Fuzzy sets in machine learning and data mining , 2011, Appl. Soft Comput..

[2]  Johannes Fürnkranz,et al.  Incremental Reduced Error Pruning , 1994, ICML.

[3]  Chia-Feng Juang,et al.  A Self-Organizing TS-Type Fuzzy Network With Support Vector Learning and its Application to Classification Problems , 2007, IEEE Transactions on Fuzzy Systems.

[4]  Mathieu Serrurier,et al.  Introducing possibilistic logic in ILP for dealing with exceptions , 2007, Artif. Intell..

[5]  Hisao Ishibuchi,et al.  Performance evaluation of three-objective genetic rule selection , 2003, The 12th IEEE International Conference on Fuzzy Systems, 2003. FUZZ '03..

[6]  Jacobus van Zyl,et al.  Fuzzy rule induction in a set covering framework , 2006, IEEE Transactions on Fuzzy Systems.

[7]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[8]  María José del Jesús,et al.  Induction of fuzzy-rule-based classifiers with evolutionary boosting algorithms , 2004, IEEE Transactions on Fuzzy Systems.

[9]  Hisao Ishibuchi,et al.  Rule weight specification in fuzzy rule-based classification systems , 2005, IEEE Transactions on Fuzzy Systems.

[10]  R. Mike Cameron-Jones,et al.  FOIL: A Midterm Report , 1993, ECML.

[11]  Hisao Ishibuchi,et al.  Effect of rule weights in fuzzy rule-based classification systems , 2000, Ninth IEEE International Conference on Fuzzy Systems. FUZZ- IEEE 2000 (Cat. No.00CH37063).

[12]  Pedro M. Domingos Rule Induction and Instance-Based Learning: A Unified Approach , 1995, IJCAI.

[13]  Serge Guillaume,et al.  Designing fuzzy inference systems from data: An interpretability-oriented review , 2001, IEEE Trans. Fuzzy Syst..

[14]  W. Press,et al.  Numerical Recipes in Fortran: The Art of Scientific Computing.@@@Numerical Recipes in C: The Art of Scientific Computing. , 1994 .

[15]  Michael J. Pazzani,et al.  HYDRA: A Noise-tolerant Relational Concept Learning Algorithm , 1993, IJCAI.

[16]  金田 重郎,et al.  C4.5: Programs for Machine Learning (書評) , 1995 .

[17]  Henrik Boström,et al.  Classifying Uncovered Examples by Rule Stretching , 2001, ILP.

[18]  William W. Cohen Fast Effective Rule Induction , 1995, ICML.

[19]  Gilles Richard,et al.  Enriching Relational Learning with Fuzzy Predicates , 2003, PKDD.

[20]  M. Friedman The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of Variance , 1937 .

[21]  Zhoujun Li,et al.  A Survey of Fuzzy Decision Tree Classifier Methodology , 2007, ICFIE.

[22]  David W. Aha,et al.  Instance-Based Learning Algorithms , 1991, Machine Learning.

[23]  Zheru Chi,et al.  Handwritten numeral recognition using self-organizing maps and fuzzy rules , 1995, Pattern Recognit..

[24]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[25]  David A. Landgrebe,et al.  A survey of decision tree classifier methodology , 1991, IEEE Trans. Syst. Man Cybern..

[26]  Eghbal G. Mansoori,et al.  Weighting fuzzy classification rules using receiver operating characteristics (ROC) analysis , 2007, Inf. Sci..

[27]  María José del Jesús,et al.  An Analysis of the Rule Weights and Fuzzy Reasoning Methods for Linguistic Rule Based Classification Systems Applied to Problems with Highly Imbalanced Data Sets , 2007, WILF.

[28]  JOHANNES FÜRNKRANZ,et al.  Separate-and-Conquer Rule Learning , 1999, Artificial Intelligence Review.

[29]  William H. Press,et al.  Book-Review - Numerical Recipes in Pascal - the Art of Scientific Computing , 1989 .

[30]  Alan Bundy,et al.  Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence - IJCAI-95 , 1995 .

[31]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..

[32]  D. Newman,et al.  THE DISTRIBUTION OF RANGE IN SAMPLES FROM A NORMAL POPULATION, EXPRESSED IN TERMS OF AN INDEPENDENT ESTIMATE OF STANDARD DEVIATION , 1939 .

[33]  R. E. Lee,et al.  Distribution-free multiple comparisons between successive treatments , 1995 .

[34]  Ulrich Bodenhofer,et al.  FS-FOIL: an inductive learning method for extracting interpretable fuzzy descriptions , 2003, Int. J. Approx. Reason..

[35]  Henrik Boström Pruning and Exclusion Criteria for Unordered Incremental Reduced Error Pruning , 2004 .

[36]  Antonio González Muñoz,et al.  SLAVE: a genetic learning system based on an iterative approach , 1999, IEEE Trans. Fuzzy Syst..

[37]  Sushmita Mitra,et al.  Neuro-fuzzy rule generation: survey in soft computing framework , 2000, IEEE Trans. Neural Networks Learn. Syst..

[38]  Hong Yan,et al.  Fuzzy Algorithms: With Applications to Image Processing and Pattern Recognition , 1996, Advances in Fuzzy Systems - Applications and Theory.

[39]  Eyke Hüllermeier,et al.  FR3: A Fuzzy Rule Learner for Inducing Reliable Classifiers , 2009, IEEE Transactions on Fuzzy Systems.

[40]  Eyke Hüllermeier,et al.  Fuzzy methods in machine learning and data mining: Status and prospects , 2005, Fuzzy Sets Syst..

[41]  R. Iman,et al.  Approximations of the critical region of the fbietkan statistic , 1980 .

[42]  Tom Fawcett PRIE: a system for generating rulelists to maximize ROC performance , 2008, Data Mining and Knowledge Discovery.

[43]  J. R. Quinlan Learning Logical Definitions from Relations , 1990 .

[44]  M. Friedman A Comparison of Alternative Tests of Significance for the Problem of $m$ Rankings , 1940 .

[45]  Iris Hendrickx,et al.  Hybrid Algorithms with Instance-Based Classification , 2005, ECML.

[46]  Antonio González Muñoz,et al.  Table Ii Tc Pattern Recognition Result for 120 Eir Satellite Image Cases Selection of Relevant Features in a Fuzzy Genetic Learning Algorithm , 2001 .

[47]  Francisco Herrera,et al.  Ten years of genetic fuzzy systems: current framework and new trends , 2004, Fuzzy Sets Syst..

[48]  Detlef Nauck,et al.  Foundations Of Neuro-Fuzzy Systems , 1997 .

[49]  María José del Jesús,et al.  KEEL: a software tool to assess evolutionary algorithms for data mining problems , 2008, Soft Comput..

[50]  Lotfi A. Zadeh,et al.  Fuzzy Algorithms , 1968, Inf. Control..