A wrapper methodology to learn interval-valued fuzzy rule-based classification systems

Abstract Learning an interval-valued fuzzy rule-based classification system is a challenge as its success directly depends on the interval-valued fuzzy partition used. In fact, the learning of an interval-valued fuzzy system usually starts by creating a partition composed of numerical fuzzy sets, which are used to build an initial fuzzy classifier. Then, it is augmented with interval-valued fuzzy sets whose shape is subsequently optimized to improve the system’s performance. However, as in this methodology the fuzzy rules are learned using numerical fuzzy sets, the benefits of the interval-valued fuzzy sets may not be fully exploited. In this paper we define a new learning methodology that avoids building the initial fuzzy classifier but directly learns interval-valued fuzzy rules. To do so, we define a wrapper methodology to learn the interval-valued fuzzy partitions such that they lead to an interval-valued fuzzy rule-based classification system as accurate as possible. Moreover, our new method allows one to represent each membership function using the most proper type of fuzzy set for the sake of modeling the uncertainty in the best possible manner. Consequently, the antecedents of the rules can be formed of only numerical fuzzy sets, only interval-valued fuzzy sets or a mixture of both. The quality of the proposal is compared versus four state-of-the-art fuzzy classifiers like FARC-HD, IVTURS, FURIA and FARC-HD using an inference based on a generalization of the Choquet integral. We also compare our new approach besides its numerical fuzzy counterpart to clearly show the benefits of the usage of interval-valued fuzzy sets. Specifically, the average accuracy rate of our new method is 81.17%, which is at least 0.66% better than the remainder state-of-the-art fuzzy classifiers.

[1]  Jerry M. Mendel,et al.  General Type-2 Fuzzy Logic Systems Made Simple: A Tutorial , 2014, IEEE Transactions on Fuzzy Systems.

[2]  Gleb Beliakov,et al.  Aggregation Functions: A Guide for Practitioners , 2007, Studies in Fuzziness and Soft Computing.

[3]  Jerry M. Mendel,et al.  Advances in type-2 fuzzy sets and systems , 2007, Inf. Sci..

[4]  J. L. Hodges,et al.  Rank Methods for Combination of Independent Experiments in Analysis of Variance , 1962 .

[5]  Francisco Herrera,et al.  A taxonomy for the crossover operator for real‐coded genetic algorithms: An experimental study , 2003, Int. J. Intell. Syst..

[6]  Tim Miller,et al.  Explanation in Artificial Intelligence: Insights from the Social Sciences , 2017, Artif. Intell..

[7]  Glad Deschrijver,et al.  Generalized arithmetic operators and their relationship to t-norms in interval-valued fuzzy set theory , 2009, Fuzzy Sets Syst..

[8]  Chih-Min Lin,et al.  Self-Evolving Interval Type-2 Wavelet Cerebellar Model Articulation Control Design for Uncertain Nonlinear Systems Using PSO , 2019, International Journal of Fuzzy Systems.

[9]  Keun-Chang Kwak A Design of Incremental Granular Model Using Context-Based Interval Type-2 Fuzzy C-Means Clustering Algorithm , 2016, IEICE Trans. Inf. Syst..

[10]  Tianyu Zhao,et al.  Remote sensing image classification based on semi-supervised adaptive interval type-2 fuzzy c-means algorithm , 2019, Comput. Geosci..

[11]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[12]  Carlos Lopez-Molina,et al.  Interval-Valued Restricted Equivalence Functions Applied on Clustering Techniques , 2009, IFSA/EUSFLAT Conf..

[13]  R. Agarwal Fast Algorithms for Mining Association Rules , 1994, VLDB 1994.

[14]  Hisao Ishibuchi,et al.  Classification and modeling with linguistic information granules - advanced approaches to linguistic data mining , 2004, Advanced information processing.

[15]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[16]  Jesús Alcalá-Fdez,et al.  KEEL Data-Mining Software Tool: Data Set Repository, Integration of Algorithms and Experimental Analysis Framework , 2011, J. Multiple Valued Log. Soft Comput..

[17]  J. Casillas Interpretability issues in fuzzy modeling , 2003 .

[18]  Oscar Castillo,et al.  A review on type-2 fuzzy logic applications in clustering, classification and pattern recognition , 2014, Appl. Soft Comput..

[19]  F. Herrera,et al.  A proposal on reasoning methods in fuzzy rule-based classification systems , 1999 .

[20]  Eyke Hüllermeier,et al.  FURIA: an algorithm for unordered fuzzy rule induction , 2009, Data Mining and Knowledge Discovery.

[21]  Chris Cornelis,et al.  On the representation of intuitionistic fuzzy t-norms and t-conorms , 2004, IEEE Transactions on Fuzzy Systems.

[22]  David J. Sheskin,et al.  Handbook of Parametric and Nonparametric Statistical Procedures , 1997 .

[23]  Tzyy-Chyang Lu,et al.  Genetic-algorithm-based type reduction algorithm for interval type-2 fuzzy logic controllers , 2015, Eng. Appl. Artif. Intell..

[24]  Pietro Ducange,et al.  A Distributed Fuzzy Associative Classifier for Big Data , 2018, IEEE Transactions on Cybernetics.

[25]  Francisco Herrera,et al.  IVTURS: A Linguistic Fuzzy Rule-Based Classification System Based On a New Interval-Valued Fuzzy Reasoning Method With Tuning and Rule Selection , 2013, IEEE Transactions on Fuzzy Systems.

[26]  Francisco Herrera,et al.  A Compact Evolutionary Interval-Valued Fuzzy Rule-Based Classification System for the Modeling and Prediction of Real-World Financial Applications With Imbalanced Data , 2015, IEEE Transactions on Fuzzy Systems.

[27]  Krassimir T. Atanassov,et al.  Genetic Algorithms Quality Assessment Implementing Intuitionistic Fuzzy Logic , 2014 .

[28]  Francisco Herrera,et al.  A Historical Account of Types of Fuzzy Sets and Their Relationships , 2016, IEEE Transactions on Fuzzy Systems.

[29]  Tzu-Tsung Wong,et al.  Reliable Accuracy Estimates from k-Fold Cross Validation , 2020, IEEE Transactions on Knowledge and Data Engineering.

[30]  Hisao Ishibuchi,et al.  Effect of rule weights in fuzzy rule-based classification systems , 2001, IEEE Trans. Fuzzy Syst..

[31]  Tin Kam Ho,et al.  Complexity Measures of Supervised Classification Problems , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Humberto Bustince,et al.  Improving the Performance of Fuzzy Rule-Based Classification Systems Based on a Nonaveraging Generalization of CC-Integrals Named $C_{F_1F_2}$-Integrals , 2019, IEEE Transactions on Fuzzy Systems.

[33]  Rui Guo,et al.  Hierarchical interval type-2 fuzzy path planning based on genetic optimization , 2020, J. Intell. Fuzzy Syst..

[34]  Ildar Z. Batyrshin,et al.  A Feasible Genetic Optimization Strategy for Parametric Interval Type-2 Fuzzy Logic Systems , 2018, Int. J. Fuzzy Syst..

[35]  S. Holm A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[36]  Francisco Herrera,et al.  Rule Base Reduction and Genetic Tuning of Fuzzy Systems Based on the Linguistic 3-tuples Representation , 2006, Soft Comput..

[37]  Francisco Herrera,et al.  Improving the performance of fuzzy rule-based classification systems with interval-valued fuzzy sets and genetic amplitude tuning , 2010, Inf. Sci..

[38]  Oscar Castillo,et al.  A review on interval type-2 fuzzy logic applications in intelligent control , 2014, Inf. Sci..

[39]  Francisco Herrera,et al.  Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: Experimental analysis of power , 2010, Inf. Sci..

[40]  Branko Kavsek,et al.  APRIORI-SD: ADAPTING ASSOCIATION RULE LEARNING TO SUBGROUP DISCOVERY , 2006 .

[41]  Oscar Castillo,et al.  Comparative Study of Type-2 Fuzzy Particle Swarm, Bee Colony and Bat Algorithms in Optimization of Fuzzy Controllers , 2017, Algorithms.

[42]  Robert John,et al.  Interval Type-2 A-Intuitionistic Fuzzy Logic for Regression Problems , 2018, IEEE Transactions on Fuzzy Systems.

[43]  Patricia Melin,et al.  Optimal Genetic Design of Type-1 and Interval Type-2 Fuzzy Systems for Blood Pressure Level Classification , 2019, Axioms.

[44]  Chandra Prakash Gupta,et al.  Design and implementation of interval type-2 fuzzy logic-PI based adaptive controller for DFIG based wind energy system , 2020 .

[45]  Zeshui Xu,et al.  Some geometric aggregation operators based on intuitionistic fuzzy sets , 2006, Int. J. Gen. Syst..

[46]  Humberto Bustince,et al.  Generation of linear orders for intervals by means of aggregation functions , 2013, Fuzzy Sets Syst..

[47]  Dongrui Wu,et al.  Recommendations on Designing Practical Interval Type-2 Fuzzy Systems , 2019, Eng. Appl. Artif. Intell..

[48]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[49]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[50]  Humberto Bustince,et al.  CF-integrals: A new family of pre-aggregation functions with application to fuzzy rule-based classification systems , 2018, Inf. Sci..

[51]  Francisco Herrera,et al.  An automatic extraction method of the domains of competence for learning classifiers using data complexity measures , 2013, Knowledge and Information Systems.

[52]  Jesús Alcalá-Fdez,et al.  A Proposal for the Genetic Lateral Tuning of Linguistic Fuzzy Systems and Its Interaction With Rule Selection , 2007, IEEE Transactions on Fuzzy Systems.

[53]  Krassimir T. Atanassov,et al.  Interval Valued Intuitionistic Fuzzy Evaluations for Analysis of a Student’s Knowledge in University e-Learning Courses , 2018, INTERNATIONAL JOURNAL of FUZZY LOGIC and INTELLIGENT SYSTEMS.

[55]  Chuanchao Zhang,et al.  Classification Rule Mining Algorithm Combining Intuitionistic Fuzzy Rough Sets and Genetic Algorithm , 2020, Int. J. Fuzzy Syst..

[56]  Jesús Alcalá-Fdez,et al.  A Fuzzy Association Rule-Based Classification Model for High-Dimensional Problems With Genetic Rule Selection and Lateral Tuning , 2011, IEEE Transactions on Fuzzy Systems.

[57]  Hani Hagras,et al.  Multiobjective Evolutionary Optimization of Type-2 Fuzzy Rule-Based Systems for Financial Data Classification , 2017, IEEE Transactions on Fuzzy Systems.

[58]  Humberto Bustince,et al.  A New Approach to Interval-Valued Choquet Integrals and the Problem of Ordering in Interval-Valued Fuzzy Set Applications , 2013, IEEE Transactions on Fuzzy Systems.

[59]  S. García,et al.  An Extension on "Statistical Comparisons of Classifiers over Multiple Data Sets" for all Pairwise Comparisons , 2008 .

[60]  Francisco Herrera,et al.  A genetic tuning to improve the performance of Fuzzy Rule-Based Classification Systems with Interval-Valued Fuzzy Sets: Degree of ignorance and lateral position , 2011, Int. J. Approx. Reason..

[61]  Hisao Ishibuchi,et al.  Rule weight specification in fuzzy rule-based classification systems , 2005, IEEE Transactions on Fuzzy Systems.

[62]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[63]  F. Herrera,et al.  IIVFDT: ignorance functions based interval-valued fuzzy decision tree with genetic tuning , 2012 .