A genetic design of linguistic terms for fuzzy rule based classifiers

The determination of fuzzy information granules including the estimation of their membership functions play a significant role in fuzzy system design as well as in the design of fuzzy rule based classifiers (FRBCSs). However, although linguistic terms are fundamental elements in the process of elucidating expert's knowledge, the problem of linguistic term design along with their fuzzy-set-based semantics has not been fully addressed, since term-sets of attributes have not been interpreted as a formalized structure. Thus, the essential relationship between linguistic terms, as syntax, and the constructed fuzzy sets, as their quantitative semantics, or in other words, the problem of the natural semantics of terms behind the linguistic literal has not been addressed. In this paper, we introduce the problem of the design of optimal linguistic terms and propose a method of the design of FRBCSs which may incorporate with the design of linguistic terms to ensure that the presence of linguistic literals are supported not only by data but also by their natural semantics. It is shown that this problem plays a primordial role in enhancing the performance and the interpretability of the designed FRBCSs and helps striking a better balance between the generality and the specificity of the desired fuzzy rule bases for fuzzy classification problems. A series of experiments concerning 17 Machine Learning datasets is reported.

[1]  Jesús Alcalá-Fdez,et al.  A Proposal for the Genetic Lateral Tuning of Linguistic Fuzzy Systems and Its Interaction With Rule Selection , 2007, IEEE Transactions on Fuzzy Systems.

[2]  María José del Jesús,et al.  Hierarchical fuzzy rule based classification systems with genetic rule selection for imbalanced data-sets , 2009, Int. J. Approx. Reason..

[3]  Anna Maria Fanelli,et al.  Interpretability assessment of fuzzy knowledge bases: A cointension based approach , 2011, Int. J. Approx. Reason..

[4]  Ajith Abraham,et al.  Engineering Evolutionary Intelligent Systems , 2008, Studies in Computational Intelligence.

[5]  S. M. Fakhrahmad,et al.  A New Rule-weight Learning Method based on Gradient Descent , 2009 .

[6]  María José del Jesús,et al.  On the 2-tuples based genetic tuning performance for fuzzy rule based classification systems in imbalanced data-sets , 2010, Inf. Sci..

[7]  Nguyen Cat Ho,et al.  Non-commercial Research and Educational Use including without Limitation Use in Instruction at Your Institution, Sending It to Specific Colleagues That You Know, and Providing a Copy to Your Institution's Administrator. All Other Uses, Reproduction and Distribution, including without Limitation Comm , 2022 .

[8]  N. C. Ho,et al.  Hedge algebras: an algebraic approach to structure of sets of linguistic truth values , 1990 .

[9]  María José del Jesús,et al.  An Analysis of the Rule Weights and Fuzzy Reasoning Methods for Linguistic Rule Based Classification Systems Applied to Problems with Highly Imbalanced Data Sets , 2007, WILF.

[10]  Jose Miguel Puerta,et al.  Learning weighted linguistic fuzzy rules by using specifically-tailored hybrid estimation of distribution algorithms , 2009, Int. J. Approx. Reason..

[11]  Van-Nam Huynh,et al.  Hedge Algebras, Linguistic-Valued Logic and Their Application to Fuzzy Reasoning , 1999, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[12]  Hisao Ishibuchi,et al.  Analysis of interpretability-accuracy tradeoff of fuzzy systems by multiobjective fuzzy genetics-based machine learning , 2007, Int. J. Approx. Reason..

[13]  Eghbal G. Mansoori,et al.  SGERD: A Steady-State Genetic Algorithm for Extracting Fuzzy Classification Rules From Data , 2008, IEEE Transactions on Fuzzy Systems.

[14]  Francisco Herrera,et al.  A Multi-Objective Genetic Algorithm for Tuning and Rule Selection to Obtain Accurate and Compact Linguistic Fuzzy Rule-Based Systems , 2007, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[15]  Hisao Ishibuchi,et al.  Fuzzy rule selection by multi-objective genetic local search algorithms and rule evaluation measures in data mining , 2004, Fuzzy Sets Syst..

[16]  Oscar Cordón,et al.  A new evolutionary algorithm combining simulated annealing and genetic programming for relevance feedback in fuzzy information retrieval systems , 2002, Soft Comput..

[17]  Hisao Ishibuchi,et al.  Rule weight specification in fuzzy rule-based classification systems , 2005, IEEE Transactions on Fuzzy Systems.

[18]  Hisao Ishibuchi,et al.  Three-objective genetics-based machine learning for linguistic rule extraction , 2001, Inf. Sci..

[19]  D. Adler,et al.  Genetic algorithms and simulated annealing: a marriage proposal , 1993, IEEE International Conference on Neural Networks.

[20]  Witold Pedrycz,et al.  Linguistic models and linguistic modeling , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[21]  Francisco Herrera,et al.  Generating the knowledge base of a fuzzy rule-based system by the genetic learning of the data base , 2001, IEEE Trans. Fuzzy Syst..

[22]  Sung-Kwun Oh,et al.  Evolutionary design of hybrid self-organizing fuzzy polynomial neural networks with the aid of information granulation , 2007, Expert Syst. Appl..

[23]  Hisao Ishibuchi,et al.  Parallel distributed genetic fuzzy rule selection , 2008, Soft Comput..

[24]  Eghbal G. Mansoori,et al.  A weighting function for improving fuzzy classification systems performance , 2007, Fuzzy Sets Syst..

[25]  Reda Alhajj,et al.  Utilizing Genetic Algorithms to Optimize Membership Functions for Fuzzy Weighted Association Rules Mining , 2006, Applied Intelligence.

[26]  Ajith Abraham,et al.  Engineering Evolutionary Intelligent Systems: Methodologies, Architectures and Reviews , 2008, Engineering Evolutionary Intelligent Systems.

[27]  Witold Pedrycz,et al.  Fuzzy equalization in the construction of fuzzy sets , 2001, Fuzzy Sets Syst..

[28]  Francisco Herrera,et al.  Generating single granularity-based fuzzy classification rules for multiobjective genetic fuzzy rule selection , 2009, 2009 IEEE International Conference on Fuzzy Systems.

[29]  Sung-Kwun Oh,et al.  Design Methodologies of Fuzzy Set-Based Fuzzy Model Based on GAs and Information Granulation , 2006, Australian Conference on Artificial Intelligence.

[30]  María José del Jesús,et al.  A study of the behaviour of linguistic fuzzy rule based classification systems in the framework of imbalanced data-sets , 2008, Fuzzy Sets Syst..

[31]  Beatrice Lazzerini,et al.  Learning concurrently partition granularities and rule bases of Mamdani fuzzy systems in a multi-objective evolutionary framework , 2009, Int. J. Approx. Reason..

[32]  Francisco Herrera,et al.  Rule Base Reduction and Genetic Tuning of Fuzzy Systems Based on the Linguistic 3-tuples Representation , 2006, Soft Comput..

[34]  Nguyen Cat Ho,et al.  A topological completion of refined hedge algebras and a model of fuzziness of linguistic terms and hedges , 2007, Fuzzy Sets Syst..

[35]  Francisco Herrera,et al.  A study of statistical techniques and performance measures for genetics-based machine learning: accuracy and interpretability , 2009, Soft Comput..

[36]  Hisao Ishibuchi,et al.  Effect of rule weights in fuzzy rule-based classification systems , 2000, Ninth IEEE International Conference on Fuzzy Systems. FUZZ- IEEE 2000 (Cat. No.00CH37063).

[37]  Francisco Herrera,et al.  A genetic tuning to improve the performance of Fuzzy Rule-Based Classification Systems with Interval-Valued Fuzzy Sets: Degree of ignorance and lateral position , 2011, Int. J. Approx. Reason..

[38]  Jesús Alcalá-Fdez,et al.  Genetic learning of accurate and compact fuzzy rule based systems based on the 2-tuples linguistic representation , 2007, Int. J. Approx. Reason..

[39]  Oscar Cordón,et al.  International Journal of Approximate Reasoning a Historical Review of Evolutionary Learning Methods for Mamdani-type Fuzzy Rule-based Systems: Designing Interpretable Genetic Fuzzy Systems , 2022 .

[40]  Beatrice Lazzerini,et al.  Learning concurrently data and rule bases of Mamdani fuzzy rule-based systems by exploiting a novel interpretability index , 2011, Soft Comput..

[41]  Witold Pedrycz,et al.  The design of fuzzy information granules: Tradeoffs between specificity and experimental evidence , 2009, Appl. Soft Comput..

[42]  Francisco Herrera,et al.  Multiobjective genetic fuzzy rule selection of single granularity-based fuzzy classification rules and its interaction with the lateral tuning of membership functions , 2011, Soft Comput..

[43]  Francisco Herrera,et al.  Interpretability of linguistic fuzzy rule-based systems: An overview of interpretability measures , 2011, Inf. Sci..