Genetic tuning of fuzzy inference within fuzzy classifier systems

In generating a suitable fuzzy classifier system, significant effort is often placed on the determination and the fine tuning of the fuzzy sets. However, in such systems little thought is given to the way in which membership functions are combined within the fuzzy rules. Often traditional fuzzy inference strategies are used which consequently provide no control over how strongly or weakly the inference is applied within these rules. Furthermore such strategies will allow no interaction between grades of membership. A number of theoretical fuzzy inference operators have been proposed for both regression and classification problems but they have not been investigated in the context of real-world applications. In this paper we propose a novel genetic algorithm framework for optimizing the strength of fuzzy inference operators concurrently with the tuning of membership functions for a given fuzzy classifier system. Each fuzzy system is generated using two well-established decision tree algorithms: C4.5 and CHAID. This will enable both classification and regression problems to be addressed within the framework. Each solution generated by the genetic algorithm will produce a set of fuzzy membership functions and also determine how strongly the inference will be applied within each fuzzy rule. We investigate several theoretical proven fuzzy inference techniques (T-norms) in the context of both classification and regression problems. The methodology proposed is applied to a number of real-world data sets in order to determine the effects of the simultaneous tuning of membership functions and inference parameters on the accuracy and robustness of fuzzy classifiers.

[1]  Ebrahim H. Mamdani,et al.  An Experiment in Linguistic Synthesis with a Fuzzy Logic Controller , 1999, Int. J. Hum. Comput. Stud..

[2]  J. R. Quinlan Learning With Continuous Classes , 1992 .

[3]  Shrikanth S. Narayanan,et al.  Emotion recognition using a data-driven fuzzy inference system , 2003, INTERSPEECH.

[4]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[5]  W. Loh,et al.  LOTUS: An Algorithm for Building Accurate and Comprehensible Logistic Regression Trees , 2004 .

[6]  Didier Dubois,et al.  A class of fuzzy measures based on triangular norms , 1982 .

[7]  Ching-Chang Wong,et al.  Design of fuzzy classification system using genetic algorithms , 2000, Ninth IEEE International Conference on Fuzzy Systems. FUZZ- IEEE 2000 (Cat. No.00CH37063).

[8]  Hyunjoong Kim,et al.  Classification Trees With Bivariate Linear Discriminant Node Models , 2003 .

[9]  Ching-Chang Wong,et al.  DESIGN OF FUZZY SYSTEMS WITH FEWER RULES , 2003, Cybern. Syst..

[10]  Zong-Mu Yeh,et al.  A systematic approach for designing multistage fuzzy control systems , 2004, Fuzzy Sets Syst..

[11]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[12]  Keith John Worsley Significance testing in automatic interaction detection (A.I.D.) , 1978 .

[13]  R. Yager On a general class of fuzzy connectives , 1980 .

[14]  David E. Goldberg,et al.  Real-coded Genetic Algorithms, Virtual Alphabets, and Blocking , 1991, Complex Syst..

[15]  M. Fajfer,et al.  Fuzzy partitioning with FID3.1 , 1999, 18th International Conference of the North American Fuzzy Information Processing Society - NAFIPS (Cat. No.99TH8397).

[16]  W. Loh,et al.  SPLIT SELECTION METHODS FOR CLASSIFICATION TREES , 1997 .

[17]  G. V. Kass An Exploratory Technique for Investigating Large Quantities of Categorical Data , 1980 .

[18]  Derek A. Linkens,et al.  Rule-base self-generation and simplification for data-driven fuzzy models , 2001, 10th IEEE International Conference on Fuzzy Systems. (Cat. No.01CH37297).

[19]  C.Z. Janikow,et al.  FID4.1: an overview , 2004, IEEE Annual Meeting of the Fuzzy Information, 2004. Processing NAFIPS '04..

[20]  Didier Dubois,et al.  On the use of aggregation operations in information fusion processes , 2004, Fuzzy Sets Syst..

[21]  Jianjun Hu,et al.  Robust and Efficient Genetic Algorithms with Hierarchical Niching and a Sustainable Evolutionary Computation Model , 2004, GECCO.

[22]  Hisao Ishibuchi,et al.  Selecting fuzzy if-then rules for classification problems using genetic algorithms , 1995, IEEE Trans. Fuzzy Syst..

[23]  Juan Luis Castro,et al.  Using Ant Colony Optimization for Learning Maximal Structure Fuzzy Rules , 2005, The 14th IEEE International Conference on Fuzzy Systems, 2005. FUZZ '05..

[24]  J. Dombi A general class of fuzzy operators, the demorgan class of fuzzy operators and fuzziness measures induced by fuzzy operators , 1982 .

[25]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[26]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[27]  Louis Wehenkel,et al.  A complete fuzzy decision tree technique , 2003, Fuzzy Sets Syst..

[28]  Francisco Herrera,et al.  Applicability of the fuzzy operators in the design of fuzzy logic controllers , 1997, Fuzzy Sets Syst..

[29]  F. Azuaje Artificial Immune Systems: A New Computational Intelligence Approach , 2003 .

[30]  Z. Bandar,et al.  Combining multiple decision trees using fuzzy-neural inference , 2002, 2002 IEEE World Congress on Computational Intelligence. 2002 IEEE International Conference on Fuzzy Systems. FUZZ-IEEE'02. Proceedings (Cat. No.02CH37291).

[31]  A. Burak Göktepe,et al.  Comparison of Multilayer Perceptron and Adaptive Neuro-Fuzzy System on Backcalculating the Mechanical Properties of Flexible Pavements , 2004 .

[32]  Philip J. Stone,et al.  Experiments in induction , 1966 .

[33]  Francisco Herrera,et al.  Ten years of genetic fuzzy systems: current framework and new trends , 2004, Fuzzy Sets Syst..

[34]  Ronald R. Yager,et al.  Uncertainty representation using fuzzy measures , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[35]  Wu De-sheng Financial Analysis:A Comparison of Pattern-transformed BP Neural Networks and Pattern-transformed Adaptive Neuro-Fuzzy Inference System(ANFIS) , 2004 .

[36]  Ronald R. Yager,et al.  On a Class of Weak Triangular Norm Operators , 1997, Inf. Sci..

[37]  Cezary Z. Janikow,et al.  Fuzzy decision trees: issues and methods , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[38]  C. J. Kim,et al.  An algorithmic approach for fuzzy inference , 1997, IEEE Trans. Fuzzy Syst..

[39]  Zbigniew Michalewicz,et al.  Genetic algorithms + data structures = evolution programs (3rd ed.) , 1996 .

[40]  G. Hommel,et al.  Bonferroni procedures for logically related hypotheses , 1999 .

[41]  J. Morgan,et al.  Problems in the Analysis of Survey Data, and a Proposal , 1963 .

[42]  George J. Klir,et al.  Fuzzy sets, uncertainty and information , 1988 .

[43]  Keeley A. Crockett,et al.  Soft decision trees: a new approach using non-linear fuzzification , 2000, Ninth IEEE International Conference on Fuzzy Systems. FUZZ- IEEE 2000 (Cat. No.00CH37063).

[44]  Mariagrazia Dotoli,et al.  Fuzzy control experiments on DC drives using various inference connectives , 2002, 2002 IEEE World Congress on Computational Intelligence. 2002 IEEE International Conference on Fuzzy Systems. FUZZ-IEEE'02. Proceedings (Cat. No.02CH37291).

[45]  M. Gupta,et al.  Theory of T -norms and fuzzy inference methods , 1991 .

[46]  Ronald R. Yager,et al.  On t-norms based measures of specificity , 2003, Fuzzy Sets Syst..