Fuzzy decision trees: issues and methods

Decision trees are one of the most popular choices for learning and reasoning from feature-based examples. They have undergone a number of alterations to deal with language and measurement uncertainties. We present another modification, aimed at combining symbolic decision trees with approximate reasoning offered by fuzzy representation. The intent is to exploit complementary advantages of both: popularity in applications to learning from examples, high knowledge comprehensibility of decision trees, and the ability to deal with inexact and uncertain information of fuzzy representation. The merger utilizes existing methodologies in both areas to full advantage, but is by no means trivial. In particular, knowledge inferences must be newly defined for the fuzzy tree. We propose a number of alternatives, based on rule-based systems and fuzzy control. We also explore capabilities that the new framework provides. The resulting learning method is most suitable for stationary problems, with both numerical and symbolic features, when the goal is both high knowledge comprehensibility and gradually changing output. We describe the methodology and provide simple illustrations.

[1]  P.E. Maher,et al.  Uncertain reasoning in an ID3 machine learning framework , 1993, [Proceedings 1993] Second IEEE International Conference on Fuzzy Systems.

[2]  R. Jager,et al.  Fuzzy Logic in Control , 1995 .

[3]  J. R. Quinlan.  DECISION TREES AS PROBABILISTIC CLASSIFIERS , 1987 .

[4]  Lotfi A. Zadeh,et al.  A Theory of Approximate Reasoning , 1979 .

[5]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..

[6]  Gerard V. Conroy,et al.  Principles of induction and approaches to attribute based induction , 1991, The Knowledge Engineering Review.

[7]  Abraham Kandel,et al.  Fuzzy Control Systems , 1993 .

[8]  Michael Lebowitz,et al.  Categorizing Numeric Information for Generalization , 1985, Cogn. Sci..

[9]  Cezary Z. Janikow,et al.  A genetic algorithm method for optimizing fuzzy decision trees , 1996 .

[10]  Il Hong Suh,et al.  Fuzzy membership function based neural networks with applications to the visual servoing of robot manipulators , 1994, IEEE Trans. Fuzzy Syst..

[11]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[12]  Masaharu Mizumoto,et al.  Fuzzy controls under various fuzzy reasoning methods , 1988, Inf. Sci..

[13]  Chaman L. Sabharwal,et al.  Dynamic ID3: a symbolic learning algorithm for many-valued attribute domains , 1993, SAC '93.

[14]  K. Kobayashi,et al.  A method of inducing fuzzy rules and membership functions , 1993 .

[15]  Naoki Hara,et al.  Fuzzy rule extraction from a multilayered neural network , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[16]  Alberto Maria Segre,et al.  Programs for Machine Learning , 1994 .

[17]  Ivan Bratko,et al.  Experiments in automatic learning of medical diagnostic rules , 1984 .

[18]  J. Ross Quinlan,et al.  Decision trees and decision-making , 1990, IEEE Trans. Syst. Man Cybern..

[19]  J. Ross Quinlan,et al.  Unknown Attribute Values in Induction , 1989, ML.

[20]  Stan Matwin,et al.  Learning Flexible Concepts Using a Two-Tiered Representation , 1993 .

[21]  Brian R. Gaines,et al.  The Trade-Off between Knowledge and Data in Knowledge Acquisition , 1991, Knowledge Discovery in Databases.

[22]  L. Zadeh.  The role of fuzzy logic in the management of uncertainty in expert systems , 1983 .

[23]  J.-S.R. Jang,et al.  Structure determination in fuzzy modeling: a fuzzy CART approach , 1994, Proceedings of 1994 IEEE 3rd International Fuzzy Systems Conference.

[24]  Thomas G. Dietterich,et al.  A Comparative Study of ID3 and Backpropagation for English Text-to-Speech Mapping , 1990, ML.

[25]  Ryszard S. Michalski,et al.  A theory and methodology of inductive learning , 1993 .

[26]  D. Wolpert.  On Overfitting Avoidance as Bias , 1993 .

[27]  Peter Clark,et al.  Induction in Noisy Domains , 1987, EWSL.

[28]  M. F.,et al.  Bibliography , 1985, Experimental Gerontology.

[29]  Dr. Hans Hellendoorn,et al.  An Introduction to Fuzzy Control , 1996, Springer Berlin Heidelberg.

[30]  Cezary Z. Janikow,et al.  A genetic algorithm for learning fuzzy controllers , 1994, SAC '94.