Continuous ID3 algorithm with fuzzy entropy measures

Fuzzy entropy measures are used to obtain a quick convergence of a continuous ID3 (CID3) algorithm proposed by K.J. Cios and N. Liu (1991), which allows for self-generation of a hierarchical feedforward neural network architecture by converting decision trees into hidden layers of a neural network. To demonstrate the learning capacity of the fuzzy version of the CID3 algorithm, it was tested on difficult spiral data consisting of 192 points, with 96 points for each spiral. One spiral is generated as a reflection of another, making the problem highly not linearly separable. A remarkable decrease in convergence time is achieved by using a fuzzy entropy measure with generalized Dombi operations.<<ETX>>

[1]  George J. Klir,et al.  Fuzzy sets, uncertainty and information , 1988 .

[2]  K. Lang,et al.  Learning to tell two spirals apart , 1988 .

[3]  Lotfi A. Zadeh,et al.  A COMPUTATIONAL APPROACH TO FUZZY QUANTIFIERS IN NATURAL LANGUAGES , 1983 .

[4]  Bart Kosko,et al.  Fuzzy entropy and conditioning , 1986, Inf. Sci..

[5]  J. Knopfmacher On measures of fuzziness , 1975 .

[6]  G. Klir,et al.  ON MEASURES OF FUZZINESS AND FUZZY COMPLEMENTS , 1982 .

[7]  Settimo Termini,et al.  Entropy of L-Fuzzy Sets , 1974, Inf. Control..

[8]  Ronald R. Yager,et al.  On the Measure of Fuzziness and Negation. II. Lattices , 1980, Inf. Control..

[9]  Charles F. Hockett,et al.  A mathematical theory of communication , 1948, MOCO.

[10]  R. Yager ON THE MEASURE OF FUZZINESS AND NEGATION Part I: Membership in the Unit Interval , 1979 .

[11]  A. Kaufman,et al.  Introduction to the Theory of Fuzzy Subsets. , 1977 .

[12]  Hubert Emptoz Nonprobabilistic entropies and indetermination measures in the setting of fuzzy sets theory , 1981 .

[13]  Settimo Termini,et al.  A Definition of a Nonprobabilistic Entropy in the Setting of Fuzzy Sets Theory , 1972, Inf. Control..

[14]  Enric Trillas,et al.  Entropies in finite fuzzy sets , 1978, Inf. Sci..

[15]  J. Dombi A general class of fuzzy operators, the demorgan class of fuzzy operators and fuzziness measures induced by fuzzy operators , 1982 .

[16]  Settimo Termini,et al.  ON THE CONVERGENCE OF ENTROPY MEASURES OF A FUZZY SET , 1977 .

[17]  L. Zadeh The role of fuzzy logic in the management of uncertainty in expert systems , 1983 .

[18]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.