Generating fuzzy if-then rules from trained neural networks: linguistic analysis of neural networks

We propose a fuzzy-arithmetic-based approach for extracting fuzzy if-then rules from multilayer feedforward neural networks. For pattern classification problems, our approach extracts fuzzy if-then rules such as "If x/sub 1/ is small and x/sub 2/ is large then Class 1 with CF=0.9" where CF is the grade of certainty. In order to determine the consequent class and the grade of certainty of a fuzzy if-then rule, first an input vector of linguistic values is presented to a trained neural network. The input vector consists of linguistic values in the antecedent part of the fuzzy if-then rule (e.g. (small, large) in the case of the above fuzzy if-then rule). Next fuzzy outputs from the neural network are calculated by fuzzy arithmetic. Then the consequent class and the grade of certainty of the fuzzy if-then rule are determined by an inequality relation between the fuzzy outputs.

[1]  Hisao Ishibuchi,et al.  Learning by fuzzified neural networks , 1995, Int. J. Approx. Reason..

[2]  J. Buckley,et al.  Fuzzy neural networks: a survey , 1994 .

[3]  Didier Dubois,et al.  Ranking fuzzy numbers in the setting of possibility theory , 1983, Inf. Sci..

[4]  LiMin Fu,et al.  Rule Generation from Neural Networks , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[5]  Sankar K. Pal,et al.  Multilayer perceptron, fuzzy sets, and classification , 1992, IEEE Trans. Neural Networks.

[6]  James J. Buckley,et al.  Fuzzy neural network with fuzzy signals and weights , 1993, Int. J. Intell. Syst..

[7]  L. Kuncheva,et al.  Improving classification performance using fuzzy MLP and two-level selective partitioning of the feature space , 1995 .

[8]  Yoichi Hayashi,et al.  A Neural Expert System with Automated Extraction of Fuzzy If-Then Rules , 1990, NIPS.

[9]  Hisao Ishibuchi,et al.  Interpolation of fuzzy if-then rules by neural networks , 1994, Int. J. Approx. Reason..

[10]  Jude W. Shavlik,et al.  Interpretation of Artificial Neural Networks: Mapping Knowledge-Based Neural Networks into Rules , 1991, NIPS.

[11]  James M. Keller,et al.  Backpropagation neural networks for fuzzy logic , 1992, Inf. Sci..

[12]  Hideo Tanaka,et al.  Trainable fuzzy classification systems based on fuzzy if-then rules , 1994, Proceedings of 1994 IEEE 3rd International Fuzzy Systems Conference.

[13]  James M. Keller,et al.  Implementation of conjunctive and disjunctive fuzzy logic rules with neural networks , 1992, Int. J. Approx. Reason..

[14]  Sushmita Mitra,et al.  Fuzzy MLP based expert system for medical diagnosis , 1994, CVPR 1994.

[15]  Hisao Ishibuchi,et al.  Classification of fuzzy input patterns by neural networks , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[16]  H. Ishibuchi,et al.  Distributed representation of fuzzy rules and its application to pattern classification , 1992 .

[17]  Tharam S. Dillon,et al.  Knowledge acquisition of conjunctive rules using multilayered neural networks , 1993, Int. J. Intell. Syst..

[18]  Lotfi A. Zadeh,et al.  The Concepts of a Linguistic Variable and its Application to Approximate Reasoning , 1975 .

[19]  Sankar K. Pal,et al.  Fuzzy multi-layer perceptron, inferencing and rule generation , 1995, IEEE Trans. Neural Networks.

[20]  C. Matthews,et al.  Fuzzy rule extraction from a trained multilayer neural network , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[21]  Caroline M. Eastman,et al.  Response: Introduction to fuzzy arithmetic: Theory and applications : Arnold Kaufmann and Madan M. Gupta, Van Nostrand Reinhold, New York, 1985 , 1987, Int. J. Approx. Reason..

[22]  Hisao Ishibuchi,et al.  Neural networks that learn from fuzzy if-then rules , 1993, IEEE Trans. Fuzzy Syst..