A new rule extraction method from neural networks

This paper presents a method of extracting rules from multilayered neural networks (NN) formed using a random optimization (search) method (ROM). The objective of this study is to extract rules from NN, achieving 100% recognition accuracy in a pattern recognition system. NNs to be extracted rules are formed using ROM. A hybrid algorithm of NN and ROM performs a formation of a small-sized NN system, which is suitable for a rule extraction. In this paper iris data is used as inputs. ROM is utilized to reduce the number of connection weights in NN. The network weights survived after the ROM training represent regularities to perform pattern classification. The rules are then extracted from the networks in which hidden units use signum and sigmoid functions to produce binary outputs. It enables us to extract simple logical functions from the network. By means of computer simulation, the effectiveness of this approach is examined.

[1]  Minoru Fukumi,et al.  A method to design a neural pattern recognition system by using a genetic algorithm with partial fitness and a deterministic mutation , 1996, 1996 IEEE International Conference on Systems, Man and Cybernetics. Information Intelligence and Systems (Cat. No.96CH35929).

[2]  Masumi Ishikawa,et al.  Structural learning with forgetting , 1996, Neural Networks.

[3]  LiMin Fu,et al.  Rule Generation from Neural Networks , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[4]  Minoru Fukumi,et al.  Rule extraction from neural networks trained using evolutionary algorithms with deterministic mutation , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[5]  Minoru Fukumi,et al.  A new back-propagation algorithm with coupled neuron , 1991, International 1989 Joint Conference on Neural Networks.