Linguistic Rule Extraction From a Simplified RBF Neural Network

SUMMARYRepresenting the concept of numerical data by linguistic rules is often desirable. In this paper, we present a novel rule-extraction algorithm from the radial basis function (RBF) neural network classifier for representing the hidden concept of numerical data. Gaussian function is used as the basis function of the RBF network. When training the RBF neural network, we allow for large overlaps between clusters corresponding to the same class, thereby reducing the number of hidden units while improving classification accuracy. The weights connecting the hidden units with the output units are then simplified. The interval for each input in the condition part of each rule is adjusted in order to obtain high accuracy in the extracted rules. Simulations using some bench-marking data sets demonstrate that our approach leads to more accurate and compact rules compared to other methods for extracting rules from RBF neural networks.

[1]  Nelson F. F. Ebecken,et al.  Rule extraction from neural networks: modified RX algorithm , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[2]  Hisao Ishibuchi,et al.  Linguistic rule extraction from neural networks and genetic-algorithm-based rule selection , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[3]  Narasimhan Sundararajan,et al.  Radial Basis Function Neural Networks With Sequential Learning: Mran and Its Applications , 1999 .

[4]  Michael R. Berthold,et al.  Building precise classifiers with automatic rule extraction , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[5]  Christian Pellegrini,et al.  Constraining the MLP power of expression to facilitate symbolic rule extraction , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[6]  Christopher M. Bishop,et al.  Neural Network for Pattern Recognition , 1995 .

[7]  John MacIntyre,et al.  Knowledge extraction and insertion from radial basis function networks , 1999 .

[8]  H. Ishibuchi,et al.  Multi-objective genetic local search for minimizing the number of fuzzy rules for pattern classification problems , 1998, 1998 IEEE International Conference on Fuzzy Systems Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36228).

[9]  P. Gubian,et al.  Approximate radial basis function neural networks (RBFNN) to learn smooth relations from noisy data , 1994, Proceedings of 1994 37th Midwest Symposium on Circuits and Systems.

[10]  M. Glesner,et al.  A new method for generating fuzzy classification systems using RBF neurons with extended RCE learning , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[11]  Stefan Wermter,et al.  Rule-extraction from radial basis function networks , 1999 .

[12]  LiMin Fu,et al.  Rule Generation from Neural Networks , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[13]  Stefan Wermter,et al.  Knowledge extraction from radial basis function networks and multilayer perceptrons , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[14]  T. Brotherton,et al.  Automated rule extraction for engine vibration analysis , 1999, 1999 IEEE Aerospace Conference. Proceedings (Cat. No.99TH8403).

[15]  Asim Roy,et al.  An algorithm to generate radial basis function (RBF)-like nets for classification problems , 1995, Neural Networks.

[16]  Asim Roy,et al.  A neural-network learning theory and a polynomial time RBF algorithm , 1997, IEEE Trans. Neural Networks.