Data mining for constructing ellipsoidal fuzzy classifier with various input features using GRBF neural networks

This paper aims at developing a theoretical framework for constructing ellipsoidal fuzzy classifiers with various input features from a data mining viewpoint. The proposed methodology for constructing fuzzy classification systems with ellipsoidal regions contains four parts: 1) rule-set initialization using a fully connected RBF neural network with an APC-III learning algorithm and cross entropy criterion; 2) feature selection by using a simple and practical algorithm; 3) determination of rule-set structure and representation using a generalized RBF neural network, where a fuzzy plus operator is employed as the activation function of the neurons at the output layer; and 4) a regularization cost function addressing the trade-off between misclassification, recognition and generalization for optimizing the initial rule-set.

[1]  John Moody,et al.  Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.

[2]  Sung Yang Bang,et al.  An Efficient Method to Construct a Radial Basis Function Neural Network Classifier , 1997, Neural Networks.

[3]  Bart Kosko,et al.  Fuzzy function approximation with ellipsoidal rules , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[4]  R.P. Lippmann,et al.  Pattern classification using neural networks , 1989, IEEE Communications Magazine.

[5]  Tharam S. Dillon,et al.  Automated knowledge acquisition , 1994, Prentice Hall International series in computer science and engineering.

[6]  Shyi-Ming Chen,et al.  A new method for constructing membership functions and fuzzy rules from training examples , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[7]  Sankar K. Pal,et al.  Knowledge-based fuzzy MLP for classification and rule generation , 1997, IEEE Trans. Neural Networks.

[8]  Tharam S. Dillon,et al.  Extraction and optimization of classification rules for continuous or mixed-mode data using neural nets , 2001, SPIE Defense + Commercial Sensing.

[9]  W. Pedrycz,et al.  Fuzzy computing for data mining , 1999, Proc. IEEE.

[10]  Xindong Wu Fuzzy interpretation of discretized intervals , 1999, IEEE Trans. Fuzzy Syst..