Fuzzification of input vectors for improving the generalization ability of neural networks

We propose an approach for improving the generalization ability of multilayer feedforward neural networks. Our approach is based on the fuzzification of input vectors. In our approach, a neural network is trained by fuzzy input vectors. The aim of such fuzzification in the learning phase is to avoid the overfitting of the neural network. In the classification phase, each new pattern is fuzzified, and the fuzzy input vector is presented to the trained neural network. The classification of each new pattern is performed based on the corresponding fuzzy output vector from the trained neural network. The aim of the fuzzification in the classification phase is to reject the classification of new patterns close to the classification boundary. The introduction of a reject option can decrease the misclassification rate on new patterns. We examine the effectiveness of our approach by computer simulations on real-world pattern classification problems.

[1]  Yann LeCun,et al.  Optimal Brain Damage , 1989, NIPS.

[2]  Hahn-Ming Lee,et al.  A neural network architecture for classification of fuzzy inputs , 1994 .

[3]  Masumi Ishikawa,et al.  Structural learning with forgetting , 1996, Neural Networks.

[4]  Gustavo Deco,et al.  Two Strategies to Avoid Overfitting in Feedforward Networks , 1997, Neural Networks.

[5]  Hisao Ishibuchi,et al.  Learning by fuzzified neural networks , 1995, Int. J. Approx. Reason..

[6]  Hisao Ishibuchi,et al.  Neural networks that learn from fuzzy if-then rules , 1993, IEEE Trans. Fuzzy Syst..

[7]  T. Feuring,et al.  Learning in fuzzy neural networks , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[8]  Hideo Tanaka,et al.  An architecture of neural networks for input vectors of fuzzy numbers , 1992, [1992 Proceedings] IEEE International Conference on Fuzzy Systems.

[9]  G. Alefeld,et al.  Introduction to Interval Computation , 1983 .

[10]  Kevin D. Reilly,et al.  Genetic learning algorithms for fuzzy neural nets , 1994, Proceedings of 1994 IEEE 3rd International Fuzzy Systems Conference.

[11]  Hisao Ishibuchi,et al.  Linguistic rule extraction from neural networks and genetic-algorithm-based rule selection , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[12]  Hisao Ishibuchi,et al.  Fuzzy regression analysis by neural networks with non-symmetric fuzzy number weights , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[13]  J. Dunyak,et al.  A training technique for fuzzy number neural networks , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[14]  J. Buckley,et al.  Fuzzy neural networks: a survey , 1994 .

[15]  James J. Buckley,et al.  Fuzzy neural network with fuzzy signals and weights , 1993, Int. J. Intell. Syst..

[16]  Madan M. Gupta,et al.  Introduction to Fuzzy Arithmetic , 1991 .

[17]  Mario Vento,et al.  A method for improving classification reliability of multilayer perceptrons , 1995, IEEE Trans. Neural Networks.