A feature-weight detector neural network and its application

A feedback neural network model with memory connections for classification and weight connections for selection is proposed. After training, a memory vector is interpreted as a prototype of a feature pattern, and a weight vector represents importance of feature variables to the corresponding feature pattern. The proposed neural network has a simple network architecture and high learning speed. Moreover, the obtained knowledge can be described by natural language. The technique is applied to the IRIS data: the two effective feature variables were extracted, and the corresponding number of errors, is almost the same as using four feature variables.

[1]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[2]  I. Turksen Measurement of membership functions and their acquisition , 1991 .

[3]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[4]  Rui-Ping Li,et al.  A maximum-entropy approach to fuzzy clustering , 1995, Proceedings of 1995 IEEE International Conference on Fuzzy Systems..

[5]  LiMin Fu,et al.  Rule Generation from Neural Networks , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[6]  L. Kuncheva Fuzzy rough sets: application to feature selection , 1992 .

[7]  James M. Keller,et al.  Incorporating Fuzzy Membership Functions into the Perceptron Algorithm , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[9]  Donald F. Specht,et al.  Probabilistic neural networks , 1990, Neural Networks.

[10]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[11]  Michio Sugeno,et al.  A fuzzy-logic-based approach to qualitative modeling , 1993, IEEE Trans. Fuzzy Syst..

[12]  Buhmann Oscillations and low firing rates in associative memory neural networks. , 1989, Physical review. A, General physics.

[13]  D. Hubel,et al.  RECEPTIVE FIELDS OF CELLS IN STRIATE CORTEX OF VERY YOUNG, VISUALLY INEXPERIENCED KITTENS. , 1963, Journal of neurophysiology.

[14]  Shouhong Wang,et al.  Fuzzy set representation of neural network classification boundaries , 1991, IEEE Trans. Syst. Man Cybern..

[15]  Sukhan Lee,et al.  A Gaussian potential function network with hierarchically self-organizing learning , 1991, Neural Networks.