GMM-PAM: a genetic multilevel multicategory perceptron associative memory

One of the principal inefficiencies in the multicategory perceptron algorithm lies in its “training algorithm”. This problem has been dealt with in the past by having multiple perceptrons trained to respond to different predefined features in the input vector using back propagation. The problem with this approach is first that in general, one cannot be sure that an appropriate set of feature vectors has been defined and second, even if it were possible to do so, one cannot insure their relative spatial geometries. A new approach for reducing the dimensionality of the pattern vector utilizes the associative memory which emerges from the cooperation among multiple distributed multicategory perceptrons connected by a genetic algorithm.

[1]  Sharad Singhal,et al.  Training Multilayer Perceptrons with the Extende Kalman Algorithm , 1988, NIPS.

[2]  Julius T. Tou,et al.  Pattern Recognition Principles , 1974 .

[3]  Peter Seitz,et al.  Minimum class entropy: A maximum information approach to layered networks , 1989, Neural Networks.

[4]  Stuart Harvey Rubin.  The transformative compression of coherent languages , 1988 .

[5]  Takayuki Ito,et al.  Neocognitron: A neural network model for a mechanism of visual pattern recognition , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[6]  John H. Holland.  Genetic Algorithms and Classifier Systems: Foundations and Future Directions , 1987, ICGA.

[7]  James L. McClelland,et al.  James L. McClelland, David Rumelhart and the PDP Research Group, Parallel distributed processing: explorations in the microstructure of cognition . Vol. 1. Foundations . Vol. 2. Psychological and biological models . Cambridge MA: M.I.T. Press, 1987. , 1989, Journal of Child Language.

[8]  Geoffrey E. Hinton,et al.  Phoneme recognition using time-delay neural networks , 1989, IEEE Trans. Acoust. Speech Signal Process..

[9]  B. Irie,et al.  Capabilities of three-layered perceptrons , 1988, IEEE 1988 International Conference on Neural Networks.

[10]  Daniel S. Levine,et al.  Modeling some effects of frontal lobe damage--Novelty and perseveration , 1989, Neural Networks.

[11]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[12]  Isabelle Guyon,et al.  Neural Network Recognizer for Hand-Written Zip Code Digits , 1988, NIPS.

[13]  H. Longuet-Higgins.  Understanding the Brain , 1968, Nature.

[14]  G. Brindley,et al.  THE UNDERSTANDING OF THE BRAIN , 1973 .

[15]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[16]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[17]  T. Kohonen.  Adaptive, associative, and self-organizing functions in neural computing. , 1987, Applied optics.