Counterpropagation networks.

By combining Kohonen learning and Grossberg learning a new type of mapping neural network is obtained. This counterpropagation network (CPN) functions as a statistically optimal self-programming lookup table. The paper begins with some introductory comments, followed by the definition of the CPN. Then a closedform formula for the error of the network is developed. The paper concludes with a discussion of CPN variants and comments about CPN convergence and performance. References and a neurocomputing bibliography with a combined total of eighty entries are provided.

[1]  S. Grossberg.  Nonlinear difference-differential equations in prediction and learning theory. , 1967, Proceedings of the National Academy of Sciences of the United States of America.

[2]  S. Grossberg.  Some Networks That Can Learn, Remember, and Reproduce any Number of Complicated Space-Time Patterns, I , 1969 .

[3]  Stephen Grossberg,et al.  Embedding fields: A theory of learning with physiological implications , 1969 .

[4]  H. C. LONGUET-HIGGINS,et al.  Non-Holographic Associative Memory , 1969, Nature.

[5]  Shun-ichi Amari,et al.  Characteristics of randomly connected threshold-element networks and network systems , 1971 .

[6]  Stephen Grossberg,et al.  Embedding Fields: Underlying Philosophy, Mathematics, and Applications to Psychology, Physiology, and Anatomy , 1971 .

[7]  James A. Anderson,et al.  A simple neural network generating an interactive memory , 1972 .

[8]  Stephen Grossberg,et al.  Studies of mind and brain , 1982 .

[9]  Robert Hecht-Nielsen.  Neural Analog Information Processing , 1982, Optics & Photonics.

[10]  Robert Hecht-Nielsen.  Neural Analog Processing , 1983, Optics & Photonics.

[11]  David Zipser,et al.  Feature Discovery by Competive Learning , 1986, Cogn. Sci..

[12]  Arthur D. Fisher,et al.  Implementations Of Adaptive Associative Optical Computing Elements , 1986, Photonics West - Lasers and Applications in Science and Engineering.

[13]  B H Soffer,et al.  Associative holographic memory with feedback using phase-conjugate mirrors. , 1986, Optics letters.

[14]  Y. Owechko,et al.  Optical Holographic Associative Memory Using A Phase Conjugate Resonator , 1986, Photonics West - Lasers and Applications in Science and Engineering.

[15]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..

[16]  Bernard Widrow,et al.  Adaptive switching circuits , 1988 .