KWTA networks and their applications

Winner-Take-All (WTA) or K-Winner-Take-All (KWTA) networks have been frequently used as the basic building blocks of complex neural networks. This paper introduces a new selection rule for network connections that implements stable KWTA networks. To widen the applications of WTA networks, a new class of WTA networks is proposed, and their efficient design methods are presented. We demonstrate the properties of the generalized class of WTA networks, through three application examples.

[1]  Yaser S. Abu-Mostafa,et al.  On the K-Winners-Take-All Network , 1988, NIPS.

[2]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..

[3]  Yaser S. Abu-Mostafa,et al.  Analog Neural Networks as Decoders , 1990, NIPS.

[4]  B. Gold,et al.  A Comparison of Hamming and Hopfield Neural Nets for Pattern Classification , 1987 .

[5]  Rhys S. Francis,et al.  A Benchmark Parallel Sort for Shared Memory Multiprocessors , 1988, IEEE Trans. Computers.

[6]  David S. Touretzky.  Analyzing the Energy Landscapes of Distributed Winner-Take-All Networks , 1988, NIPS.

[7]  Ioannis Pitas,et al.  Edge Detectors Based on Nonlinear Filters , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Rabab Kreidieh Ward,et al.  OSNet: a neural network implementation of order statistic filters , 1993, IEEE Trans. Neural Networks.

[9]  Simon Parsons,et al.  Soft computing: fuzzy logic, neural networks and distributed artificial intelligence by F. Aminzadeh and M. Jamshidi (Eds.), PTR Prentice Hall, Englewood Cliffs, NJ, pp 301, ISBN 0-13-146234-2 , 1996, Knowl. Eng. Rev..

[10]  William J. Wolfe,et al.  K-winner networks , 1991, IEEE Trans. Neural Networks.

[11]  Jerome A. Feldman,et al.  Connectionist Models and Their Properties , 1982, Cogn. Sci..

[12]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[13]  Stephen Grossberg,et al.  Contour Enhancement, Short Term Memory, and Constancies in Reverberating Neural Networks , 1973 .

[14]  Sun-Yuan Kung,et al.  Digital neural networks , 1993, Prentice Hall Information and System Sciences Series.

[15]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[16]  John Lazzaro,et al.  Winner-Take-All Networks of O(N) Complexity , 1988, NIPS.

[17]  Barry W. Johnson.  Design & analysis of fault tolerant digital systems , 1988 .

[18]  A. Venetsanopoulos,et al.  Nonlinear order statistic filters for image filtering and edge detection , 1986 .