A Discrete-Time Recurrent Neural Network with One Neuron for k-Winners-Take-All Operation

In this paper, a discrete-time recurrent neural network with one neuron and global convergence is proposed for k -winners-take-all (k WTA) operation. Comparing with the existing k WTA networks, the proposed network has simpler structure with only one neuron. The global convergence of the network can be guaranteed for k WTA operation. Simulation results are provided to show that the outputs vector of the network is globally convergent to the solution of the k WTA operation.

[1]  Mokhtar S. Bazaraa,et al.  Nonlinear Programming: Theory and Algorithms , 1993 .

[2]  Haim Brezis.  Review: David Kinderlehrer and Guido Stampacchia, An introduction to variational inequalities and their applications , 1982 .

[3]  R. Palmer,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[4]  Shubao Liu,et al.  A Simplified Dual Neural Network for Quadratic Programming With Its KWTA Application , 2006, IEEE Transactions on Neural Networks.

[5]  Kiichi Urahama,et al.  K-winners-take-all circuit with O(N) complexity , 1995, IEEE Trans. Neural Networks.

[6]  Xiaolin Hu,et al.  An Improved Dual Neural Network for Solving a Class of Quadratic Programming Problems and Its $k$-Winners-Take-All Application , 2008, IEEE Transactions on Neural Networks.

[7]  B. Sekerkiran,et al.  A CMOS K-winners-take-all circuit with O(n) complexity , 1999 .

[8]  William J. Wolfe,et al.  K-winner networks , 1991, IEEE Trans. Neural Networks.

[9]  J. P. Lasalle.  The stability of dynamical systems , 1976 .

[10]  Wolfgang Maass,et al.  Neural Computation with Winner-Take-All as the Only Nonlinear Operation , 1999, NIPS.

[11]  Corneliu A. Marinov,et al.  Stable computational dynamics for a class of circuits with O(N) interconnections capable of KWTA and rank extractions , 2005, IEEE Transactions on Circuits and Systems I: Regular Papers.

[12]  D. Kinderlehrer,et al.  An introduction to variational inequalities and their applications , 1980 .

[13]  Corneliu A. Marinov,et al.  Performance analysis for a K-winners-take-all analog neural network: basic theory , 2003, IEEE Trans. Neural Networks.

[14]  D Marr,et al.  Cooperative computation of stereo disparity. , 1976, Science.

[15]  Andreas G. Andreou,et al.  Current-mode subthreshold MOS circuits for analog VLSI neural systems , 1991, IEEE Trans. Neural Networks.

[16]  Qingshan Liu,et al.  Two k-winners-take-all networks with discontinuous activation functions , 2008, Neural Networks.

[17]  Jun Wang.  Analogue winner-take-all neural networks for determining maximum and minimum signals , 1994 .