Convergence Time of Wang's kWTA Network with Stochastic Output Nodes

Recently, an extended Wang's kWTA network with stochastic output nodes has been studied. It is shown that this extended model converges asymptotically. In this paper, we further studies the convergence time of this model. The convergence time is defined as the time taken for the model to reach a finite region around the convergent. With this definition, an approximation of convergence time is derived and its viability is shown by simulation results.

[1]  Xiaolin Hu,et al.  An Improved Dual Neural Network for Solving a Class of Quadratic Programming Problems and Its $k$-Winners-Take-All Application , 2008, IEEE Transactions on Neural Networks.

[2]  Corneliu A. Marinov,et al.  Time-Oriented Synthesis for a WTA Continuous-Time Neural Network Affected by Capacitive Cross-Coupling , 2010, IEEE Transactions on Circuits and Systems I: Regular Papers.

[3]  Andrew Chi-Sing Leung,et al.  Analysis for a class of winner-take-all model , 1999, IEEE Trans. Neural Networks.

[4]  Corneliu A. Marinov,et al.  Another K-winners-take-all analog neural network , 2000, IEEE Trans. Neural Networks Learn. Syst..

[5]  Corneliu A. Marinov,et al.  Performance analysis for a K-winners-take-all analog neural network: basic theory , 2003, IEEE Trans. Neural Networks.

[6]  Herbert A. David,et al.  Order Statistics , 2011, International Encyclopedia of Statistical Science.

[7]  Yaser S. Abu-Mostafa,et al.  On the K-Winners-Take-All Network , 1988, NIPS.

[8]  P. Olver.  Nonlinear Systems , 2013 .

[9]  Andrew Chi-Sing Leung,et al.  Analysis on Wang's kWTA with Stochastic Output Nodes , 2011, ICONIP.

[10]  Jun Wang,et al.  Parametric Sensitivity and Scalability of k-Winners-Take-All Networks with a Single State Variable and Infinity-Gain Activation Functions , 2010, ISNN.

[11]  Andrew Chi-Sing Leung,et al.  A Fault-Tolerant Regularizer for RBF Networks , 2008, IEEE Transactions on Neural Networks.

[12]  Paul W. Munro,et al.  Nets with Unreliable Hidden Nodes Learn Error-Correcting Codes , 1992, NIPS.

[13]  Andrew Chi-Sing Leung,et al.  Analysis on the Convergence Time of Dual Neural Network-Based WTA , 2012, IEEE Trans. Neural Networks Learn. Syst..

[14]  Lipo Wang,et al.  Noise injection into inputs in sparsely connected Hopfield and winner-take-all neural networks , 1997, IEEE Trans. Syst. Man Cybern. Part B.

[15]  Jinde Cao,et al.  A Novel Recurrent Neural Network With One Neuron and Finite-Time Convergence for $k$-Winners-Take-All Operation , 2010, IEEE Transactions on Neural Networks.

[16]  Jun Wang,et al.  Analysis and Design of a $k$ -Winners-Take-All Model With a Single State Variable and the Heaviside Step Activation Function , 2010, IEEE Transactions on Neural Networks.

[17]  Simon Haykin,et al.  Neural Networks and Learning Machines , 2010 .