A Simple Neural Network Exhibiting Selective Activation of Neuronal Ensembles: From Winner-Take-All to Winners-Share-All

A neuroecological equation of the Lotka-Volterra type for mean firing rate is derived from the conventional membrane dynamics of a neural network with lateral inhibition and self-inhibition. Neural selection mechanisms employed by the competitive neural network receiving external input sare studied with analytic and numerical calculations. A remarkable finding is that the strength of lateral inhibition relative to that of self-inhibition is crucial for determining the steady states of the network among three qualitatively different types of behavior. Equal strength of both types of inhibitory connections leads the network to the well-known winner-take-all behavior. If, however, the lateral inhibition is weaker than the self-inhibition, a certain number of neurons are activated in the steady states or the number of winners is in general more than one (the winners-share-all behavior). On the other hand, if the self-inhibition is weaker than the lateral one, only one neuron is activated, but the winner is not necessarily the neuron receiving the largest input. It is suggested that our simple network model provides a mathematical basis for understanding neural selection mechanisms.

[1]  J. D. Cowan,et al.  Statistical Mechanics of Nervous Nets , 1968 .

[2]  D. Robinson.  Eye movements evoked by collicular stimulation in the alert monkey. , 1972, Vision research.

[3]  S. Grossberg.  Contour Enhancement , Short Term Memory , and Constancies in Reverberating Neural Networks , 1973 .

[4]  S Grossberg,et al.  Some developmental and attentional biases in the contrast enhancement and short term memory of recurrent neural networks. , 1975, Journal of theoretical biology.

[5]  W. Precht.  The synaptic organization of the brain G.M. Shepherd, Oxford University Press (1975). 364 pp., £3.80 (paperback) , 1976, Neuroscience.

[6]  M. Suzuki,et al.  Theory of instability, nonlinear brownian motion and formation of macroscopic order , 1978 .

[7]  R. Wurtz,et al.  Vision during saccadic eye movements. III. Visual interactions in monkey superior colliculus. , 1980, Journal of neurophysiology.

[8]  Stephen Grossberg,et al.  Absolute stability of global pattern formation and parallel memory storage by competitive neural networks , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[9]  John H. R. Maunsell,et al.  The visual field representation in striate cortex of the macaque monkey: Asymmetries, anisotropies, and individual variability , 1984, Vision Research.

[10]  G. E. Alexander,et al.  Parallel organization of functionally segregated circuits linking basal ganglia and cortex. , 1986, Annual review of neuroscience.

[11]  Yaser S. Abu-Mostafa,et al.  On the K-Winners-Take-All Network , 1988, NIPS.

[12]  Alan L. Yuille,et al.  A Winner-Take-All Mechanism Based on Presynaptic Inhibition Feedback , 1989, Neural Computation.

[13]  T. Wiesel,et al.  The influence of contextual stimuli on the orientation selectivity of cells in primary visual cortex of the cat , 1990, Vision Research.

[14]  Shigeru Tanaka,et al.  Theory of self-organization of cortical maps: Mathematical framework , 1990, Neural Networks.

[15]  O. Hikosaka.  Basal ganglia — possible role in motor coordination and learning , 1991, Current Opinion in Neurobiology.

[16]  William J. Wolfe,et al.  K-winner networks , 1991, IEEE Trans. Neural Networks.

[17]  M. Young,et al.  Sparse population coding of faces in the inferotemporal cortex. , 1992, Science.

[18]  Richard Granger,et al.  A cortical model of winner-take-all competition via lateral inhibition , 1992, Neural Networks.

[19]  Bard Ermentrout,et al.  Complex dynamics in winner-take-all neural nets with slow inhibition , 1992, Neural Networks.

[20]  A. Georgopoulos,et al.  Cognitive neurophysiology of the motor cortex. , 1993, Science.

[21]  B L McNaughton,et al.  Dynamics of the hippocampal ensemble code for space. , 1993, Science.

[22]  Samuel Kaski,et al.  Winner-take-all networks for physiological models of competitive learning , 1994, Neural Networks.

[23]  J. Houk,et al.  Network models of the basal ganglia , 1997, Current Opinion in Neurobiology.

[24]  W. Kristan,et al.  Population coding and behavioral choice , 1997, Current Opinion in Neurobiology.

[25]  Erkki Oja,et al.  Softmax-network and S-Map-models for density-generating topographic mappings , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[26]  Martina Siemann Juan D. Delius.  Algebraic Learning and Neural Network Models for Transitive and Non-transitive Responding , 1998 .

[27]  R. O’Reilly.  Six principles for biologically based computational models of cortical cognition , 1998, Trends in Cognitive Sciences.