The Scaling of Winner-Takes-All Accuracy with Population Size

Empirical studies seem to support conflicting hypotheses with regard to the nature of the neural code. While some studies highlight the role of a distributed population code, others emphasize the possibility of a single-best-cell readout. One particularly interesting example of single-best-cell readout is provided by the winner-takes-all (WTA) approach. According to the WTA, every cell is characterized by one particular preferred stimulus, to which it responds maximally. The WTA estimate for the stimulus is defined as the preferred stimulus of the cell with the strongest response. From a theoretical point of view, not much is known about the efficiency of single-best-cell readout mechanisms, in contrast to the considerable existing theoretical knowledge on the efficiency of distributed population codes. In this work, we provide a basic theoretical framework for investigating single-best-cell readout mechanisms. We study the accuracy of the WTA readout. In particular, we are interested in how the WTA accuracy scales with the number of cells in the population. Using this framework, we show that for large neuronal populations, the WTA accuracy is dominated by the tail of the single-cell-response distribution. Furthermore, we find that although the WTA accuracy does improve when larger populations are considered, this improvement is extremely weak compared to other types of population codes. More precisely, we show that while the accuracy of a linear readout scales linearly with the population size, the accuracy of the WTA readout scales logarithmically with the number of cells in the population.

[1]  P. Zweifel Advanced Mathematical Methods for Scientists and Engineers , 1980 .

[2]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[3]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[4]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[5]  D. McAlpine,et al.  A neural code for low-frequency sound localization in mammals , 2001, Nature Neuroscience.

[6]  Haim Sompolinsky,et al.  Nonlinear Population Codes , 2004, Neural Computation.

[7]  H. Sompolinsky,et al.  Population coding in neuronal systems with correlated noise. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[8]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[9]  R. H. Arnott,et al.  The ability of inferior colliculus neurons to signal differences in interaural delay , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[10]  K. H. Britten,et al.  Neuronal correlates of a perceptual decision , 1989, Nature.

[11]  Timothy J Ebner,et al.  Population code for tracking velocity based on cerebellar Purkinje cell simple spike firing in monkeys , 2000, Neuroscience Letters.

[12]  Z. Fuzessery,et al.  Functional organization of the pallid bat auditory cortex: emphasis on binaural organization. , 2002, Journal of neurophysiology.

[13]  A. Parker,et al.  Sense and the single neuron: probing the physiology of perception. , 1998, Annual review of neuroscience.

[14]  Haim Sompolinsky,et al.  Implications of Neuronal Diversity on Population Coding , 2006, Neural Computation.

[15]  A P Georgopoulos,et al.  On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.