Representational capacity of a set of independent neurons.

The capacity with which a system of independent neuron-like units represents a given set of stimuli is studied by calculating the mutual information between the stimuli and the neural responses. Both discrete noiseless and continuous noisy neurons are analyzed. In both cases, the information grows monotonically with the number of neurons considered. Under the assumption that neurons are independent, the mutual information rises linearly from zero, and approaches exponentially its maximum value. We find the dependence of the initial slope on the number of stimuli and on the sparseness of the representation.

[1]  E T Rolls,et al.  Information about spatial view in an ensemble of primate hippocampal cells. , 1998, Journal of neurophysiology.

[2]  A. Treves,et al.  The representational capacity of the distributed encoding of information provided by populations of neurons in primate temporal visual cortex , 1997, Experimental Brain Research.

[3]  Miss A.O. Penney.  (b) , 1974, The New Yale Book of Quotations.

[4]  Treves,et al.  Graded-response neurons and information encodings in autoassociative memories. , 1990, Physical review. A, Atomic, molecular, and optical physics.

[5]  L. Optican,et al.  Role of inferior temporal neurons in visual memory. I. Temporal encoding of information about visual images, recalled images, and behavioral context. , 1992, Journal of neurophysiology.

[6]  Edmund T. Rolls,et al.  What determines the capacity of autoassociative memories in the brain? Network , 1991 .

[7]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[8]  E. Rolls,et al.  Representation of olfactory information in the primate orbitofrontal cortex. , 1996, Journal of neurophysiology.

[9]  J. O'Keefe,et al.  The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. , 1971, Brain research.

[10]  E T Rolls,et al.  Analysis of information transmission in the schaffer collaterals , 1999, Hippocampus.

[11]  S. W. Kuffler.  Discharge patterns and functional organization of mammalian retina. , 1953, Journal of neurophysiology.

[12]  A Treves,et al.  On the perceptual structure of face space. , 1997, Bio Systems.

[13]  E. Rolls,et al.  Neural networks and brain function , 1998 .

[14]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[15]  A. Treves,et al.  How much of the hippocampus can be explained by functional constraints? , 1996, Hippocampus.

[16]  I Samengo.  Independent neurons representing a finite set of stimuli: dependence of the mutual information on the number of units sampled , 2001, Network.

[17]  TJ Gawne,et al.  How independent are the messages carried by adjacent inferior temporal cortical neurons? , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[18]  M. Tovée,et al.  Information encoding and the responses of single neurons in the primate temporal visual cortex. , 1993, Journal of neurophysiology.

[19]  L. Optican,et al.  Temporal encoding of two-dimensional patterns by single units in primate inferior temporal cortex. III. Information theoretic analysis. , 1987, Journal of neurophysiology.