Threshold behaviour of the maximum likelihood method in population decoding

We study the performance of the maximum likelihood (ML) method in population decoding as a function of the population size. Assuming uncorrelated noise in neural responses, the ML performance, quantified by the expected square difference between the estimated and the actual quantity, follows closely the optimal Cramer–Rao bound, provided that the population size is sufficiently large. However, when the population size decreases below a certain threshold, the performance of the ML method undergoes a rapid deterioration, experiencing a large deviation from the optimal bound. We explain the cause of such threshold behaviour, and present a phenomenological approach for estimating the threshold population size, which is found to be linearly proportional to the inverse of the square of the system's signal-to-noise ratio. If the ML method is used by neural systems, we expect the number of neurons involved in population coding to be above this threshold.

[1]  J. O'Keefe,et al.  The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. , 1971, Brain research.

[2]  Robert Boorstyn,et al.  Single tone parameter estimation from discrete-time observations , 1974, IEEE Trans. Inf. Theory.

[3]  K. Takeuchi,et al.  Asymptotic efficiency of statistical estimators : concepts and higher order asymptotic efficiency , 1981 .

[4]  A P Georgopoulos,et al.  On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[5]  D C Van Essen,et al.  Functional properties of neurons in middle temporal visual area of the macaque monkey. I. Selectivity for stimulus direction, speed, and orientation. , 1983, Journal of neurophysiology.

[6]  D G Pelli,et al.  Uncertainty explains many aspects of visual contrast detection and discrimination. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[7]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[8]  J P Miller,et al.  Representation of sensory information in the cricket cercal sensory system. II. Information theoretic calculation of system accuracy and optimal tuning-curve widths of four primary interneurons. , 1991, Journal of neurophysiology.

[9]  H Sompolinsky,et al.  Simple models for reading neuronal population codes. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[10]  Michael N. Shadlen,et al.  Noise, neural codes and cortical organization , 1994, Current Opinion in Neurobiology.

[11]  Herman P. Snippe,et al.  Parameter Extraction from Population Codes: A Critical Assessment , 1996, Neural Computation.

[12]  Peter E. Latham,et al.  Statistically Efficient Estimation Using Population Coding , 1998, Neural Computation.

[13]  Haim Sompolinsky,et al.  The Effect of Correlations on the Fisher Information of Population Codes , 1998, NIPS.

[14]  Peter Dayan,et al.  The Effect of Correlated Variability on the Accuracy of a Population Code , 1999, Neural Computation.

[15]  A. Pouget,et al.  Reading population codes: a neural implementation of ideal observers , 1999, Nature Neuroscience.

[16]  R. Zemel,et al.  Information processing with population codes , 2000, Nature Reviews Neuroscience.

[17]  Si Wu,et al.  Population Coding with Correlation and an Unfaithful Model , 2001, Neural Computation.

[18]  H. V. Trees Detection, Estimation, And Modulation Theory , 2001 .

[19]  P. Best,et al.  Spatial processing in the brain: the activity of hippocampal place cells. , 2001, Annual review of neuroscience.

[20]  Si Wu,et al.  Population Coding and Decoding in a Neural Field: A Computational Study , 2002, Neural Computation.

[21]  M. Paradiso,et al.  A theory for the use of visual orientation information which exploits the columnar structure of striate cortex , 2004, Biological Cybernetics.

[22]  Emilio Salinas,et al.  Vector reconstruction from firing rates , 1994, Journal of Computational Neuroscience.

[23]  Jan J. Koenderink,et al.  Information in channel-coded systems: correlated receivers , 1992, Biological Cybernetics.

[24]  Ehud Zohary,et al.  Population coding of visual stimuli by cortical neurons tuned to more than one dimension , 2004, Biological Cybernetics.