Statistically Efficient Estimation Using Population Coding

Coarse codes are widely used throughout the brain to encode sensory and motor variables. Methods designed to interpret these codes, such as population vector analysis, are either inefficient (the variance of the estimate is much larger than the smallest possible variance) or biologically implausible, like maximum likelihood. Moreover, these methods attempt to compute a scalar or vector estimate of the encoded variable. Neurons are faced with a similar estimation problem. They must read out the responses of the presynaptic neurons, but, by contrast, they typically encode the variable with a further population code rather than as a scalar. We show how a nonlinear recurrent network can be used to perform estimation in a near-optimal way while keeping the estimate in a coarse code format. This work suggests that lateral connections in the cortex may be involved in cleaning up uncorrelated noise among neurons representing similar variables.

[1]  Stephen Grossberg,et al.  Absolute stability of global pattern formation and parallel memory storage by competitive neural networks , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[2]  Peter E. Hart,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[3]  A. Sillito The contribution of inhibitory mechanisms to the receptive field properties of neurones in the striate cortex of the cat. , 1975, The Journal of physiology.

[4]  Ehud Zohary,et al.  Correlated neuronal discharge rate and its implications for psychophysical performance , 1994, Nature.

[5]  D C Van Essen,et al.  Functional properties of neurons in middle temporal visual area of the macaque monkey. I. Selectivity for stimulus direction, speed, and orientation. , 1983, Journal of neurophysiology.

[6]  G. Schöner,et al.  The distribution of neuronal population activation (DPA) as a tool to study interaction and integration in cortical representations , 1999, Journal of Neuroscience Methods.

[7]  Peter E. Latham,et al.  Narrow Versus Wide Tuning Curves: What's Best for a Population Code? , 1999, Neural Computation.

[8]  B L McNaughton,et al.  Dynamics of the hippocampal ensemble code for space. , 1993, Science.

[9]  K. Zhang,et al.  Representation of spatial orientation by the intrinsic dynamics of the head-direction cell ensemble: a theory , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[10]  T. Sejnowski,et al.  Egocentric Spaw Representation in Early Vision , 1993, Journal of Cognitive Neuroscience.

[11]  D. Ferster,et al.  Orientation selectivity of thalamic input to simple cells of cat visual cortex , 1996, Nature.

[12]  Herman P. Snippe,et al.  Parameter Extraction from Population Codes: A Critical Assessment , 1996, Neural Computation.

[13]  I. Miller Probability, Random Variables, and Stochastic Processes , 1966 .

[14]  Stefano Panzeri,et al.  On Decoding the Responses of a Population of Neurons from Short Time Windows , 1999, Neural Computation.

[15]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[16]  M. Hirsch,et al.  Differential Equations, Dynamical Systems, and Linear Algebra , 1974 .

[17]  D. Regan,et al.  Postadaptation orientation discrimination. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[18]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[19]  Charles H. Anderson,et al.  BASIC ELEMENTS OF BIOLOGICAL COMPUTATIONAL SYSTEMS , 1994 .

[20]  Christof Koch,et al.  Modeling the mammalian visual system , 1989 .

[21]  M. V. Rossum,et al.  In Neural Computation , 2022 .

[22]  Jochen Braun,et al.  A quantitative model relating visual neuronal activity to psychophysical thresholds , 1999, Neurocomputing.

[23]  A P Georgopoulos,et al.  On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[24]  R L Jenison,et al.  Correlated cortical populations can enhance sound localization performance. , 2000, The Journal of the Acoustical Society of America.

[25]  Peter Dayan,et al.  Computational Differences between Asymmetrical and Symmetrical Networks , 1998, NIPS.

[26]  C. Koch,et al.  A detailed model of the primary visual pathway in the cat: comparison of afferent excitatory and intracortical inhibitory connection schemes for orientation selectivity , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[27]  D. Perrett,et al.  The `Ideal Homunculus': decoding neural population signals , 1998, Trends in Neurosciences.

[28]  P. Heggelund Receptive field organization of simple cells in cat striate cortex , 1981, Experimental brain research.

[29]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[30]  J. Feng,et al.  Output of a neuronal population code. , 1999, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[31]  Terence D. Sanger,et al.  Probability Density Methods for Smooth Function Approximation and Learning in Populations of Tuned Spiking Neurons , 1998, Neural Computation.

[32]  Leslie G. Ungerleider,et al.  Contour, color and shape analysis beyond the striate cortex , 1985, Vision Research.

[33]  S. Nelson,et al.  An emergent model of orientation selectivity in cat visual cortical simple cells , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[34]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[35]  Terrence J. Sejnowski,et al.  Seeing White: Qualia in the Context of Decoding Population Codes , 1999, Neural Computation.

[36]  Alexandre Pouget,et al.  Connectionist Models of Orientation Identification , 1991 .

[37]  Michael N. Shadlen,et al.  Noise, neural codes and cortical organization , 1994, Current Opinion in Neurobiology.

[38]  Geoffrey E. Hinton,et al.  How neural networks learn from experience. , 1992, Scientific American.

[39]  Athanasios Papoulis,et al.  Probability, Random Variables and Stochastic Processes , 1965 .

[40]  Peter Dayan,et al.  The Effect of Correlated Variability on the Accuracy of a Population Code , 1999, Neural Computation.

[42]  Alexandre Pouget,et al.  Probabilistic Interpretation of Population Codes , 1996, Neural Computation.

[43]  Haim Sompolinsky,et al.  Neural Network Models of Perceptual Learning of Angle Discrimination , 1996, Neural Computation.

[44]  Terrence J. Sejnowski,et al.  Neuronal Tuning: To Sharpen or Broaden? , 1999, Neural Computation.

[45]  H Sompolinsky,et al.  Simple models for reading neuronal population codes. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[46]  Terrence J. Sejnowski,et al.  Egocentric Spatial Representation in Early Vision , 1993 .

[47]  H. Sompolinsky,et al.  Theory of orientation tuning in visual cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[48]  S. Lehky,et al.  Neural model of stereoacuity and depth interpolation based on a distributed representation of stereo disparity [published erratum appears in J Neurosci 1991 Mar;11(3):following Table of Contents] , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.