Implicit encoding of prior probabilities in optimal neural populations

Optimal coding provides a guiding principle for understanding the representation of sensory variables in neural populations. Here we consider the influence of a prior probability distribution over sensory variables on the optimal allocation of neurons and spikes in a population. We model the spikes of each cell as samples from an independent Poisson process with rate governed by an associated tuning curve. For this response model, we approximate the Fisher information in terms of the density and amplitude of the tuning curves, under the assumption that tuning width varies inversely with cell density. We consider a family of objective functions based on the expected value, over the sensory prior, of a functional of the Fisher information. This family includes lower bounds on mutual information and perceptual discriminability as special cases. In all cases, we find a closed form expression for the optimum, in which the density and gain of the cells in the population are power law functions of the stimulus prior. This also implies a power law relationship between the prior and perceptual discriminability. We show preliminary evidence that the theory successfully predicts the relationship between empirically measured stimulus priors, physiologically measured neural response properties (cell density, tuning widths, and firing rates), and psychophysically measured discrimination thresholds.

[1]  J. H. Hateren,et al.  Independent component filters of natural images compared with simple cells in primary visual cortex , 1998 .

[2]  Allen Gersho,et al.  Vector quantization and signal compression , 1991, The Kluwer international series in engineering and computer science.

[3]  H Sompolinsky,et al.  Simple models for reading neuronal population codes. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[4]  Simoncelli Eero Bayesian line orientation perception: Human prior expectations match natural image statistics , 2010 .

[5]  J. Movshon,et al.  Nature and interaction of signals from the receptive field center and surround in macaque V1 neurons. , 2002, Journal of neurophysiology.

[6]  P. Berkes,et al.  Statistically Optimal Perception and Learning: from Behavior to Neural Representations , 2022 .

[7]  Terry Caelli,et al.  Discrimination thresholds in the two-dimensional spatial frequency domain , 1983, Vision Research.

[8]  D. Knill,et al.  The Bayesian brain: the role of uncertainty in neural coding and computation , 2004, Trends in Neurosciences.

[9]  D. Macleod,et al.  Optimal nonlinear codes for the perception of natural colours , 2001, Network.

[10]  J. Nadal,et al.  Nonlinear neurons in the low-noise limit: a factorial code maximizes information transfer Network 5 , 1994 .

[11]  J. V. van Hateren,et al.  Independent component filters of natural images compared with simple cells in primary visual cortex , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[12]  Terence D Sanger,et al.  Neural population codes , 2003, Current Opinion in Neurobiology.

[13]  D Regan,et al.  Spatial frequency discrimination in normal vision and in patients with multiple sclerosis. , 1982, Brain : a journal of neurology.

[14]  Alexandre Pouget,et al.  Probabilistic Interpretation of Population Codes , 1996, Neural Computation.

[15]  Alan A. Stocker,et al.  Is the Homunculus Aware of Sensory Adaptation? , 2009, Neural Computation.

[16]  Haim Sompolinsky,et al.  Implications of Neuronal Diversity on Population Coding , 2006, Neural Computation.

[17]  S. Laughlin A Simple Coding Procedure Enhances a Neuron's Information Capacity , 1981, Zeitschrift fur Naturforschung. Section C, Biosciences.

[18]  Peter E. Latham,et al.  Narrow Versus Wide Tuning Curves: What's Best for a Population Code? , 1999, Neural Computation.

[19]  Terrence J. Sejnowski,et al.  Neuronal Tuning: To Sharpen or Broaden? , 1999, Neural Computation.

[20]  Anthony J. Movshon,et al.  Optimal representation of sensory information by neural populations , 2006, Nature Neuroscience.

[21]  W. Michael Brown,et al.  Optimal Neuronal Tuning for Finite Stimulus Spaces , 2004, Neural Computation.

[22]  Matthias Bethge,et al.  Optimal Short-Term Population Coding: When Fisher Information Fails , 2002, Neural Computation.

[23]  R. Mansfield,et al.  Neural Basis of Orientation Perception in Primate Vision , 1974, Science.

[24]  Alexander S. Ecker,et al.  Neurometric function analysis of short-term population codes , 2009 .

[25]  R. Zemel,et al.  Inference and computation with population codes. , 2003, Annual review of neuroscience.

[26]  M. Kendall Theoretical Statistics , 1956, Nature.

[27]  J. Movshon,et al.  Selectivity and spatial distribution of signals from the receptive field surround in macaque V1 neurons. , 2002, Journal of neurophysiology.

[28]  Terrence J. Sejnowski,et al.  Spatiochromatic Receptive Field Properties Derived from Information-Theoretic Analyses of Cone Mosaic Responses to Natural Scenes , 2003, Neural Computation.

[29]  Ehud Zohary,et al.  Correlated neuronal discharge rate and its implications for psychophysical performance , 1994, Nature.

[30]  Eero P. Simoncelli Optimal Estimation in Sensory Systems , 2009 .

[31]  Mark D. McDonnell,et al.  Maximally Informative Stimuli and Tuning Curves for Sigmoidal Rate-Coding Neurons with Quasi-Poisson Variability , 2008 .

[32]  Wei Ji Ma,et al.  Bayesian inference with probabilistic population codes , 2006, Nature Neuroscience.

[33]  Nicolas Brunel,et al.  Mutual Information, Fisher Information and Population Coding Submitted to Neural Computation , 1998 .

[34]  Marcelo A. Montemurro,et al.  Optimal Tuning Widths in Population Coding of Periodic Variables , 2006, Neural Computation.

[35]  David McAlpine,et al.  Optimal neural population coding of an auditory spatial cue , 2004, Nature.