The most informative neural code accounts for population heterogeneity

Sensory perception depends on the accurate representation of the external world by neuronal populations. Each neuron’s contribution to a population code depends on its tuning preferences, but neuronal populations are heterogeneous: their spiking rate, spiking variability and tuning selectivity are all different. To understand how this heterogeneity impacts a neuron’s contribution to the population code, we recorded responses to moving stimuli from motion-sensitive neurons in anaesthetized marmosets (Callithrix jacchus) and trained linear decoders to discriminate direction using these responses. The relationship between a neuron’s preferred direction and the discrimination boundary was the strongest predictor of its decoding weight, and highly direction selective neurons are the most useful in the population code. Millisecond-timescale changes in neuronal responses mean that optimal weights change rapidly; however, perceptual readouts do not have this fine-grained temporal flexibility, and must perform sub-optimal decoding at each point in time. Author Summary It is widely understood that perception depends upon interpreting, or decoding, the pattern of activity across a neuronal population. To do this, firing rates from hundreds of sensory neurons must be weighted and combined to accurately represent stimulus properties. Despite the reality of a diverse, heterogeneous population of neurons, all we know is that their weighting is a function of the relationship between their tuning preference, and the decoding decision or perceptual task under consideration. In this manuscript we ask: which neurons in a heterogeneous population are the most informative, can their usefulness can be predicted by their response properties, and to what degree can we expect them to be optimized? We addressed this question using a machine learning approach to learn how to weight each neuron’s response in order to perform a range of discrimination tasks, and fit a series of decoding models to show that models based on preferred direction alone are significantly improved if neurons that are more selective are weighted more strongly. These results show that we can perform better decoding without machine learning if we address the false assumption that all members of the neural population are equally informative. Competing interests The authors have declared that no competing interests exist. Funding This work was funded by Australia’s National Health and Medical Research Council, the Human Frontier Science Program, and the Australian Research Council. Author Contributions EZ and NSCP designed the study, EZ, HHY, MGPR, and NSCP ran the experiments, EZ performed the analysis and modelling, EZ and NSCP wrote the paper.

[1]  Bart Krekelberg,et al.  Adaptation in macaque MT reduces perceived speed and improves speed discrimination. , 2006, Journal of neurophysiology.

[2]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[3]  Maxwell H. Turner,et al.  Direction-Selective Circuits Shape Noise to Ensure a Precise Population Code , 2016, Neuron.

[4]  Terrence J. Sejnowski,et al.  Neuronal Tuning: To Sharpen or Broaden? , 1999, Neural Computation.

[5]  R. Zemel,et al.  Inference and computation with population codes. , 2003, Annual review of neuroscience.

[6]  Dennis L Barbour,et al.  Rate, not selectivity, determines neuronal population coding accuracy in auditory cortex , 2017, PLoS biology.

[7]  J. Movshon,et al.  A new perceptual illusion reveals mechanisms of sensory decoding , 2007, Nature.

[8]  William Bialek,et al.  Reading a Neural Code , 1991, NIPS.

[9]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[10]  Adam J. Sachs,et al.  Correlated variability modifies working memory fidelity in primate prefrontal neuronal ensembles , 2017, Proceedings of the National Academy of Sciences.

[11]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[12]  R. Desimone,et al.  Columnar organization of directionally selective cells in visual area MT of the macaque. , 1984, Journal of neurophysiology.

[13]  D. Bradley,et al.  Neural population code for fine perceptual decisions in area MT , 2005, Nature Neuroscience.

[14]  John H. R. Maunsell,et al.  Functional properties of neurons in middle temporal visual area of the macaque monkey. II. Binocular interactions and sensitivity to binocular disparity. , 1983, Journal of neurophysiology.

[15]  K. H. Britten,et al.  Motion adaptation in area MT. , 2002, Journal of neurophysiology.

[16]  K. H. Britten,et al.  Neuronal correlates of a perceptual decision , 1989, Nature.

[17]  M. Carandini,et al.  The Nature of Shared Cortical Variability , 2015, Neuron.

[18]  G. DeAngelis,et al.  Contribution of Middle Temporal Area to Coarse Depth Discrimination: Comparison of Neuronal and Psychophysical Sensitivity , 2003, The Journal of Neuroscience.

[19]  R. Gregory The Most Expensive Painting in the World , 2007, Perception.

[20]  Duje Tadin,et al.  Perceptual and neural consequences of rapid motion adaptation , 2011, Proceedings of the National Academy of Sciences.

[21]  John W Morley,et al.  Spatial precision of population activity in primate area MT. , 2015, Journal of neurophysiology.

[22]  Nicholas J. Priebe,et al.  The Neural Representation of Speed in Macaque Area MT/V5 , 2003, The Journal of Neuroscience.

[23]  Rava Azeredo da Silveira,et al.  Structures of Neural Correlation and How They Favor Coding , 2016, Neuron.

[24]  Peter E. Latham,et al.  Narrow Versus Wide Tuning Curves: What's Best for a Population Code? , 1999, Neural Computation.

[25]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[26]  W. Newsome,et al.  A selective impairment of motion perception following lesions of the middle temporal visual area (MT) , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[27]  Samuel G. Solomon,et al.  Dynamic population codes of multiplexed stimulus features in primate area MT. , 2017, Journal of neurophysiology.

[28]  A. Pouget,et al.  Tuning curve sharpening for orientation selectivity: coding efficiency and the impact of correlations , 2004, Nature Neuroscience.

[29]  Leo L. Lui,et al.  Spatial and temporal frequency selectivity of neurons in the middle temporal visual area of new world monkeys (Callithrix jacchus) , 2007, The European journal of neuroscience.

[30]  Elise G. Rowe,et al.  Rapid Adaptation Induces Persistent Biases in Population Codes for Visual Motion , 2016, The Journal of Neuroscience.

[31]  P. Dayan,et al.  Space and time in visual context , 2007, Nature Reviews Neuroscience.

[32]  Alexander S. Ecker,et al.  The Effect of Noise Correlations in Populations of Diversely Tuned Neurons , 2011, The Journal of Neuroscience.

[33]  Marcello G P Rosa,et al.  Preparation for the in vivo recording of neuronal responses in the visual cortex of anaesthetised marmosets (Callithrix jacchus). , 2003, Brain research. Brain research protocols.

[34]  M. Rosa,et al.  Uniformity and diversity of response properties of neurons in the primary visual cortex: Selectivity for orientation, direction of motion, and stimulus size from center to far periphery , 2013, Visual Neuroscience.

[35]  Julio C. Martinez-Trujillo,et al.  Sharp emergence of feature-selective sustained activity along the dorsal visual pathway , 2014, Nature Neuroscience.

[36]  A. Pouget,et al.  Correlations and Neuronal Population Information. , 2016, Annual review of neuroscience.

[37]  Trevor Hastie,et al.  Regularization Paths for Generalized Linear Models via Coordinate Descent. , 2010, Journal of statistical software.

[38]  Frank Bremmer,et al.  Eye-Position Signals in the Dorsal Visual System Are Accurate and Precise on Short Timescales , 2013, The Journal of Neuroscience.

[39]  Anthony J. Movshon,et al.  Optimal representation of sensory information by neural populations , 2006, Nature Neuroscience.

[40]  Arnulf B. A. Graf,et al.  Decoding the activity of neuronal populations in macaque primary visual cortex , 2011, Nature Neuroscience.

[41]  Wei Ji Ma,et al.  A Fast and Simple Population Code for Orientation in Primate V1 , 2012, The Journal of Neuroscience.

[42]  S. Petersen,et al.  Direction-specific adaptation in area MT of the owl monkey , 1985, Brain Research.

[43]  H Sompolinsky,et al.  Simple models for reading neuronal population codes. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[44]  Emilio Salinas,et al.  Vector reconstruction from firing rates , 1994, Journal of Computational Neuroscience.

[45]  Maoz Shamir,et al.  Emerging principles of population coding: in search for the neural code , 2014, Current Opinion in Neurobiology.

[46]  R. Born,et al.  Adaptation to Speed in Macaque Middle Temporal and Medial Superior Temporal Areas , 2013, The Journal of Neuroscience.

[47]  Denis G. Pelli,et al.  ECVP '07 Abstracts , 2007, Perception.