Tuning curve sharpening for orientation selectivity: coding efficiency and the impact of correlations

Several studies have shown that the information conveyed by bell-shaped tuning curves increases as their width decreases, leading to the notion that sharpening of tuning curves improves population codes. This notion, however, is based on assumptions that the noise distribution is independent among neurons and independent of the tuning curve width. Here we reexamine these assumptions in networks of spiking neurons by using orientation selectivity as an example. We compare two principal classes of model: one in which the tuning curves are sharpened through cortical lateral interactions, and one in which they are not. We report that sharpening through lateral interactions does not improve population codes but, on the contrary, leads to a severe loss of information. In addition, the sharpening models generate complicated codes that rely extensively on pairwise correlations. Our study generates several experimental predictions that can be used to distinguish between these two classes of model.

[1]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[2]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[3]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[4]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[5]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[6]  H. Spitzer,et al.  Increased attention enhances both behavioral and neuronal performance. , 1988, Science.

[7]  Steven W. Zucker,et al.  Two Stages of Curve Detection Suggest Two Styles of Visual Computation , 1989, Neural Computation.

[8]  K. H. Britten,et al.  Neuronal correlates of a perceptual decision , 1989, Nature.

[9]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[10]  H Sompolinsky,et al.  Simple models for reading neuronal population codes. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[11]  William R. Softky,et al.  The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[12]  Ehud Zohary,et al.  Correlated neuronal discharge rate and its implications for psychophysical performance , 1994, Nature.

[13]  H. Sompolinsky,et al.  Theory of orientation tuning in visual cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[14]  S. Nelson,et al.  An emergent model of orientation selectivity in cat visual cortical simple cells , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[15]  R. Shapley,et al.  New perspectives on the mechanisms for orientation selectivity , 1997, Current Opinion in Neurobiology.

[16]  Terrence R. Stanford,et al.  A neuronal population code for sound localization , 1997, Nature.

[17]  Peter E. Latham,et al.  Statistically Efficient Estimation Using Population Coding , 1998, Neural Computation.

[18]  Nicholas J. Priebe,et al.  Contrast-Invariant Orientation Tuning in Cat Visual Cortex: Thalamocortical Input Tuning and Correlation-Based Intracortical Connectivity , 1998, The Journal of Neuroscience.

[19]  A. P. Georgopoulos,et al.  Variability and Correlated Noise in the Discharge of Neurons in Motor and Parietal Areas of the Primate Cortex , 1998, The Journal of Neuroscience.

[20]  B. Richmond,et al.  Coding strategies in monkey V1 and inferior temporal cortices. , 1998, Journal of neurophysiology.

[21]  Haim Sompolinsky,et al.  The Effect of Correlations on the Fisher Information of Population Codes , 1998, NIPS.

[22]  Zhaoping Li,et al.  A Neural Model of Contour Integration in the Primary Visual Cortex , 1998, Neural Computation.

[23]  Peter Dayan,et al.  The Effect of Correlated Variability on the Accuracy of a Population Code , 1999, Neural Computation.

[24]  D. Field,et al.  Integration of contours: new insights , 1999, Trends in Cognitive Sciences.

[25]  C. Koch,et al.  Attention activates winner-take-all competition among visual filters , 1999, Nature Neuroscience.

[26]  R. Shapley,et al.  A neuronal network model of macaque primary visual cortex (V1): orientation selectivity and dynamics in the input layer 4Calpha. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[27]  D. Ferster,et al.  Neural mechanisms of orientation selectivity in the visual cortex. , 2000, Annual review of neuroscience.

[28]  Si Wu,et al.  Population Coding with Correlation and an Unfaithful Model , 2001, Neural Computation.

[29]  G. Orban,et al.  Practising orientation identification improves orientation coding in V1 neurons , 2001, Nature.

[30]  P. Latham,et al.  Retinal ganglion cells act largely as independent encoders , 2001, Nature.

[31]  W Gerstner,et al.  Effect of lateral connections on the accuracy of the population code for a network of spiking neurons. , 2001, Network.

[32]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[33]  A. Pouget,et al.  Efficient computation and cue integration with noisy population codes , 2001, Nature Neuroscience.

[34]  Steven Reece,et al.  An information theoretic approach to the contributions of the firing rates and the correlations between the firing of neurons. , 2003, Journal of neurophysiology.

[35]  M. Diamond,et al.  Decoding neuronal population activity in rat somatosensory cortex: role of columnar organization. , 2003, Cerebral cortex.

[36]  Y. Frégnac,et al.  The “silent” surround of V1 receptive fields: theory and experiments , 2003, Journal of Physiology-Paris.

[37]  Daeyeol Lee,et al.  Neural Noise and Movement-Related Codes in the Macaque Supplementary Motor Area , 2003, The Journal of Neuroscience.

[38]  Sheila Nirenberg,et al.  Decoding neuronal spike trains: How important are correlations? , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[39]  Lyle J. Graham,et al.  Orientation and Direction Selectivity of Synaptic Inputs in Visual Cortical Neurons A Diversity of Combinations Produces Spike Tuning , 2003, Neuron.

[40]  N. Qian,et al.  Learning and adaptation in a recurrent model of V1 orientation selectivity. , 2003, Journal of neurophysiology.

[41]  R. Shapley,et al.  Dynamics of Orientation Selectivity in the Primary Visual Cortex and the Importance of Cortical Inhibition , 2003, Neuron.

[42]  Peter E. Latham,et al.  Optimal computation with attractor networks , 2003, Journal of Physiology-Paris.

[43]  M. Paradiso,et al.  A theory for the use of visual orientation information which exploits the columnar structure of striate cortex , 2004, Biological Cybernetics.

[44]  Haim Sompolinsky,et al.  Nonlinear Population Codes , 2004, Neural Computation.

[45]  E. Wojciulik,et al.  Attention increases neural selectivity in the human lateral occipital complex , 2004, Nature Neuroscience.

[46]  R. Freeman,et al.  Orientation selectivity in the cat's striate cortex is invariant with stimulus contrast , 2004, Experimental Brain Research.

[47]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[48]  Michael I. Jordan,et al.  An Introduction to Variational Methods for Graphical Models , 1999, Machine Learning.

[49]  J. Maunsell,et al.  The Effect of Perceptual Learning on Neuronal Responses in Monkey Visual Area V4 , 2004, The Journal of Neuroscience.

[50]  Philipp Slusallek,et al.  Introduction to real-time ray tracing , 2005, SIGGRAPH Courses.