The Variable Discharge of Cortical Neurons: Implications for Connectivity, Computation, and Information Coding

Cortical neurons exhibit tremendous variability in the number and temporal distribution of spikes in their discharge patterns. Furthermore, this variability appears to be conserved over large regions of the cerebral cortex, suggesting that it is neither reduced nor expanded from stage to stage within a processing pathway. To investigate the principles underlying such statistical homogeneity, we have analyzed a model of synaptic integration incorporating a highly simplified integrate and fire mechanism with decay. We analyzed a “high-input regime” in which neurons receive hundreds of excitatory synaptic inputs during each interspike interval. To produce a graded response in this regime, the neuron must balance excitation with inhibition. We find that a simple integrate and fire mechanism with balanced excitation and inhibition produces a highly variable interspike interval, consistent with experimental data. Detailed information about the temporal pattern of synaptic inputs cannot be recovered from the pattern of output spikes, and we infer that cortical neurons are unlikely to transmit information in the temporal pattern of spike discharge. Rather, we suggest that quantities are represented as rate codes in ensembles of 50–100 neurons. These column-like ensembles tolerate large fractions of common synaptic input and yet covary only weakly in their spike discharge. We find that an ensemble of 100 neurons provides a reliable estimate of rate in just one interspike interval (10–50 msec). Finally, we derived an expression for the variance of the neural spike count that leads to a stable propagation of signal and noise in networks of neurons—that is, conditions that do not impose an accumulation or diminution of noise. The solution implies that single neurons perform simple algebra resembling averaging, and that more sophisticated computations arise by virtue of the anatomical convergence of novel combinations of inputs to the cortical column from external sources.

[1]  J. Wolfowitz,et al.  An Introduction to the Theory of Statistics , 1951, Nature.

[2]  V. Mountcastle Modality and topographic properties of single neurons of cat's somatic sensory cortex. , 1957, Journal of neurophysiology.

[3]  O. L. Smith,et al.  ON THE CUMULANTS OF RENEWAL PROCESSES , 1959 .

[4]  D. Hubel,et al.  Integrative action in the cat's lateral geniculate body , 1961, The Journal of physiology.

[5]  B. Mandelbrot,et al.  RANDOM WALK MODELS FOR THE SPIKE ACTIVITY OF A SINGLE NEURON. , 1964, Biophysical journal.

[6]  R. Stein A THEORETICAL ANALYSIS OF NEURONAL VARIABILITY. , 1965, Biophysical journal.

[7]  Samuel Karlin,et al.  A First Course on Stochastic Processes , 1968 .

[8]  J. Kingman A FIRST COURSE IN STOCHASTIC PROCESSES , 1967 .

[9]  C. Stevens,et al.  Synaptic noise and other sources of randomness in motoneuron interspike intervals. , 1968, Journal of neurophysiology.

[10]  G. P. Moore,et al.  Statistical signs of synaptic interaction in neurons. , 1970, Biophysical journal.

[11]  J. Stone,et al.  Relay of receptive-field properties in dorsal lateral geniculate nucleus of the cat. , 1972, Journal of neurophysiology.

[12]  Bruce W. Knight,et al.  Dynamics of Encoding in a Population of Neurons , 1972, The Journal of general physiology.

[13]  Franklin A. Graybill,et al.  Introduction to The theory , 1974 .

[14]  G. J. Tomko,et al.  Neuronal variability: non-stationary responses to identical visual stimuli. , 1974, Brain research.

[15]  B. Finlay,et al.  Short-term response variability of monkey striate neurons , 1976, Brain Research.

[16]  V. Mountcastle,et al.  An organizing principle for cerebral function : the unit module and the distributed system , 1978 .

[17]  K O Johnson,et al.  Sensory discrimination: decision process. , 1980, Journal of neurophysiology.

[18]  M. Abeles Role of the cortical neuron: integrator or coincidence detector? , 1982, Israel journal of medical sciences.

[19]  J. Movshon,et al.  The statistical reliability of signals in single neurons in cat and monkey visual cortex , 1983, Vision Research.

[20]  K. Tanaka Cross-correlation analysis of geniculostriate neuronal relationships in cats. , 1983, Journal of neurophysiology.

[21]  T. Poggio,et al.  Nonlinear interactions in a dendritic tree: localization, timing, and role in information processing. , 1983, Proceedings of the National Academy of Sciences of the United States of America.

[22]  D. Oertel Synaptic responses and electrical properties of cells in brain slices of the mouse anteroventral cochlear nucleus , 1983, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[23]  P. Somogyi,et al.  Synaptic connections of morphologically identified and physiologically characterized large basket cells in the striate cortex of cat , 1983, Neuroscience.

[24]  A. Cowey,et al.  Retrograde transport of gamma-amino[3H]butyric acid reveals specific interlaminar connections in the striate cortex of monkey. , 1983, Proceedings of the National Academy of Sciences of the United States of America.

[25]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[26]  A. Parker,et al.  Capabilities of monkey cortical cells in spatial-resolution tasks. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[27]  E. G. Jones,et al.  Vertical organization of gamma-aminobutyric acid-accumulating intrinsic neuronal systems in monkey cerebral cortex , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[28]  D. McCormick,et al.  Comparative electrophysiology of pyramidal and sparsely spiny stellate neurons of the neocortex. , 1985, Journal of neurophysiology.

[29]  T. Wiesel,et al.  Relationships between horizontal interactions and functional architecture in cat striate cortex as revealed by cross-correlation analysis , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[30]  D. Ferster Orientation selectivity of synaptic potentials in neurons of cat primary visual cortex , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[31]  I. Ohzawa,et al.  Visual orientation and spatial frequency discrimination: a comparison of single neurons and behavior. , 1987, Journal of neurophysiology.

[32]  I. Ohzawa,et al.  The effects of contrast on visual orientation and spatial frequency discrimination: a comparison of single cells and behavior. , 1987, Journal of neurophysiology.

[33]  G. Shepherd,et al.  Logic operations are properties of computer-simulated interactions between excitable dendritic spines , 1987, Neuroscience.

[34]  D. Simons,et al.  Membrane potential changes in rat SmI cortical neurons evoked by controlled stimulation of mystacial vibrissae , 1988, Brain Research.

[35]  Eberhard E. Fetz,et al.  Effects of Firing Synchrony on Signal Propagation in Layered Networks , 1989, NIPS.

[36]  T. Wiesel,et al.  Columnar specificity of intrinsic horizontal and corticocortical connections in cat visual cortex , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[37]  Andrew Parker,et al.  Detection and discrimination mechanisms in the striate cortex of Old World monkeys , 1990 .

[38]  Michael S. Landy,et al.  Detection and Discrimination , 1991 .

[39]  R. Douglas,et al.  A functional microcircuit for cat visual cortex. , 1991, The Journal of physiology.

[40]  E. Fetz,et al.  Synaptic Interactions between Cortical Neurons , 1991 .

[41]  Prof. Dr. Valentino Braitenberg,et al.  Anatomy of the Cortex , 1991, Studies of Brain Function.

[42]  D. Whitteridge,et al.  An intracellular analysis of the visual responses of neurones in cat visual cortex. , 1991, The Journal of physiology.

[43]  A. Peters,et al.  Organization of pyramidal neurons in area 17 of monkey visual cortex , 1991, The Journal of comparative neurology.

[44]  K. Stratford,et al.  Synaptic transmission between individual pyramidal neurons of the rat visual cortex in vitro , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[45]  T. M. Mayhew,et al.  Anatomy of the Cortex: Statistics and Geometry. , 1991 .

[46]  Moshe Abeles,et al.  Corticonics: Neural Circuits of Cerebral Cortex , 1991 .

[47]  M. Cynader,et al.  Quantitative distribution of GABA-immunopositive and -immunonegative neurons and synapses in the monkey striate cortex (area 17). , 1992, Cerebral cortex.

[48]  J. Movshon,et al.  The analysis of visual motion: a comparison of neuronal and psychophysical performance , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[49]  W. Singer,et al.  Temporal coding in the visual cortex: new vistas on integration in the nervous system , 1992, Trends in Neurosciences.

[50]  D. Heeger Half-squaring in responses of cat striate cells , 1992, Visual Neuroscience.

[51]  Idan Segev Single neurone models: oversimple, complex and reduced , 1992, Trends in Neurosciences.

[52]  D. Heeger Normalization of cell responses in cat striate cortex , 1992, Visual Neuroscience.

[53]  U. Eysel,et al.  Network of GABAergic large basket cells in cat visual cortex (area 18): Implication for lateral disinhibition , 1993, The Journal of comparative neurology.

[54]  J. Deuchars,et al.  Single axon excitatory postsynaptic potentials in neocortical interneurons exhibit pronounced paired pulse facilitation , 1993, Neuroscience.

[55]  J. B. Levitt,et al.  Comparison of intrinsic connectivity in different areas of macaque monkey cerebral cortex. , 1993, Cerebral cortex.

[56]  B. Connors,et al.  Regenerative activity in apical dendrites of pyramidal cells in neocortex. , 1993, Cerebral cortex.

[57]  A. Reyes,et al.  Two modes of interspike interval shortening by brief transient depolarizations in cat neocortical neurons. , 1993, Journal of neurophysiology.

[58]  A. Thomson,et al.  Fluctuations in pyramid-pyramid excitatory postsynaptic potentials modified by presynaptic firing pattern and postsynaptic membrane potential using paired intracellular recordings in rat neocortex , 1993, Neuroscience.

[59]  J. Deuchars,et al.  Large, deep layer pyramid-pyramid single axon EPSPs in slices of rat motor cortex display paired pulse and frequency-dependent depression, mediated presynaptically and self-facilitation, mediated postsynaptically. , 1993, Journal of neurophysiology.

[60]  TJ Gawne,et al.  How independent are the messages carried by adjacent inferior temporal cortical neurons? , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[61]  T D Albright,et al.  Cortical processing of visual motion. , 1993, Reviews of oculomotor research.

[62]  Bartlett W. Mel Synaptic integration in an excitable dendritic tree. , 1993, Journal of neurophysiology.

[63]  Roberto Malinow,et al.  Measuring the impact of probabilistic transmission on neuronal output , 1993, Neuron.

[64]  E. Vaadia,et al.  Spatiotemporal firing patterns in the frontal cortex of behaving monkeys. , 1993, Journal of neurophysiology.

[65]  R. Malach,et al.  Cortical hierarchy reflected in the organization of intrinsic connections in macaque monkey visual cortex , 1993, The Journal of comparative neurology.

[66]  K. H. Britten,et al.  Responses of neurons in macaque MT to stochastic motion signals , 1993, Visual Neuroscience.

[67]  H Sompolinsky,et al.  Simple models for reading neuronal population codes. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[68]  William R. Softky,et al.  The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[69]  C. Koch,et al.  Amplification and linearization of distal synaptic input to cortical pyramidal cells. , 1994, Journal of neurophysiology.

[70]  R. Frostig,et al.  Cortical point-spread function and long-range lateral interactions revealed by real-time optical imaging of macaque monkey primary visual cortex , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[71]  L. Cauller,et al.  Synaptic physiology of horizontal afferents to layer I in slices of rat SI neocortex , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[72]  S. Nelson,et al.  Orientation selectivity of cortical neurons during intracellular blockade of inhibition. , 1994, Science.

[73]  William R. Softky,et al.  Sub-millisecond coincidence detection in active dendritic trees , 1994, Neuroscience.

[74]  L F Abbott,et al.  Decoding neuronal firing and modelling neural networks , 1994, Quarterly Reviews of Biophysics.

[75]  Eberhard E. Fetz,et al.  Effects of Input Synchrony on the Firing Rate of a Three-Conductance Cortical Neuron Model , 1994, Neural Computation.

[76]  Michael N. Shadlen,et al.  Noise, neural codes and cortical organization , 1994, Current Opinion in Neurobiology.

[77]  W. Newsome,et al.  Neuronal and psychophysical sensitivity to motion signals in extrastriate area MST of the macaque monkey , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[78]  Ehud Zohary,et al.  Correlated neuronal discharge rate and its implications for psychophysical performance , 1994, Nature.

[79]  D. Fitzpatrick,et al.  Patterns of excitation and inhibition evoked by horizontal connections in visual cortex share a common relationship to orientation columns , 1995, Neuron.

[80]  B. Sakmann,et al.  Amplification of EPSPs by axosomatic sodium channels in neocortical pyramidal neurons , 1995, Neuron.

[81]  T. Sejnowski,et al.  Reliability of spike timing in neocortical neurons. , 1995, Science.

[82]  R. Reid,et al.  Specificity of monosynaptic connections from thalamus to visual cortex , 1995, Nature.

[83]  C. Gilbert,et al.  Receptive field expansion in adult visual cortex is linked to dynamic changes in strength of cortical connections. , 1995, Journal of neurophysiology.

[84]  S. Nelson,et al.  An emergent model of orientation selectivity in cat visual cortical simple cells , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[85]  C. Koch,et al.  Recurrent excitation in neocortical circuits , 1995, Science.

[86]  P. Schwindt,et al.  Amplification of synaptic current by persistent sodium conductance in apical dendrite of neocortical neurons. , 1995, Journal of neurophysiology.

[87]  C. Gilbert,et al.  Long-range horizontal connections and their role in cortical reorganization revealed by optical recording of cat primary visual cortex , 1995, Nature.

[88]  F. Wörgötter,et al.  Temporal structure in the light response of relay cells in the dorsal lateral geniculate nucleus of the cat. , 1995, The Journal of physiology.

[89]  J. Bullier,et al.  Structural basis of cortical synchronization. I. Three types of interhemispheric coupling. , 1995, Journal of neurophysiology.

[90]  D. Ferster,et al.  Orientation selectivity of thalamic input to simple cells of cat visual cortex , 1996, Nature.

[91]  K. Martin,et al.  Excitatory synaptic inputs to spiny stellate cells in cat visual cortex , 1996, Nature.

[92]  Anthony J. Movshon,et al.  Visual Response Properties of Striate Cortical Neurons Projecting to Area MT in Macaque Monkeys , 1996, The Journal of Neuroscience.

[93]  C. Gray,et al.  Chattering Cells: Superficial Pyramidal Neurons Contributing to the Generation of Synchronous Oscillations in the Visual Cortex , 1996, Science.

[94]  D. Johnston,et al.  Active properties of neuronal dendrites. , 1996, Annual review of neuroscience.

[95]  Christof Koch,et al.  Temporal Precision of Spike Trains in Extrastriate Cortex of the Behaving Macaque Monkey , 1999, Neural Computation.

[96]  H. Markram,et al.  Redistribution of synaptic efficacy between neocortical pyramidal neurons , 1996, Nature.

[97]  Eero P. Simoncelli,et al.  Computational models of cortical visual processing. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[98]  Y. Frégnac,et al.  Voltage-clamp measurement of visually-evoked conductances with whole-cell patch recordings in primary visual cortex , 1996, Journal of Physiology-Paris.

[99]  William Bialek,et al.  Spikes: Exploring the Neural Code , 1996 .

[100]  A Aertsen,et al.  Propagation of synchronous spiking activity in feedforward neural networks , 1996, Journal of Physiology-Paris.

[101]  W. Singer,et al.  Integrator or coincidence detector? The role of the cortical neuron revisited , 1996, Trends in Neurosciences.

[102]  J. Movshon,et al.  A computational analysis of the relationship between neuronal and behavioral responses to visual motion , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[103]  E. Fetz,et al.  Synaptic Interactions between Primate Precentral Cortex Neurons Revealed by Spike-Triggered Averaging of Intracellular Membrane Potentials In Vivo , 1996, The Journal of Neuroscience.

[104]  A. Grinvald,et al.  Dynamics of Ongoing Activity: Explanation of the Large Variability in Evoked Cortical Responses , 1996, Science.

[105]  M. Meister Multineuronal codes in retinal signaling. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[106]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[107]  J. Deuchars,et al.  Single axon IPSPs elicited in pyramidal cells by three classes of interneurones in slices of rat neocortex. , 1996, The Journal of physiology.

[108]  B Schechter How the Brain Gets Rhythm , 1996, Science.

[109]  Kenneth D. Miller,et al.  Physiological Gain Leads to High ISI Variability in a Simple Model of a Cortical Regular Spiking Cell , 1997, Neural Computation.

[110]  G. Edelman,et al.  Neural dynamics in a model of the thalamocortical system. II. The role of neural synchrony tested through perturbations of spike timing. , 1997, Cerebral cortex.

[111]  D. Johnston,et al.  K+ channel regulation of signal propagation in dendrites of hippocampal pyramidal neurons , 1997, Nature.

[112]  L. Abbott,et al.  Synaptic Depression and Cortical Gain Control , 1997, Science.

[113]  D. Johnston,et al.  Active dendrites reduce location-dependent variability of synaptic input trains. , 1997, Journal of neurophysiology.

[114]  D. Snodderly,et al.  Response Variability of Neurons in Primary Visual Cortex (V1) of Alert Monkeys , 1997, The Journal of Neuroscience.

[115]  Maria V. Sanchez-Vives,et al.  Influence of low and high frequency inputs on spike timing in visual cortical neurons. , 1997, Cerebral cortex.

[116]  T. Wiesel Neural Mechanisms of Visual Perception , 1997 .

[117]  L S Hibbard,et al.  GABAergic Neurons in Barrel Cortex Show Strong, Whisker-Dependent Metabolic Activation during Normal Behavior , 1997, The Journal of Neuroscience.

[118]  M. Carandini,et al.  A tonic hyperpolarization underlying contrast adaptation in cat visual cortex. , 1997, Science.

[119]  D. G. Albrecht,et al.  Visual cortex neurons in monkeys and cats: Detection, discrimination, and identification , 1997, Visual Neuroscience.

[120]  P. Schwindt,et al.  Modification of current transmitted from apical dendrite to soma by blockade of voltage- and Ca2+-dependent conductances in rat neocortical pyramidal neurons. , 1997, Journal of neurophysiology.

[121]  M. Teich,et al.  Fractal character of the neural spike train in the visual system of the cat. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[122]  D. Fitzpatrick,et al.  Orientation Selectivity and the Arrangement of Horizontal Connections in Tree Shrew Striate Cortex , 1997, The Journal of Neuroscience.

[123]  P. Schwindt,et al.  Local and propagated dendritic action potentials evoked by glutamate iontophoresis on rat neocortical pyramidal neurons. , 1997, Journal of neurophysiology.

[124]  Peter E. Latham,et al.  Statistically Efficient Estimation Using Population Coding , 1998, Neural Computation.

[125]  Eero P. Simoncelli,et al.  A model of neuronal responses in visual area MT , 1998, Vision Research.

[126]  L. P. O'Keefe,et al.  The influence of fixational eye movements on the response of neurons in area MT of the macaque , 1998, Visual Neuroscience.

[127]  A. P. Georgopoulos,et al.  Variability and Correlated Noise in the Discharge of Neurons in Motor and Parietal Areas of the Primate Cortex , 1998, The Journal of Neuroscience.

[128]  Richard Cb Slack,et al.  Measuring the Impact , 1998 .