Generating Spike Trains with Specified Correlation Coefficients

Spike trains recorded from populations of neurons can exhibit substantial pairwise correlations between neurons and rich temporal structure. Thus, for the realistic simulation and analysis of neural systems, it is essential to have efficient methods for generating artificial spike trains with specified correlation structure. Here we show how correlated binary spike trains can be simulated by means of a latent multivariate gaussian model. Sampling from the model is computationally very efficient and, in particular, feasible even for large populations of neurons. The entropy of the model is close to the theoretical maximum for a wide range of parameters. In addition, this framework naturally extends to correlations over time and offers an elegant way to model correlated neural spike counts with arbitrary marginal distributions.

[1]  I. Good,et al.  The Maximum Entropy Formalism. , 1979 .

[2]  N. Higham.  Computing the nearest correlation matrix—a problem from finance , 2002 .

[3]  A. Qu,et al.  Consistent Model Selection for Marginal Generalized Additive Model for Correlated Data , 2010 .

[4]  Shy Shoham,et al.  Correlation-distortion based identification of Linear-Nonlinear-Poisson models , 2009, Journal of Computational Neuroscience.

[5]  B. Sakmann,et al.  Whisker movements evoked by stimulation of single pyramidal cells in rat motor cortex , 2004, Nature.

[6]  Michael J. Berry,et al.  Weak pairwise correlations imply strongly correlated network states in a neural population , 2005, Nature.

[7]  Jonathan D Victor,et al.  Analyzing the activity of large populations of neurons: how tractable is the problem? , 2007, Current Opinion in Neurobiology.

[8]  Shy Shoham,et al.  Multivariate Autoregressive Modeling and Granger Causality Analysis of Multiple Spike Trains , 2010, Comput. Intell. Neurosci..

[9]  R Clay Reid,et al.  Demonstration of artificial visual percepts generated through thalamic microstimulation , 2007, Proceedings of the National Academy of Sciences.

[10]  Peter Dayan,et al.  The Effect of Correlated Variability on the Accuracy of a Population Code , 1999, Neural Computation.

[11]  Rick L. Jenison,et al.  The Shape of Neural Dependence , 2004, Neural Computation.

[12]  Michael J. Berry,et al.  Synergy, Redundancy, and Independence in Population Codes , 2003, The Journal of Neuroscience.

[13]  Matthias Bethge,et al.  Near-Maximum Entropy Models for Binary Neural Representations of Natural Images , 2007, NIPS.

[14]  H. Block,et al.  A Multivariate Extension of Hoeffding's Lemma. , 1988 .

[15]  Matthias Bethge,et al.  Bayesian Inference for Spiking Neuron Models with a Sparsity Prior , 2007, NIPS.

[16]  H. Joe,et al.  Range of correlation matrices for dependent Bernoulli random variables , 2006 .

[17]  Simon Haykin,et al.  On Different Facets of Regularization Theory , 2002, Neural Computation.

[18]  R. Nelsen.  Discrete bivariate distributions with given marginals and correlation , 1987 .

[19]  F. Mechler,et al.  Independent and Redundant Information in Nearby Cortical Neurons , 2001, Science.

[20]  W. Bair,et al.  Correlated Firing in Macaque Visual Area MT: Time Scales and Relationship to Behavior , 2001, The Journal of Neuroscience.

[21]  R. Zemel,et al.  Inference and computation with population codes. , 2003, Annual review of neuroscience.

[22]  Simon R. Schultz,et al.  The Ising decoder: reading out the activity of large neural ensembles , 2010, Journal of Computational Neuroscience.

[23]  Ehud Zohary,et al.  Correlated neuronal discharge rate and its implications for psychophysical performance , 1994, Nature.

[24]  Michael Satosi Watanabe,et al.  Information Theoretical Analysis of Multivariate Correlation , 1960, IBM J. Res. Dev..

[25]  John M. Beggs,et al.  A Maximum Entropy Model Applied to Spatial and Temporal Correlations from Cortical Networks In Vitro , 2008, The Journal of Neuroscience.

[26]  R. Reid,et al.  Precisely correlated firing in cells of the lateral geniculate nucleus , 1996, Nature.

[27]  Jonathon Shlens,et al.  The Structure of Multi-Neuron Firing Patterns in Primate Retina , 2006, The Journal of Neuroscience.

[28]  Alan J. Lee,et al.  Generating Random Binary Deviates Having Fixed Marginal Distributions and Specified Degrees of Association , 1993 .

[29]  Kazutomo Kawamura,et al.  The structure of multivariate Poisson distribution , 1979 .

[30]  D. Baylor,et al.  Concerted Signaling by Retinal Ganglion Cells , 1995, Science.

[31]  Shun-ichi Amari,et al.  Conditional Mixture Model for Correlated Neuronal Spikes , 2010, Neural Computation.

[32]  Wolff,et al.  Collective Monte Carlo updating for spin systems. , 1989, Physical review letters.

[33]  S. Sherman.  Tonic and burst firing: dual modes of thalamocortical relay , 2001, Trends in Neurosciences.

[34]  A. Dawid,et al.  Game theory, maximum entropy, minimum discrepancy and robust Bayesian decision theory , 2004, math/0410076.

[35]  Alexander S. Ecker,et al.  Recording chronically from the same neurons in awake, behaving primates. , 2007, Journal of neurophysiology.

[36]  William T. Newsome,et al.  Cortical microstimulation influences perceptual judgements of motion direction , 1990, Nature.

[37]  Karl Pearson,et al.  ON A NEW METHOD OF DETERMINING CORRELATION BETWEEN A MEASURED CHARACTER A, AND A CHARACTER B, OF WHICH ONLY THE PERCENTAGE OF CASES WHEREIN B EXCEEDS (OR FALLS SHORT OF) A GIVEN INTENSITY IS RECORDED FOR EACH GRADE OF A , 1909 .

[38]  S. Gange.  Generating Multivariate Categorical Variates Using the Iterative Proportional Fitting Algorithm , 1995 .

[39]  A. Pouget,et al.  Neural correlations, population coding and computation , 2006, Nature Reviews Neuroscience.

[40]  B D. R. COX.  On some models for multivariate binary variables parallel in complexity with the multivariate Gaussian distribution , 2002 .

[41]  Shane G. Henderson,et al.  Behavior of the NORTA method for correlated random vector generation as the dimension increases , 2003, TOMC.

[42]  TJ Gawne,et al.  How independent are the messages carried by adjacent inferior temporal cortical neurons? , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[43]  Robert E. Schapire,et al.  Faster solutions of the inverse pairwise Ising problem , 2008 .

[44]  Alexander S. Ecker,et al.  Studying the effects of noise correlations on population coding using a sampling method , 2007 .

[45]  A. D. Lunn,et al.  A note on generating correlated binary variables , 1998 .

[46]  Ernst Niebur,et al.  Generation of Synthetic Spike Trains with Defined Pairwise Correlations , 2007, Neural Computation.

[47]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[48]  Masato Okada,et al.  Analytical investigation of the effects of lateral connections on the accuracy of population coding. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[49]  M. A. Smith,et al.  Stimulus Dependence of Neuronal Correlation in Primary Visual Cortex of the Macaque , 2005, The Journal of Neuroscience.

[50]  E. T. Jaynes,et al.  Where do we Stand on Maximum Entropy , 1979 .

[51]  Haim Sompolinsky,et al.  Learning Input Correlations through Nonlinear Temporally Asymmetric Hebbian Plasticity , 2003, The Journal of Neuroscience.

[52]  Robert E. Kass,et al.  Spike Count Correlation Increases with Length of Time Interval in the Presence of Trial-to-Trial Variation , 2006, Neural Computation.

[53]  K. Deisseroth,et al.  Millisecond-timescale, genetically targeted optical control of neural activity , 2005, Nature Neuroscience.

[54]  Robert E Kass,et al.  Statistical assessment of time-varying dependency between two neurons. , 2005, Journal of neurophysiology.

[55]  C. Park,et al.  A Simple Method for Generating Correlated Binary Variates , 1996 .

[56]  Bahjat F. Qaqish,et al.  A family of multivariate binary distributions for simulating correlated binary variables with specified marginal means and correlations , 2003 .

[57]  K. Svoboda,et al.  Sparse optical microstimulation in barrel cortex drives learned behaviour in freely moving mice , 2008, Nature.

[58]  D. Mastronarde.  Correlated firing of cat retinal ganglion cells. I. Spontaneously active inputs to X- and Y-cells. , 1983, Journal of neurophysiology.

[59]  G. Buzsáki.  Large-scale recording of neuronal ensembles , 2004, Nature Neuroscience.

[60]  Shy Shoham,et al.  Generation of Spike Trains with Controlled Auto- and Cross-Correlation Functions , 2009, Neural Computation.

[61]  Sheila Nirenberg,et al.  Decoding neuronal spike trains: How important are correlations? , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[62]  Shun-ichi Amari,et al.  Information geometry on hierarchy of probability distributions , 2001, IEEE Trans. Inf. Theory.

[63]  Sonja Grün,et al.  CuBIC: cumulant based inference of higher-order correlations in massively parallel spike trains , 2009, Journal of Computational Neuroscience.

[64]  Wang,et al.  Nonuniversal critical dynamics in Monte Carlo simulations. , 1987, Physical review letters.

[65]  D. Snodderly,et al.  Response Variability of Neurons in Primary Visual Cortex (V1) of Alert Monkeys , 1997, The Journal of Neuroscience.

[66]  C. Genest,et al.  A Primer on Copulas for Count Data , 2007, ASTIN Bulletin.

[67]  M. A. Smith,et al.  The Role of Correlations in Direction and Contrast Coding in the Primary Visual Cortex , 2007, The Journal of Neuroscience.

[68]  M. Piedmonte,et al.  A Method for Generating High-Dimensional Multivariate Binary Variates , 1991 .