A Simple Mechanism for Beyond-Pairwise Correlations in Integrate-and-Fire Neurons

The collective dynamics of neural populations are often characterized in terms of correlations in the spike activity of different neurons. We have developed an understanding of the circuit mechanisms that lead to correlations among cell pairs, but little is known about what determines the population firing statistics among larger groups of cells. Here, we examine this question for a simple, but ubiquitous, circuit feature: common fluctuating input arriving to spiking neurons of integrate-and-fire type. We show that this leads to strong beyond-pairwise correlations—that is, correlations that cannot be captured by maximum entropy models that extrapolate from pairwise statistics—as for earlier work with discrete threshold crossing (dichotomous Gaussian) models. Moreover, we find that the same is true for another widely used, doubly stochastic model of neural spiking, the linear–nonlinear cascade. We demonstrate the strong connection between the collective dynamics produced by integrate-and-fire and dichotomous Gaussian models, and show that the latter is a surprisingly accurate model of the former. Our conclusion is that beyond-pairwise correlations can be both broadly expected and possible to describe by simplified (and tractable) statistical models.

[1]  Jonathon Shlens,et al.  The Structure of Multi-Neuron Firing Patterns in Primate Retina , 2006, The Journal of Neuroscience.

[2]  Brent Doiron,et al.  Theory of oscillatory firing induced by spatially correlated noise and delayed inhibitory feedback. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[3]  Jianhua Lin,et al.  Divergence measures based on the Shannon entropy , 1991, IEEE Trans. Inf. Theory.

[4]  Michael J. Berry,et al.  Weak pairwise correlations imply strongly correlated network states in a neural population , 2005, Nature.

[5]  Eric Shea-Brown,et al.  Input nonlinearities can shape beyond-pairwise correlations and improve information transmission by neural populations. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[6]  Benjamin Lindner,et al.  Information filtering by synchronous spikes in a neural population , 2012, Journal of Computational Neuroscience.

[7]  M. Bethge,et al.  Common input explains higher-order correlations and entropy in a simple model of neural population activity. , 2011, Physical review letters.

[8]  Michael J. Berry,et al.  Synergy, Redundancy, and Independence in Population Codes , 2003, The Journal of Neuroscience.

[9]  Nicolas Brunel,et al.  From Spiking Neuron Models to Linear-Nonlinear Models , 2011, PLoS Comput. Biol..

[10]  Ifije E. Ohiorhenuan,et al.  Sparse coding and high-order correlations in fine-scale cortical networks , 2010, Nature.

[11]  Michael J. Berry,et al.  Searching for Collective Behavior in a Large Network of Sensory Neurons , 2013, PLoS Comput. Biol..

[12]  Eric Shea-Brown,et al.  Correlation and synchrony transfer in integrate-and-fire neurons: basic properties and consequences for coding. , 2008, Physical review letters.

[13]  Bruno A. Olshausen,et al.  Modeling Higher-Order Correlations within Cortical Microcolumns , 2014, PLoS Comput. Biol..

[14]  Jaime de la Rocha,et al.  Supplementary Information for the article ‘ Correlation between neural spike trains increases with firing rate ’ , 2007 .

[15]  R K Powers,et al.  Relationship between simulated common synaptic input and discharge synchrony in cat spinal motoneurons. , 2001, Journal of neurophysiology.

[16]  F. Rieke,et al.  Origin of correlated activity between parasol retinal ganglion cells , 2008, Nature Neuroscience.

[17]  Stefano Panzeri,et al.  The impact of high-order interactions on the rate of synchronous discharge and information transmission in somatosensory cortex , 2009, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[18]  C. Gray,et al.  Higher Order Correlations within Cortical Layers Dominate Functional Connectivity in Microcolumns , 2012, 1301.0050.

[19]  W. Newsome,et al.  The Variable Discharge of Cortical Neurons: Implications for Connectivity, Computation, and Information Coding , 1998, The Journal of Neuroscience.

[20]  Yutaka Sakai,et al.  Synchronous Firing and Higher-Order Interactions in Neuron Pool , 2003, Neural Computation.

[21]  Eric Shea-Brown,et al.  Triplet correlations among similarly tuned cells impact population coding , 2015, Front. Comput. Neurosci..

[22]  Jonathon Shlens,et al.  The Structure of Large-Scale Synchronized Firing in Primate Retina , 2009, The Journal of Neuroscience.

[23]  L. Paninski,et al.  Common-input models for multiple neural spike-train data , 2007, Network.

[24]  D. Hansel,et al.  How Spike Generation Mechanisms Determine the Neuronal Response to Fluctuating Inputs , 2003, The Journal of Neuroscience.

[25]  Eric Shea-Brown,et al.  When do microcircuits produce beyond-pairwise correlations? , 2014, Front. Comput. Neurosci..

[26]  Günther Palm,et al.  Detecting higher-order interactions among the spiking events in a group of neurons , 1995, Biological Cybernetics.

[27]  M. J. Richardson,et al.  Firing-rate response of linear and nonlinear integrate-and-fire neurons to modulated current-based and conductance-based synaptic drive. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[28]  Eero P. Simoncelli,et al.  Spatio-temporal correlations and visual signalling in a complete neuronal population , 2008, Nature.

[29]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[30]  Peter E. Latham,et al.  Pairwise Maximum Entropy Models for Studying Large Biological Systems: When They Can Work and When They Can't , 2008, PLoS Comput. Biol..

[31]  Shan Yu,et al.  Higher-Order Interactions Characterized in Cortical Activity , 2011, The Journal of Neuroscience.

[32]  Eric Shea-Brown,et al.  When are feedforward microcircuits well-modeled by maximum entropy methods? , 2010, ArXiv.

[33]  Sonja Grün,et al.  CuBIC: cumulant based inference of higher-order correlations in massively parallel spike trains , 2009, Journal of Computational Neuroscience.

[34]  R. Segev,et al.  Sparse low-order interaction network underlies a highly correlated and learnable neural population code , 2011, Proceedings of the National Academy of Sciences.

[35]  R. Kass,et al.  Multiple neural spike train data analysis: state-of-the-art and future challenges , 2004, Nature Neuroscience.

[36]  Bruno A. Olshausen,et al.  Book Review , 2003, Journal of Cognitive Neuroscience.

[37]  William R. Softky,et al.  The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.