How Structure Determines Correlations in Neuronal Networks

Networks are becoming a ubiquitous metaphor for the understanding of complex biological systems, spanning the range between molecular signalling pathways, neural networks in the brain, and interacting species in a food web. In many models, we face an intricate interplay between the topology of the network and the dynamics of the system, which is generally very hard to disentangle. A dynamical feature that has been subject of intense research in various fields are correlations between the noisy activity of nodes in a network. We consider a class of systems, where discrete signals are sent along the links of the network. Such systems are of particular relevance in neuroscience, because they provide models for networks of neurons that use action potentials for communication. We study correlations in dynamic networks with arbitrary topology, assuming linear pulse coupling. With our novel approach, we are able to understand in detail how specific structural motifs affect pairwise correlations. Based on a power series decomposition of the covariance matrix, we describe the conditions under which very indirect interactions will have a pronounced effect on correlations and population dynamics. In random networks, we find that indirect interactions may lead to a broad distribution of activation levels with low average but highly variable correlations. This phenomenon is even more pronounced in networks with distance dependent connectivity. In contrast, networks with highly connected hubs or patchy connections often exhibit strong average correlations. Our results are particularly relevant in view of new experimental techniques that enable the parallel recording of spiking activity from a large number of neurons, an appropriate interpretation of which is hampered by the currently limited understanding of structure-dynamics relations in complex networks.

[1]  M. London,et al.  Sensitivity to perturbations in vivo implies high noise and suggests rate coding in cortex , 2010, Nature.

[2]  Stefan Rotter,et al.  Higher-Order Statistics of Input Ensembles and the Response of Simple Model Neurons , 2003, Neural Computation.

[3]  Robert Rosenbaum,et al.  Frontiers in Computational Neuroscience Computational Neuroscience , 2022 .

[4]  Yun Wang,et al.  Synaptic connections and small circuits involving excitatory and inhibitory neurons in layers 2-5 of adult rat and cat neocortex: triple intracellular recordings and biocytin labelling in vitro. , 2002, Cerebral cortex.

[5]  Eric Shea-Brown,et al.  Correlation and synchrony transfer in integrate-and-fire neurons: basic properties and consequences for coding. , 2008, Physical review letters.

[6]  Nicolas Brunel,et al.  Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons , 2000, Journal of Computational Neuroscience.

[7]  Stefan Rotter,et al.  Correlations and Population Dynamics in Cortical Networks , 2008, Neural Computation.

[8]  W. Newsome,et al.  The Variable Discharge of Cortical Neurons: Implications for Connectivity, Computation, and Information Coding , 1998, The Journal of Neuroscience.

[9]  William R. Softky,et al.  The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[10]  Spencer L. Smith,et al.  Parallel processing of visual space by neighboring neurons in mouse visual cortex , 2010, Nature Neuroscience.

[11]  Kevin L. Briggman,et al.  3D structural imaging of the brain with photons and electrons , 2008, Current Opinion in Neurobiology.

[12]  Sen Song,et al.  Highly Nonrandom Features of Synaptic Connectivity in Local Cortical Circuits , 2005, PLoS biology.

[13]  Alexander S. Ecker,et al.  Decorrelated Neuronal Firing in Cortical Microcircuits , 2010, Science.

[14]  Duane Q Nykamp,et al.  Pinpointing connectivity despite hidden nodes within stimulus-driven networks. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[15]  Rotter Stefan Structural motifs and correlation dynamics in networks of spiking neurons , 2010 .

[16]  R. Kempter,et al.  Hebbian learning and spiking neurons , 1999 .

[17]  E. Callaway,et al.  Fine-scale specificity of cortical networks depends on inhibitory cell type and connectivity , 2005, Nature Neuroscience.

[18]  John Hertz,et al.  Cross-Correlations in High-Conductance States of a Model Cortical Network , 2010, Neural Computation.

[19]  Moritz Helias,et al.  Decorrelation of low-frequency neural activity by inhibitory feedback , 2010, BMC Neuroscience.

[20]  Matthieu Gilson,et al.  Emergence of network structure due to spike-timing-dependent plasticity in recurrent neuronal networks IV , 2009, Biological Cybernetics.

[21]  Stephen Coombes,et al.  Waves, bumps, and patterns in neural field theories , 2005, Biological Cybernetics.

[22]  D. Hansel,et al.  Role of delays in shaping spatiotemporal dynamics of neuronal activity in large networks. , 2005, Physical review letters.

[23]  E. O’Shea,et al.  Living with noisy genes: how cells function reliably with inherent variability in gene expression. , 2007, Annual review of biophysics and biomolecular structure.

[24]  L. Abbott,et al.  Eigenvalue spectra of random matrices for neural networks. , 2006, Physical review letters.

[25]  Bernhard Hellwig,et al.  A quantitative analysis of the local connectivity between pyramidal neurons in layers 2/3 of the rat visual cortex , 2000, Biological Cybernetics.

[26]  Rainer Dahlhaus,et al.  Identification of synaptic connections in neural ensembles by graphical models , 1997, Journal of Neuroscience Methods.

[27]  Antonio G. Zippo,et al.  Higher order synchrony predictability in somatosensory cortex during spontaneous activity , 2010 .

[28]  Néstor Parga,et al.  Auto- and crosscorrelograms for the spike response of leaky integrate-and-fire neurons with slow synapses. , 2006, Physical review letters.

[29]  S. Grün,et al.  Higher-Order Correlations and Cumulants , 2010 .

[30]  R. Reid,et al.  Cellular Imaging of Visual Cortex Reveals the Spatial and Functional Organization of Spontaneous Activity , 2010, Front. Integr. Neurosci..

[31]  Néstor Parga,et al.  Theory of Input Spike Auto- and Cross-Correlations and Their Effect on the Response of Spiking Neurons , 2007, Neural Computation.

[32]  Fred Wolf,et al.  Correlations and synchrony in threshold neuron models. , 2008, Physical review letters.

[33]  R. F. Galán,et al.  On How Network Architecture Determines the Dominant Patterns of Spontaneous Neural Activity , 2008, PLoS ONE.

[34]  André Longtin,et al.  Driving neural oscillations with correlated spatial input and topographic feedback. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[35]  D. Chklovskii,et al.  Neurogeometry and potential synaptic connectivity , 2005, Trends in Neurosciences.

[36]  A. Hawkes Spectra of some self-exciting and mutually exciting point processes , 1971 .

[37]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[38]  Moritz Helias,et al.  Neurons hear their echo , 2010, BMC Neuroscience.

[39]  Duane Q. Nykamp,et al.  A kinetic theory approach to capturing interneuronal correlation: the feed-forward case , 2008, Journal of Computational Neuroscience.

[40]  Olaf Sporns,et al.  Complex network measures of brain connectivity: Uses and interpretations , 2010, NeuroImage.

[41]  O. Sporns,et al.  Complex brain networks: graph theoretical analysis of structural and functional systems , 2009, Nature Reviews Neuroscience.

[42]  A. Hawkes Point Spectra of Some Mutually Exciting Point Processes , 1971 .

[43]  Arthur W. Wetzel,et al.  Network anatomy and in vivo physiology of visual cortical neurons , 2011, Nature.

[44]  Jordi Bascompte,et al.  Disentangling the Web of Life , 2009, Science.

[45]  Benno Schwikowski,et al.  Graph-based methods for analysing networks in cell biology , 2006, Briefings Bioinform..

[46]  Nicolas Brunel,et al.  The Statistics of Repeating Patterns of Cortical Activity Can Be Reproduced by a Model Network of Stochastic Binary Neurons , 2008, The Journal of Neuroscience.

[47]  Bernard W. Balleine,et al.  Frontiers in Integrative Neuroscience Integrative Neuroscience , 2022 .

[48]  Nils Blüthgen,et al.  Noise Management by Molecular Networks , 2009, PLoS Comput. Biol..

[49]  M. A. Smith,et al.  Spatial and Temporal Scales of Neuronal Correlation in Primary Visual Cortex , 2008, The Journal of Neuroscience.

[50]  Lee E Miller,et al.  Inferring functional connections between neurons , 2008, Current Opinion in Neurobiology.

[51]  Nicolas Brunel,et al.  How Connectivity, Background Activity, and Synaptic Properties Shape the Cross-Correlation between Spike Trains , 2009, The Journal of Neuroscience.

[52]  P. Dayan,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S9 References the Asynchronous State in Cortical Circuits , 2022 .

[53]  Jaime de la Rocha,et al.  Supplementary Information for the article ‘ Correlation between neural spike trains increases with firing rate ’ , 2007 .

[54]  Shy Shoham,et al.  Frontiers in Computational Neuroscience Correlation-based Analysis and Generation of Multiple Spike Trains Using Hawkes Models with an Exogenous Input , 2022 .

[55]  Carlos D. Brody,et al.  Correlations Without Synchrony , 1999, Neural Computation.

[56]  Moritz Helias,et al.  Correlations in spiking neuronal networks with distance dependent connections , 2009, Journal of Computational Neuroscience.

[57]  Pierre Yger,et al.  Topologically invariant macroscopic statistics in balanced networks of conductance-based integrate-and-fire neurons , 2011, Journal of Computational Neuroscience.

[58]  A. Pouget,et al.  Neural correlations, population coding and computation , 2006, Nature Reviews Neuroscience.

[59]  A. van Oudenaarden,et al.  Noise Propagation in Gene Networks , 2005, Science.

[60]  E. Callaway,et al.  Excitatory cortical neurons form fine-scale functional networks , 2005, Nature.

[61]  Naama Barkai,et al.  Noise Propagation and Signaling Sensitivity in Biological Networks: A Role for Positive Feedback , 2007, PLoS Comput. Biol..

[62]  Rachel I. Wilson,et al.  Origins of correlated activity in an olfactory circuit , 2009, Nature Neuroscience.

[63]  P. Bressloff,et al.  Breathers in two-dimensional neural media. , 2005, Physical review letters.

[64]  Ifije E. Ohiorhenuan,et al.  Sparse coding and high-order correlations in fine-scale cortical networks , 2010, Nature.

[65]  Nicolas Brunel,et al.  Phase diagrams of sparsely connected networks of excitatory and inhibitory spiking neurons , 2000, Neurocomputing.

[66]  G. Bi,et al.  Synaptic modification by correlated activity: Hebb's postulate revisited. , 2001, Annual review of neuroscience.