Linking structure and activity in nonlinear spiking networks

Recent experimental advances are producing an avalanche of data on both neural connectivity and neural activity. To take full advantage of these two emerging datasets we need a framework that links them, revealing how collective neural activity arises from the structure of neural connectivity and intrinsic neural dynamics. This problem of structure-driven activity has drawn major interest in computational neuroscience. Existing methods for relating activity and architecture in spiking networks rely on linearizing activity around a central operating point and thus fail to capture the nonlinear responses of individual neurons that are the hallmark of neural information processing. Here, we overcome this limitation and present a new relationship between connectivity and activity in networks of nonlinear spiking neurons by developing a diagrammatic fluctuation expansion based on statistical field theory. We explicitly show how recurrent network structure produces pairwise and higher-order correlated activity, and how nonlinearities impact the networks’ spiking activity. Our findings open new avenues to investigating how single-neuron nonlinearities—including those of different cell types—combine with connectivity to shape population activity and function.

[1]  Moshe Abeles,et al.  Corticonics: Neural Circuits of Cerebral Cortex , 1991 .

[2]  R C Reid,et al.  Divergence and reconvergence: multielectrode analysis of feedforward connections in the visual system. , 2001, Progress in brain research.

[3]  Sompolinsky,et al.  Theory of correlations in stochastic neural networks. , 1994, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[4]  T. Sejnowski,et al.  Storing covariance with nonlinearly interacting neurons , 1977, Journal of mathematical biology.

[5]  G. Biroli,et al.  Dynamics of interacting particle systems: stochastic process and field theory , 2007, 0709.1325.

[6]  A. Pouget,et al.  Tuning curve sharpening for orientation selectivity: coding efficiency and the impact of correlations , 2004, Nature Neuroscience.

[7]  Nicholas J. Priebe,et al.  Direction Selectivity of Excitation and Inhibition in Simple Cells of the Cat Primary Visual Cortex , 2005, Neuron.

[8]  Paul C. Martin,et al.  Statistical Dynamics of Classical Systems , 1973 .

[9]  Daniel B. Rubin,et al.  The Stabilized Supralinear Network: A Unifying Circuit Motif Underlying Multi-Input Integration in Sensory Cortex , 2015, Neuron.

[10]  Srdjan Ostojic,et al.  Two types of asynchronous activity in networks of excitatory and inhibitory spiking neurons , 2014, Nature Neuroscience.

[11]  E. Callaway,et al.  Fine-scale specificity of cortical networks depends on inhibitory cell type and connectivity , 2005, Nature Neuroscience.

[12]  Nicolas Brunel,et al.  Dynamics of the Firing Probability of Noisy Integrate-and-Fire Neurons , 2002, Neural Computation.

[13]  Christof Koch,et al.  The Influence of Synaptic Weight Distribution on Neuronal Population Dynamics , 2013, PLoS Comput. Biol..

[14]  H Sompolinsky,et al.  Dynamics of random neural networks with bistable units. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[15]  Michael A. Buice,et al.  Path Integral Methods for Stochastic Differential Equations , 2015, Journal of mathematical neuroscience.

[16]  Stefan Rotter,et al.  How Structure Determines Correlations in Neuronal Networks , 2011, PLoS Comput. Biol..

[17]  Kenneth D. Miller,et al.  Analysis of the Stabilized Supralinear Network , 2012, Neural Computation.

[18]  L. Peliti Path integral approach to birth-death processes on a lattice , 1985 .

[19]  J. Cardy,et al.  Non-Equilibrium Statistical Mechanics and Turbulence , 2009 .

[20]  J. Macke,et al.  Neural population coding: combining insights from microscopic and mass signals , 2015, Trends in Cognitive Sciences.

[21]  T. Sejnowski,et al.  Impact of Correlated Synaptic Input on Output Firing Rate and Variability in Simple Neuronal Models , 2000, The Journal of Neuroscience.

[22]  A. Reyes Synchrony-dependent propagation of firing rate in iteratively constructed networks in vitro , 2003, Nature Neuroscience.

[23]  Thomas K. Berger,et al.  A synaptic organizing principle for cortical neuronal groups , 2011, Proceedings of the National Academy of Sciences.

[24]  J. Elgin The Fokker-Planck Equation: Methods of Solution and Applications , 1984 .

[25]  Brent Doiron,et al.  Inhibitory stabilization and visual coding in cortical circuits with multiple interneuron subtypes. , 2016, Journal of neurophysiology.

[26]  Tatyana O Sharpee,et al.  Low-dimensional dynamics of structured random networks. , 2015, Physical review. E.

[27]  D. Heeger Normalization of cell responses in cat striate cortex , 1992, Visual Neuroscience.

[28]  Nicolas Brunel,et al.  How Connectivity, Background Activity, and Synaptic Properties Shape the Cross-Correlation between Spike Trains , 2009, The Journal of Neuroscience.

[29]  Yoram Burak,et al.  Shaping Neural Circuits by High Order Synaptic Interactions , 2016, PLoS Comput. Biol..

[30]  Nicolas Brunel,et al.  Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons , 2000, Journal of Computational Neuroscience.

[31]  David Hansel,et al.  Asynchronous Rate Chaos in Spiking Neuronal Circuits , 2015, bioRxiv.

[32]  D. R. Muir,et al.  Functional organization of excitatory synaptic strength in primary visual cortex , 2015, Nature.

[33]  B. Sakmann,et al.  Cortex Is Driven by Weak but Synchronously Active Thalamocortical Synapses , 2006, Science.

[34]  Nicholas J. Priebe,et al.  Contrast-Invariant Orientation Tuning in Cat Visual Cortex: Thalamocortical Input Tuning and Correlation-Based Intracortical Connectivity , 1998, The Journal of Neuroscience.

[35]  Alex Roxin,et al.  The Role of Degree Distribution in Shaping the Dynamics in Networks of Sparsely Connected Spiking Neurons , 2011, Front. Comput. Neurosci..

[36]  R. Reid,et al.  Paired-spike interactions and synaptic efficacy of retinal inputs to the thalamus , 1998, Nature.

[37]  Eric Shea-Brown,et al.  Impact of Network Structure and Cellular Response on Spike Time Correlations , 2011, PLoS Comput. Biol..

[38]  Brett J. Graham,et al.  Anatomy and function of an excitatory network in the visual cortex , 2016, Nature.

[39]  Jacques Bourg,et al.  Multilaminar networks of cortical neurons integrate common inputs from sensory thalamus , 2016, Nature Neuroscience.

[40]  Wulfram Gerstner,et al.  Neuronal Dynamics: From Single Neurons To Networks And Models Of Cognition , 2014 .

[41]  H. Risken Fokker-Planck Equation , 1996 .

[42]  A. Pouget,et al.  Information-limiting correlations , 2014, Nature Neuroscience.

[43]  U. Täuber Field-Theory Approaches to Nonequilibrium Dynamics , 2007 .

[44]  Eric Shea-Brown,et al.  Linking structure and activity in nonlinear spiking networks , 2016 .

[45]  Michael A Buice,et al.  Beyond mean field theory: statistical field theory for neural networks , 2013, Journal of statistical mechanics.

[46]  H. Sompolinsky,et al.  Transition to chaos in random neuronal networks , 2015, 1508.06486.

[47]  Marcel Abendroth,et al.  Quantum Field Theory And Critical Phenomena , 2016 .

[48]  D. Sornette,et al.  Generating functions and stability study of multivariate self-excited epidemic processes , 2011, 1101.5564.

[49]  A. Aertsen,et al.  Spiking activity propagation in neuronal networks: reconciling different perspectives on neural coding , 2010, Nature Reviews Neuroscience.

[50]  Susan A. Murphy,et al.  Monographs on statistics and applied probability , 1990 .

[51]  Sen Song,et al.  Highly Nonrandom Features of Synaptic Connectivity in Local Cortical Circuits , 2005, PLoS biology.

[52]  A. Hawkes,et al.  A cluster process representation of a self-exciting process , 1974, Journal of Applied Probability.

[53]  Brent Doiron,et al.  Oscillatory activity in electrosensory neurons increases with the spatial correlation of the stochastic input stimulus. , 2004, Physical review letters.

[54]  Nicholas J. Priebe,et al.  Mechanisms underlying cross-orientation suppression in cat visual cortex , 2006, Nature Neuroscience.

[55]  M. Mattia,et al.  Population dynamics of interacting spiking neurons. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[56]  J. Cowan,et al.  Field-theoretic approach to fluctuation effects in neural networks. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[57]  Michael A. Buice,et al.  Systematic Fluctuation Expansion for Neural Network Activity Equations , 2009, Neural Computation.

[58]  Sommers,et al.  Chaos in random neural networks. , 1988, Physical review letters.

[59]  J. Zinn-Justin Quantum Field Theory and Critical Phenomena , 2002 .

[60]  Eric Shea-Brown,et al.  Local paths to global coherence: cutting networks down to size. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[61]  Rava Azeredo da Silveira,et al.  Structures of Neural Correlation and How They Favor Coding , 2016, Neuron.

[62]  D. Brillinger Estimation of the Second-Order Intensities of a Bivariate Stationary Point Process , 1976 .

[63]  E. Bienenstock,et al.  Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[64]  Brent Doiron,et al.  Self-Organization of Microcircuits in Networks of Spiking Neurons with Plastic Synapses , 2015, PLoS Comput. Biol..

[65]  Theoden I. Netoff,et al.  Synchronization from Second Order Network Connectivity Statistics , 2011, Front. Comput. Neurosci..

[66]  A. Pouget,et al.  Neural correlations, population coding and computation , 2006, Nature Reviews Neuroscience.

[67]  E. Callaway,et al.  Excitatory cortical neurons form fine-scale functional networks , 2005, Nature.

[68]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[69]  Stefan Rotter,et al.  Cumulants of Hawkes point processes. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[70]  John H R Maunsell,et al.  Cortical neural populations can guide behavior by integrating inputs linearly, independent of synchrony , 2013, Proceedings of the National Academy of Sciences.

[71]  W. Gerstner,et al.  Triplets of Spikes in a Model of Spike Timing-Dependent Plasticity , 2006, The Journal of Neuroscience.

[72]  Stefan Rotter,et al.  Interplay between Graph Topology and Correlations of Third Order in Spiking Neuronal Networks , 2016, PLoS Comput. Biol..

[73]  M. Doi Stochastic theory of diffusion-controlled reaction , 1976 .

[74]  Maxwell H. Turner,et al.  Direction-Selective Circuits Shape Noise to Ensure a Precise Population Code , 2016, Neuron.

[75]  Ad Aertsen,et al.  Stable propagation of synchronous spiking in cortical neural networks , 1999, Nature.

[76]  Evan S. Schaffer,et al.  Inhibitory Stabilization of the Cortical Network Underlies Visual Surround Suppression , 2009, Neuron.

[77]  Paul C. Bressloff,et al.  Stochastic Neural Field Theory and the System-Size Expansion , 2009, SIAM J. Appl. Math..

[78]  B. McNaughton,et al.  Paradoxical Effects of External Modulation of Inhibitory Interneurons , 1997, The Journal of Neuroscience.

[79]  Nicholas J. Priebe,et al.  The contribution of spike threshold to the dichotomy of cortical simple and complex cells , 2004, Nature Neuroscience.

[80]  P. Dayan,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S9 References the Asynchronous State in Cortical Circuits , 2022 .

[81]  Jaime de la Rocha,et al.  Supplementary Information for the article ‘ Correlation between neural spike trains increases with firing rate ’ , 2007 .

[82]  Paul C. Bressloff,et al.  Path-Integral Methods for Analyzing the Effects of Fluctuations in Stochastic Hybrid Neural Networks , 2015, The Journal of Mathematical Neuroscience (JMN).

[83]  P. Brémaud,et al.  STABILITY OF NONLINEAR HAWKES PROCESSES , 1996 .

[84]  Francesca Mastrogiuseppe,et al.  Intrinsically-generated fluctuating activity in excitatory-inhibitory networks , 2016, PLoS Comput. Biol..

[85]  Nicolas Brunel,et al.  Dynamics of Networks of Excitatory and Inhibitory Neurons in Response to Time-Dependent Inputs , 2011, Front. Comput. Neurosci..

[86]  Emery N. Brown,et al.  Analysis of Neural Data , 2014 .

[87]  K. Miller,et al.  Neural noise can explain expansive, power-law nonlinearities in neural response functions. , 2002, Journal of neurophysiology.

[88]  M. Abeles Role of the cortical neuron: integrator or coincidence detector? , 1982, Israel journal of medical sciences.

[89]  Wulfram Gerstner,et al.  A neuronal learning rule for sub-millisecond temporal coding , 1996, Nature.

[90]  Yu Hu,et al.  The Sign Rule and Beyond: Boundary Effects, Flexibility, and Noise Correlations in Neural Population Codes , 2013, PLoS Comput. Biol..

[91]  Merav Stern,et al.  Transition to chaos in random networks with cell-type-specific connectivity. , 2014, Physical review letters.

[92]  Ohira,et al.  Master-equation approach to stochastic neurodynamics. , 1993, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[93]  Eric Shea-Brown,et al.  Stimulus-Dependent Correlations and Population Codes , 2008, Neural Computation.

[94]  M. Doi Second quantization representation for classical many-particle system , 1976 .

[95]  Haim Sompolinsky,et al.  Chaotic Balanced State in a Model of Cortical Circuits , 1998, Neural Computation.

[96]  Brent Doiron,et al.  The mechanics of state-dependent neural correlations , 2016, Nature Neuroscience.

[97]  A. Hawkes Spectra of some self-exciting and mutually exciting point processes , 1971 .

[98]  Eric Shea-Brown,et al.  Motif statistics and spike correlations in neuronal networks , 2012, BMC Neuroscience.