Spontaneous activity emerging from an inferred network model captures complex spatio-temporal dynamics of spike data

Inference methods are widely used to recover effective models from observed data. However, few studies attempted to investigate the dynamics of inferred models in neuroscience, and none, to our knowledge, at the network level. We introduce a principled modification of a widely used generalized linear model (GLM), and learn its structural and dynamic parameters from in-vitro spike data. The spontaneous activity of the new model captures prominent features of the non-stationary and non-linear dynamics displayed by the biological network, where the reference GLM largely fails, and also reflects fine-grained spatio-temporal dynamical features. Two ingredients were key for success. The first is a saturating transfer function: beyond its biological plausibility, it limits the neuron’s information transfer, improving robustness against endogenous and external noise. The second is a super-Poisson spikes generative mechanism; it accounts for the undersampling of the network, and allows the model neuron to flexibly incorporate the observed activity fluctuations.

[1]  S. Leibler,et al.  Neuronal couplings between retinal ganglion cells inferred by efficient inverse statistical physics methods , 2009, Proceedings of the National Academy of Sciences.

[2]  Shimon Marom,et al.  Self-organized criticality in single-neuron excitability. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[3]  Jan Stegenga,et al.  Experimental analysis and computational modeling of interburst intervals in spontaneous activity of cortical neuronal culture , 2011, Biological Cybernetics.

[4]  Gustavo Deco,et al.  Network Events on Multiple Space and Time Scales in Cultured Neural Networks and in a Stochastic Rate Model , 2015, PLoS Comput. Biol..

[5]  W. Newsome,et al.  The Variable Discharge of Cortical Neurons: Implications for Connectivity, Computation, and Information Coding , 1998, The Journal of Neuroscience.

[6]  Jonathan W. Pillow,et al.  Capturing the Dynamical Repertoire of Single Neurons with Generalized Linear Models , 2016, Neural Computation.

[7]  Il Memming Park,et al.  Encoding and decoding in parietal cortex during sensorimotor decision-making , 2014, Nature Neuroscience.

[8]  J. Hertz,et al.  Mean field theory for nonequilibrium network reconstruction. , 2010, Physical review letters.

[9]  Yasser Roudi,et al.  Multi-neuronal activity and functional connectivity in cell assemblies , 2015, Current Opinion in Neurobiology.

[10]  R. Zecchina,et al.  Inverse statistical problems: from the inverse Ising problem to data science , 2017, 1702.01522.

[11]  Matteo Marsili,et al.  The effect of nonstationarity on models inferred from neural data , 2012, 1203.5673.

[12]  V. Priesemann,et al.  Subsampling scaling , 2017, Nature Communications.

[13]  J. Donoghue,et al.  Collective dynamics in human and monkey sensorimotor cortex: predicting single neuron spikes , 2009, Nature Neuroscience.

[14]  Michael J. Berry,et al.  Weak pairwise correlations imply strongly correlated network states in a neural population , 2005, Nature.

[15]  José Carlos Príncipe,et al.  Modeling of Synchronized Burst in Dissociated Cortical Tissue: An Exploration of Parameter Space , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[16]  David J Schwab,et al.  Zipf's law and criticality in multivariate data without fine-tuning. , 2013, Physical review letters.

[17]  F. Lombardi,et al.  Temporal correlations in neuronal avalanche occurrence , 2016, Scientific Reports.

[18]  Bruno B Averbeck.  Poisson or Not Poisson: Differences in Spike Train Statistics between Parietal Cortical Areas , 2009, Neuron.

[19]  Danny Eytan,et al.  Dynamics and Effective Topology Underlying Synchronization in Networks of Cortical Neurons , 2006, The Journal of Neuroscience.

[20]  Uri T Eden,et al.  A point process framework for relating neural spiking activity to spiking history, neural ensemble, and extrinsic covariate effects. , 2005, Journal of neurophysiology.

[21]  Gustavo Deco,et al.  Network Bursting Dynamics in Excitatory Cortical Neuron Cultures Results from the Combination of Different Adaptive Mechanism , 2013, PloS one.

[22]  D. Plenz,et al.  Criticality in neural systems , 2014 .

[23]  James K. Lindsey,et al.  Applying Generalized Linear Models , 2000 .

[24]  Scott W. Linderman,et al.  Bayesian latent structure discovery from multi-neuron recordings , 2016, NIPS.

[25]  Eero P. Simoncelli,et al.  Partitioning neuronal variability , 2014, Nature Neuroscience.

[26]  Michael J. Berry,et al.  Thermodynamics and signatures of criticality in a network of neurons , 2015, Proceedings of the National Academy of Sciences.

[27]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[28]  Sonja Grün,et al.  Bistability, non-ergodicity, and inhibition in pairwise maximum-entropy models , 2016, PLoS Comput. Biol..

[29]  Alain Destexhe,et al.  Maximum entropy models reveal the correlation structure in cortical neural activity during wakefulness and sleep , 2018 .

[30]  John Hertz,et al.  Ising Models for Inferring Network Structure From Spike Data , 2011, 1106.1752.

[31]  Eero P. Simoncelli,et al.  Spatio-temporal correlations and visual signalling in a complete neuronal population , 2008, Nature.

[32]  Federico Ricci-Tersenghi,et al.  Inferring Synaptic Structure in Presence of Neural Interaction Time Scales , 2014, PloS one.

[33]  Klaus Obermayer,et al.  Analyzing Short-Term Noise Dependencies of Spike-Counts in Macaque Prefrontal Cortex Using Copulas and the Flashlight Transformation , 2009, PLoS Comput. Biol..

[34]  Professor Dr. Jos J. Eggermont.  The Correlative Brain , 1990, Studies of Brain Function.

[35]  E. Halgren,et al.  Spatiotemporal dynamics of neocortical excitation and inhibition during human sleep , 2012, Proceedings of the National Academy of Sciences.

[36]  Andreas Herzog,et al.  Slow oscillating population activity in developing cortical networks: models and experimental results. , 2011, Journal of neurophysiology.

[37]  Hirokazu Takahashi,et al.  Locally embedded presages of global network bursts , 2017, Proceedings of the National Academy of Sciences.

[38]  Christian Igel,et al.  Empirical evaluation of the improved Rprop learning algorithms , 2003, Neurocomputing.

[39]  M Giugliano,et al.  Single-neuron discharge properties and network activity in dissociated cultures of neocortex. , 2004, Journal of neurophysiology.

[40]  J. Schiller,et al.  Dynamics of Excitability over Extended Timescales in Cultured Cortical Neurons , 2010, The Journal of Neuroscience.

[41]  Ian H. Stevenson,et al.  Bayesian Inference of Functional Connectivity and Network Structure From Spikes , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[42]  Steve M. Potter,et al.  An extremely rich repertoire of bursting patterns during the development of cortical cultures , 2006, BMC Neuroscience.