Information Diversity in Structure and Dynamics of Simulated Neuronal Networks

Neuronal networks exhibit a wide diversity of structures, which contributes to the diversity of the dynamics therein. The presented work applies an information theoretic framework to simultaneously analyze structure and dynamics in neuronal networks. Information diversity within the structure and dynamics of a neuronal network is studied using the normalized compression distance. To describe the structure, a scheme for generating distance-dependent networks with identical in-degree distribution but variable strength of dependence on distance is presented. The resulting network structure classes possess differing path length and clustering coefficient distributions. In parallel, comparable realistic neuronal networks are generated with NETMORPH simulator and similar analysis is done on them. To describe the dynamics, network spike trains are simulated using different network structures and their bursting behaviors are analyzed. For the simulation of the network activity the Izhikevich model of spiking neurons is used together with the Tsodyks model of dynamical synapses. We show that the structure of the simulated neuronal networks affects the spontaneous bursting activity when measured with bursting frequency and a set of intraburst measures: the more locally connected networks produce more and longer bursts than the more random networks. The information diversity of the structure of a network is greatest in the most locally connected networks, smallest in random networks, and somewhere in between in the networks between order and disorder. As for the dynamics, the most locally connected networks and some of the in-between networks produce the most complex intraburst spike trains. The same result also holds for sparser of the two considered network densities in the case of full spike trains.

[1]  José María Amigó,et al.  Estimating the Entropy Rate of Spike Trains via Lempel-Ziv Complexity , 2004, Neural Computation.

[2]  Nicolas Brunel,et al.  Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons , 2000, Journal of Computational Neuroscience.

[3]  Marc Benayoun,et al.  Avalanches in a Stochastic Model of Spiking Neurons , 2010, PLoS Comput. Biol..

[4]  Stefan Rotter,et al.  Models of cortical networks with long-range patchy projections , 2010, Journal of Computational Neuroscience.

[5]  Shimon Marom,et al.  Development, learning and memory in large random networks of cortical neurons: lessons beyond anatomy , 2002, Quarterly Reviews of Biophysics.

[6]  A. Kriegstein,et al.  Morphological classification of rat cortical neurons in cell culture , 1983, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[7]  B. Richmond,et al.  Intrinsic dynamics in neuronal networks. I. Theory. , 2000, Journal of neurophysiology.

[8]  Alessandro Vato,et al.  Dissociated cortical networks show spontaneously correlated activity patterns during in vitro development , 2006, Brain Research.

[9]  Mark E. J. Newman,et al.  The Structure and Function of Complex Networks , 2003, SIAM Rev..

[10]  Bin Ma,et al.  The similarity metric , 2001, IEEE Transactions on Information Theory.

[11]  A. Kohn,et al.  Measuring spike pattern reliability with the Lempel–Ziv-distance , 2006, Journal of Neuroscience Methods.

[12]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[13]  Stefan Rotter,et al.  Exact digital simulation of time-invariant linear systems with applications to neuronal modeling , 1999, Biological Cybernetics.

[14]  Albert-László Barabási,et al.  Statistical mechanics of complex networks , 2001, ArXiv.

[15]  Stefan Rotter,et al.  Correlations and Population Dynamics in Cortical Networks , 2008, Neural Computation.

[16]  Frank Emmert-Streib,et al.  Statistic Complexity: Combining Kolmogorov Complexity with an Ensemble Approach , 2010, PloS one.

[17]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[18]  Steve M. Potter,et al.  An extremely rich repertoire of bursting patterns during the development of cortical cultures , 2006, BMC Neuroscience.

[19]  H. Markram,et al.  t Synchrony Generation in Recurrent Networks with Frequency-Dependent Synapses , 2000, The Journal of Neuroscience.

[20]  Nathan D. Price,et al.  Biological Information as Set-Based Complexity , 2010, IEEE Transactions on Information Theory.

[21]  W. Newsome,et al.  The Variable Discharge of Cortical Neurons: Implications for Connectivity, Computation, and Information Coding , 1998, The Journal of Neuroscience.

[22]  Henry C. Tuckwell,et al.  Cortical network modeling: Analytical methods for firing rates and some properties of networks of LIF neurons , 2006, Journal of Physiology-Paris.

[23]  Bruce C. Wheeler,et al.  Designing Neural Networks in Culture , 2010, Proceedings of the IEEE.

[24]  Yves Frégnac,et al.  Complexity in Neuronal Networks , 2007 .

[25]  P. Rapp,et al.  The algorithmic complexity of neural spike trains increases during focal seizures , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[26]  Riikka Havela,et al.  Modeling of Neuronal Growth In Vitro: Comparison of Simulation Tools NETMORPH and CX3D , 2011, EURASIP J. Bioinform. Syst. Biol..

[27]  Michael E. Orrison,et al.  The Linear Complexity of a Graph , 2006, Electron. J. Comb..

[28]  Jan Stegenga,et al.  Network bursts in cortical cultures are best simulated using pacemaker neurons and adaptive synapses , 2010, Biological Cybernetics.

[29]  Ilya Shmulevich,et al.  Critical networks exhibit maximal information diversity in structure-dynamics relationships. , 2008, Physical review letters.

[30]  Liam Paninski,et al.  Estimation of Entropy and Mutual Information , 2003, Neural Computation.

[31]  A. Aertsen,et al.  Conditions for Propagating Synchronous Spiking and Asynchronous Firing Rates in a Cortical Network Model , 2008, The Journal of Neuroscience.

[32]  Ming Li,et al.  An Introduction to Kolmogorov Complexity and Its Applications , 2019, Texts in Computer Science.

[33]  Yoram Louzoun,et al.  Random distance dependent attachment as a model for neural network generation in the Caenorhabditis elegans , 2010, Bioinform..

[34]  D. Long Networks of the Brain , 2011 .

[35]  Randal A. Koene,et al.  NETMORPH: A Framework for the Stochastic Generation of Large Scale Neuronal Networks With Realistic Neuron Morphologies , 2009, Neuroinformatics.