Self-regulated Complexity in Neural Networks

Recordings of spontaneous activity of in vitro neuronal networks reveal various phenomena on different time scales. These include synchronized firing of neurons, bursting events of firing on both cell and network levels, hierarchies of bursting events, etc. These findings suggest that networks’ natural dynamics are self-regulated to facilitate different processes on intervals in orders of magnitude ranging from fractions of seconds to hours. Observing these unique structures of recorded time-series give rise to questions regarding the diversity of the basic elements of the sequences, the information storage capacity of a network and the means of implementing calculations.Due to the complex temporal nature of the recordings, the proper methods of characterizing and quantifying these dynamics are on the time–frequency plane. We thus introduce time-series analysis of neuronal network’s synchronized bursting events applying the wavelet packet decomposition based on the Haar mother-wavelet. We utilize algorithms for optimal tiling of the time–frequency plane to signify the local and global variations within the sequence. New quantifying observables of regularity and complexity are identified based on both the homogeneity and diversity of the tiling (Hulata et al., 2004, Physical Review Letters 92: 198181–198104 ). These observables are demonstrated while exploring the regularity–complexity plane to fulfill the accepted criteria (yet lacking an operational definition) of Effective Complexity. The presented question regarding the sequences’ capacity of information is addressed through applying our observables on recorded sequences, scrambled sequences, artificial sequences produced with similar long-range statistical distributions and on outputs of neuronal models devised to simulate the unique networks’ dynamics.

[1]  Tamas Vicsek Complexity: The bigger picture , 2002, Nature.

[2]  Ronald R. Coifman,et al.  Wavelets and Adapted Waveform Analy-sis: A Toolkit for Signal Processing and Numerical Analysis , 1993 .

[3]  R. Mantegna,et al.  Scaling behaviour in the dynamics of an economic index , 1995, Nature.

[4]  R. Segev,et al.  Hidden neuronal correlations in cultured networks. , 2004, Physical review letters.

[5]  R. Badii,et al.  Complexity: Hierarchical Structures and Scaling in Physics , 1997 .

[6]  Ronald R. Coifman,et al.  Entropy-based algorithms for best basis selection , 1992, IEEE Trans. Inf. Theory.

[7]  U. Egert,et al.  A novel organotypic long-term culture of the rat hippocampus on substrate-integrated multielectrode arrays. , 1998, Brain research. Brain research protocols.

[8]  R. Segev,et al.  A method for spike sorting and detection based on wavelet packets and Shannon's mutual information , 2002, Journal of Neuroscience Methods.

[9]  C. Morris,et al.  Voltage oscillations in the barnacle giant muscle fiber. , 1981, Biophysical journal.

[10]  Giorgio Carmignoto,et al.  Calcium oscillations encoding neuron-to-astrocyte communication , 2002, Journal of Physiology-Paris.

[11]  Eshel Ben-Jacob,et al.  Self-regulated complexity in cultured neuronal networks. , 2004, Physical review letters.

[12]  H. Markram,et al.  t Synchrony Generation in Recurrent Networks with Frequency-Dependent Synapses , 2000, The Journal of Neuroscience.

[13]  J. Sutherland The Quark and the Jaguar , 1994 .

[14]  S. Mallat VI – Wavelet zoom , 1999 .

[15]  E. Ben-Jacob,et al.  The formation of patterns in non-equilibrium growth , 1990, Nature.

[16]  Eshel Ben-Jacob,et al.  Generative modelling of regulated dynamical behavior in cultured neuronal networks , 2004 .

[17]  Ronald R. Coifman,et al.  Wavelet analysis and signal processing , 1990 .

[18]  M. C. Angulo,et al.  Glutamate Released from Glial Cells Synchronizes Neuronal Activity in the Hippocampus , 2004, The Journal of Neuroscience.

[19]  L. Villemoes,et al.  A Fast Algorithm for Adapted Time–Frequency Tilings , 1996 .

[20]  Y Shapira,et al.  Observations and modeling of synchronized bursting in two-dimensional neural networks. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[21]  E Hulata,et al.  Detection and sorting of neural spikes using wavelet packets. , 2000, Physical review letters.

[22]  E. Ben-Jacob From snowflake formation to growth of bacterial colonies II: Cooperative formation of complex colonial patterns , 1997 .

[23]  P. Sanberg,et al.  Neuroscience and Biobehavioral Reviews , 2002, Physiology & Behavior.

[24]  S. Mallat A wavelet tour of signal processing , 1998 .

[25]  Robert Axelrod,et al.  Complexity and Adaptation in Community Information Systems: Implications for Design , 1998, Community Computing and Support Systems.

[26]  Ronen Segev,et al.  Formation of electrically active clusterized neural networks. , 2003, Physical review letters.

[27]  Amir Ayali,et al.  Contextual regularity and complexity of neuronal activity: From stand-alone cultures to task-performing animals , 2004, Complex..

[28]  Eshel Ben-Jacob,et al.  The artistry of nature , 2001, Nature.

[29]  H. Kimelberg,et al.  Neuronal–glial interactions and behaviour , 2000, Neuroscience & Biobehavioral Reviews.

[30]  Jean-Michel Poggi,et al.  Wavelets and their applications , 2007 .

[31]  Eshel Ben-Jacob,et al.  Bacterial self–organization: co–enhancement of complexification and adaptability in a dynamic environment , 2003, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[32]  H E Stanley,et al.  Statistical physics and physiology: monofractal and multifractal approaches. , 1999, Physica A.

[33]  Goldenfeld,et al.  Simple lessons from complexity , 1999, Science.

[34]  John Horgan,et al.  From Complexity to Perplexity , 1995 .

[35]  Jeffrey M. Hausdorff,et al.  Long-range anticorrelations and non-Gaussian behavior of the heartbeat. , 1993, Physical review letters.

[36]  M. Jiménez-Montaño,et al.  Measures of complexity in neural spike-trains of the slowly adapting stretch receptor organs. , 2000, Bio Systems.

[37]  R. Segev,et al.  Long term behavior of lithographically prepared in vitro neuronal networks. , 2002, Physical review letters.

[38]  E. Ben-Jacob From snowflake formation to growth of bacterial colonies , 1993 .

[39]  G. Elston,et al.  Pyramidal Cells, Patches, and Cortical Columns: a Comparative Study of Infragranular Neurons in TEO, TE, and the Superior Temporal Polysensory Area of the Macaque Monkey , 2000, The Journal of Neuroscience.

[40]  Penna,et al.  Long-range anticorrelations and non-Gaussian behavior of a leaky faucet. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[41]  C. Naus,et al.  Intercellular Calcium Signaling in Astrocytes via ATP Release through Connexin Hemichannels* , 2002, The Journal of Biological Chemistry.

[42]  E. Ben-Jacob,et al.  Manifestation of function-follow-form in cultured neuronal networks , 2005, Physical biology.