From space to time: Spatial inhomogeneities lead to the emergence of spatiotemporal sequences in spiking neuronal networks

Spatio-temporal sequences of neuronal activity are observed in many brain regions in a variety of tasks and are thought to form the basis of meaningful behavior. However, mechanisms by which a neuronal network can generate spatio-temporal activity sequences have remained obscure. Existing models are biologically untenable because they either require manual embedding of a feedforward network within a random network or supervised learning to train the connectivity of a network to generate sequences. Here, we propose a biologically plausible, generative rule to create spatio-temporal activity sequences in a network of spiking neurons with distance-dependent connectivity. We show that the emergence of spatio-temporal activity sequences requires: (1) individual neurons preferentially project a small fraction of their axons in a specific direction, and (2) the preferential projection direction of neighboring neurons is similar. Thus, an anisotropic but correlated connectivity of neuron groups suffices to generate spatio-temporal activity sequences in an otherwise random neuronal network model.

[1]  D. Hansel,et al.  Role of delays in shaping spatiotemporal dynamics of neuronal activity in large networks. , 2005, Physical review letters.

[2]  Ann M Graybiel,et al.  Neural representation of time in cortico-basal ganglia circuits , 2009, Proceedings of the National Academy of Sciences.

[3]  Zachary P. Kilpatrick,et al.  Threshold of Front Propagation in Neural Fields: An Interface Dynamics Approach , 2018, SIAM J. Appl. Math..

[4]  Markus Diesmann,et al.  Activity dynamics and propagation of synchronous spiking in locally connected random networks , 2003, Biological Cybernetics.

[5]  Richard Hans Robert Hahnloser,et al.  Spike-Time-Dependent Plasticity and Heterosynaptic Competition Organize Networks to Produce Long Scale-Free Sequences of Neural Activity , 2010, Neuron.

[6]  K. Lashley The problem of serial order in behavior , 1951 .

[7]  Sen Cheng,et al.  The CRISP theory of hippocampal function in episodic memory , 2013, Front. Neural Circuits.

[8]  Naoki Masuda,et al.  Formation of feedforward networks and frequency synchrony by spike-timing-dependent plasticity , 2007, Journal of Computational Neuroscience.

[9]  P. Bressloff Spatiotemporal dynamics of continuum neural fields , 2012 .

[10]  A. Nimmerjahn,et al.  Ultrafast neuronal imaging of dopamine dynamics with designed genetically encoded sensors , 2018, Science.

[11]  M. Crair,et al.  Retinal waves coordinate patterned activity throughout the developing visual system , 2012, Nature.

[12]  Guy Eyal,et al.  Dendritic and Axonal Architecture of Individual Pyramidal Neurons across Layers of Adult Human Neocortex , 2015, Cerebral cortex.

[13]  H. Sompolinsky,et al.  Theory of orientation tuning in visual cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[14]  Nicolas Brunel,et al.  Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons , 2000, Journal of Computational Neuroscience.

[15]  K. Zhang,et al.  Representation of spatial orientation by the intrinsic dynamics of the head-direction cell ensemble: a theory , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[16]  Dean V Buonomano,et al.  Embedding Multiple Trajectories in Simulated Recurrent Neural Networks in a Self-Organizing Manner , 2009, The Journal of Neuroscience.

[17]  Alexander S. Ecker,et al.  Principles of connectivity among morphologically defined cell types in adult neocortex , 2015, Science.

[18]  Axel Hutt,et al.  Local excitation-lateral inhibition interaction yields oscillatory instabilities in nonlocally interacting systems involving finite propagation delay , 2008 .

[19]  Upinder S Bhalla,et al.  CA1 cell activity sequences emerge after reorganization of network correlation structure during associative learning , 2014, eLife.

[20]  Christopher D. Harvey,et al.  Recurrent Network Models of Sequence Generation and Memory , 2016, Neuron.

[21]  L. Abbott,et al.  Eigenvalue spectra of random matrices for neural networks. , 2006, Physical review letters.

[22]  Matthias Bethge,et al.  Functional analysis of ultra high information rates conveyed by rat vibrissal primary afferents , 2013, Front. Neural Circuits.

[23]  Axel Hutt,et al.  Analysis of nonlocal neural fields for both general and gamma-distributed connectivities , 2005 .

[24]  Yuji Ikegaya,et al.  Synfire Chains and Cortical Songs: Temporal Modules of Cortical Activity , 2004, Science.

[25]  K. D. Punta,et al.  An ultra-sparse code underlies the generation of neural sequences in a songbird , 2002 .

[26]  Pulin Gong,et al.  Propagating Waves Can Explain Irregular Neural Dynamics , 2015, The Journal of Neuroscience.

[27]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[28]  Frank Sobott,et al.  The structural basis for dynamic DNA binding and bridging interactions which condense the bacterial centromere , 2017, eLife.

[29]  Asohan Amarasingham,et al.  Hippocampus Internally Generated Cell Assembly Sequences in the Rat , 2011 .

[30]  Moritz Helias,et al.  Conditions for wave trains in spiking neural networks , 2018, Physical Review Research.

[31]  Dean V Buonomano,et al.  Differential Encoding of Time by Prefrontal and Striatal Network Dynamics , 2017, The Journal of Neuroscience.

[32]  C. Harvey,et al.  The Spatial Structure of Neural Encoding in Mouse Posterior Cortex during Navigation , 2019, Neuron.

[33]  Tomoki Fukai,et al.  Recurrent network model for learning goal-directed sequences through reverse replay , 2017, bioRxiv.

[34]  Terrence J. Sejnowski,et al.  Cortical travelling waves: mechanisms and computational principles , 2018, Nature Reviews Neuroscience.

[35]  Stephen Coombes,et al.  Neural fields , 2006, Scholarpedia.

[36]  Xiao Zhang,et al.  Spectra of random graphs with community structure and arbitrary degrees , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[37]  J. Knott The organization of behavior: A neuropsychological theory , 1951 .

[38]  G. Dragoi,et al.  Preplay of future place cell sequences by hippocampal cellular assemblies , 2011, Nature.

[39]  A. Selverston,et al.  Dynamical principles in neuroscience , 2006 .

[40]  U. Bhalla Dendrites, deep learning, and sequences in the hippocampus , 2019, Hippocampus.

[41]  Christopher D. Harvey,et al.  Choice-specific sequences in parietal cortex during a virtual-navigation decision task , 2012, Nature.

[42]  Moshe Abeles,et al.  Corticonics: Neural Circuits of Cerebral Cortex , 1991 .

[43]  Markus Diesmann,et al.  Limits to the Development of Feed-Forward Structures in Large Recurrent Neuronal Networks , 2011, Front. Comput. Neurosci..

[44]  Asohan Amarasingham,et al.  Internally Generated Cell Assembly Sequences in the Rat Hippocampus , 2008, Science.

[45]  Stefan Rotter,et al.  How Structure Determines Correlations in Neuronal Networks , 2011, PLoS Comput. Biol..

[46]  Ad Aertsen,et al.  Physiology and Impact of Horizontal Connections in Rat Neocortex. , 2015, Cerebral cortex.

[47]  Dean V. Buonomano,et al.  ROBUST TIMING AND MOTOR PATTERNS BY TAMING CHAOS IN RECURRENT NEURAL NETWORKS , 2012, Nature Neuroscience.

[48]  J. Wickens,et al.  Effects of local connectivity on striatal function: Simulation and analysis of a model , 1995, Synapse.

[49]  Robert Rosenbaum,et al.  Spatiotemporal Dynamics and Reliable Computations in Recurrent Spiking Neural Networks. , 2016, Physical review letters.

[50]  Mark C. W. van Rossum,et al.  Recurrent networks with short term synaptic depression , 2009, Journal of Computational Neuroscience.

[51]  A. Aertsen,et al.  Conditions for Propagating Synchronous Spiking and Asynchronous Firing Rates in a Cortical Network Model , 2008, The Journal of Neuroscience.

[52]  J. Rinzel,et al.  Propagating activity patterns in large-scale inhibitory neuronal networks. , 1998, Science.

[53]  A. Aertsen,et al.  Spiking activity propagation in neuronal networks: reconciling different perspectives on neural coding , 2010, Nature Reviews Neuroscience.

[54]  Anthony M. Zador A Critique of Pure Learning: What Artificial Neural Networks can Learn from Animal Brains , 2019 .

[55]  S. Amari Dynamics of pattern formation in lateral-inhibition type neural fields , 1977, Biological Cybernetics.

[56]  Ad Aertsen,et al.  Stable propagation of synchronous spiking in cortical neural networks , 1999, Nature.

[57]  E. Halgren,et al.  Spatiotemporal dynamics of neocortical excitation and inhibition during human sleep , 2012, Proceedings of the National Academy of Sciences.

[58]  Y. Dan,et al.  Clonally Related Visual Cortical Neurons Show Similar Stimulus Feature Selectivity , 2012, Nature.

[59]  G. Buzsáki,et al.  Cell Assembly Sequences Arising from Spike Threshold Adaptation Keep Track of Time in the Hippocampus , 2011, The Journal of Neuroscience.

[60]  James M Murray,et al.  Learning multiple variable-speed sequences in striatum via cortical tutoring , 2017, eLife.

[61]  W. Gerstner,et al.  Connectivity reflects coding: a model of voltage-based STDP with homeostasis , 2010, Nature Neuroscience.

[62]  Ad Aertsen,et al.  Activity Dynamics and Signal Representation in a Striatal Network Model with Distance-Dependent Connectivity , 2016, eNeuro.

[63]  H. Meinhardt,et al.  Biological pattern formation: fmm basic mechanisms ta complex structures , 1994 .

[64]  G. Buzsáki,et al.  Sequential structure of neocortical spontaneous activity in vivo , 2007, Proceedings of the National Academy of Sciences.

[65]  Ken Perlin,et al.  [Computer Graphics]: Three-Dimensional Graphics and Realism , 2022 .