Embedding Multiple Trajectories in Simulated Recurrent Neural Networks in a Self-Organizing Manner

Complex neural dynamics produced by the recurrent architecture of neocortical circuits is critical to the cortex's computational power. However, the synaptic learning rules underlying the creation of stable propagation and reproducible neural trajectories within recurrent networks are not understood. Here, we examined synaptic learning rules with the goal of creating recurrent networks in which evoked activity would: (1) propagate throughout the entire network in response to a brief stimulus while avoiding runaway excitation; (2) exhibit spatially and temporally sparse dynamics; and (3) incorporate multiple neural trajectories, i.e., different input patterns should elicit distinct trajectories. We established that an unsupervised learning rule, termed presynaptic-dependent scaling (PSD), can achieve the proposed network dynamics. To quantify the structure of the trained networks, we developed a recurrence index, which revealed that presynaptic-dependent scaling generated a functionally feedforward network when training with a single stimulus. However, training the network with multiple input patterns established that: (1) multiple non-overlapping stable trajectories can be embedded in the network; and (2) the structure of the network became progressively more complex (recurrent) as the number of training patterns increased. In addition, we determined that PSD and spike-timing-dependent plasticity operating in parallel improved the ability of the network to incorporate multiple and less variable trajectories, but also shortened the duration of the neural trajectory. Together, these results establish one of the first learning rules that can embed multiple trajectories, each of which recruits all neurons, within recurrent neural networks in a self-organizing manner.

[1]  D. R. Euston,et al.  Fast-Forward Playback of Recent Memory Sequences in Prefrontal Cortex During Sleep , 2007, Science.

[2]  Antonio Malgaroli,et al.  LTP and adaptation to inactivity: Overlapping mechanisms and implications for metaplasticity , 2007, Neuropharmacology.

[3]  O. Sporns,et al.  Motifs in Brain Networks , 2004, PLoS biology.

[4]  Henry Markram,et al.  Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations , 2002, Neural Computation.

[5]  T. Harkany,et al.  Pyramidal cell communication within local networks in layer 2/3 of rat neocortex , 2003, The Journal of physiology.

[6]  Dean V Buonomano,et al.  A learning rule for the emergence of stable dynamics and timing in recurrent networks. , 2005, Journal of neurophysiology.

[7]  Dario L. Ringach,et al.  Dynamics of orientation tuning in macaque primary visual cortex , 1997, Nature.

[8]  Nicholas T. Carnevale,et al.  The NEURON Simulation Environment , 1997, Neural Computation.

[9]  Jerald D. Kralik,et al.  Real-time prediction of hand trajectory by ensembles of cortical neurons in primates , 2000, Nature.

[10]  D V Buonomano,et al.  Decoding Temporal Information: A Model Based on Short-Term Synaptic Plasticity , 2000, The Journal of Neuroscience.

[11]  Harald Haas,et al.  Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication , 2004, Science.

[12]  R. Malenka,et al.  Synaptic scaling mediated by glial TNF-alpha. , 2006, Nature.

[13]  V. Jayaraman,et al.  Intensity versus Identity Coding in an Olfactory System , 2003, Neuron.

[14]  V Latora,et al.  Efficient behavior of small-world networks. , 2001, Physical review letters.

[15]  L. Abbott,et al.  Competitive Hebbian learning through spike-timing-dependent synaptic plasticity , 2000, Nature Neuroscience.

[16]  Sen Song,et al.  Highly Nonrandom Features of Synaptic Connectivity in Local Cortical Circuits , 2005, PLoS biology.

[17]  D. McCormick,et al.  Turning on and off recurrent balanced cortical activity , 2003, Nature.

[18]  Gustavo Deco,et al.  Computational significance of transient dynamics in cortical networks , 2007, The European journal of neuroscience.

[19]  N. Seidah,et al.  Regulation by gastric acid of the processing of progastrin‐derived peptides in rat antral mucosa , 1997, The Journal of physiology.

[20]  G. Turrigiano Homeostatic signaling: the positive side of negative feedback , 2007, Current Opinion in Neurobiology.

[21]  R. Malenka,et al.  Synaptic scaling mediated by glial TNF-α , 2006, Nature.

[22]  A. Aertsen,et al.  Conditions for Propagating Synchronous Spiking and Asynchronous Firing Rates in a Cortical Network Model , 2008, The Journal of Neuroscience.

[23]  M. Fee,et al.  Using temperature to analyze temporal dynamics in the songbird motor pathway , 2008, Nature.

[24]  E. Bullmore,et al.  Hierarchical Organization of Human Cortical Networks in Health and Schizophrenia , 2008, The Journal of Neuroscience.

[25]  Anubhuthi Goel,et al.  Persistence of Experience-Induced Homeostatic Synaptic Plasticity through Adulthood in Superficial Layers of Mouse Visual Cortex , 2007, The Journal of Neuroscience.

[26]  Niraj S. Desai,et al.  Activity-dependent scaling of quantal amplitude in neocortical neurons , 1998, Nature.

[27]  Dean V. Buonomano,et al.  Mechanisms and significance of spike-timing dependent plasticity , 2002, Biological Cybernetics.

[28]  H. Markram,et al.  Organizing principles for a diversity of GABAergic interneurons and synapses in the neocortex. , 2000, Science.

[29]  Terrence J. Sejnowski,et al.  An Efficient Method for Computing Synaptic Conductances Based on a Kinetic Model of Receptor Binding , 1994, Neural Computation.

[30]  Y. Dan,et al.  Spike Timing-Dependent Plasticity of Neural Circuits , 2004, Neuron.

[31]  Xiao-Jing Wang Synaptic reverberation underlying mnemonic persistent activity , 2001, Trends in Neurosciences.

[32]  Markus Diesmann,et al.  Activity dynamics and propagation of synchronous spiking in locally connected random networks , 2003, Biological Cybernetics.

[33]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[34]  Gopal Santhanam,et al.  Preparatory activity in premotor and motor cortex reflects the speed of the upcoming reach. , 2006, Journal of neurophysiology.

[35]  H. Markram,et al.  Differential signaling via the same axon of neocortical pyramidal neurons. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[36]  Byron M. Yu,et al.  Techniques for extracting single-trial activity patterns from large-scale neural recordings , 2007, Current Opinion in Neurobiology.

[37]  John M. Beggs,et al.  Neuronal Avalanches in Neocortical Circuits , 2003, The Journal of Neuroscience.

[38]  Martin A. Lema,et al.  Delay model of the circadian pacemaker. , 2000, Journal of theoretical biology.

[39]  Claire E. J. Cheetham,et al.  Sensory Experience Alters Cortical Connectivity and Synaptic Function Site Specifically , 2007, The Journal of Neuroscience.

[40]  W. Maass,et al.  State-dependent computations: spatiotemporal processing in cortical networks , 2009, Nature Reviews Neuroscience.

[41]  Mark C. W. van Rossum,et al.  Stable Hebbian Learning from Spike Timing-Dependent Plasticity , 2000, The Journal of Neuroscience.

[42]  V. Jayaraman,et al.  Encoding and Decoding of Overlapping Odor Sequences , 2006, Neuron.

[43]  R. Tsien,et al.  Adaptation to Synaptic Inactivity in Hippocampal Neurons , 2005, Neuron.

[44]  L. Abbott,et al.  Neural network dynamics. , 2005, Annual review of neuroscience.

[45]  A. Schwartz,et al.  Motor cortical activity during drawing movements: population representation during lemniscate tracing. , 1999 .

[46]  Evgueniy V. Lubenov,et al.  Decoupling through Synchrony in Neuronal Circuits with Propagation Delays , 2008, Neuron.

[47]  Dean V Buonomano,et al.  Timing of neural responses in cortical organotypic slices , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[48]  Nicolas Brunel,et al.  Dynamics of networks of randomly connected excitatory and inhibitory spiking neurons , 2000, Journal of Physiology-Paris.

[49]  Maxim Bazhenov,et al.  Pathological Effect of Homeostatic Synaptic Scaling on Network Dynamics in Diseases of the Cortex , 2008, The Journal of Neuroscience.

[50]  H. Markram,et al.  Physiology and anatomy of synaptic connections between thick tufted pyramidal neurones in the developing rat neocortex. , 1997, The Journal of physiology.

[51]  Asohan Amarasingham,et al.  Internally Generated Cell Assembly Sequences in the Rat Hippocampus , 2008, Science.

[52]  K Albus,et al.  Activity-dependent development of spontaneous bioelectric activity in organotypic cultures of rat occipital cortex. , 2000, Brain research. Developmental brain research.

[53]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[54]  Asohan Amarasingham,et al.  Hippocampus Internally Generated Cell Assembly Sequences in the Rat , 2011 .

[55]  Dean V Buonomano,et al.  Development and Plasticity of Spontaneous Activity and Up States in Cortical Organotypic Slices , 2007, The Journal of Neuroscience.

[56]  Surya Ganguli,et al.  Memory traces in dynamical systems , 2008, Proceedings of the National Academy of Sciences.

[57]  Alexandre Pouget,et al.  Dynamical Constraints on Using Precise Spike Timing to Compute in Recurrent Cortical Networks , 2008, Neural Computation.

[58]  Eugene M. Izhikevich,et al.  Polychronization: Computation with Spikes , 2006, Neural Computation.

[59]  U. Karmarkar,et al.  Different forms of homeostatic plasticity are engaged with distinct temporal profiles , 2006, The European journal of neuroscience.

[60]  John M. Beggs,et al.  Neuronal Avalanches Are Diverse and Precise Activity Patterns That Are Stable for Many Hours in Cortical Slice Cultures , 2004, The Journal of Neuroscience.

[61]  L. Abbott,et al.  Cortical Development and Remapping through Spike Timing-Dependent Plasticity , 2001, Neuron.

[62]  T. Sejnowski,et al.  Homeostatic synaptic plasticity can explain post-traumatic epileptogenesis in chronically isolated neocortex. , 2005, Cerebral cortex.

[63]  O. Sporns,et al.  Organization, development and function of complex brain networks , 2004, Trends in Cognitive Sciences.

[64]  E. Marder,et al.  A Model Neuron with Activity-Dependent Conductances Regulated by Multiple Calcium Sensors , 1998, The Journal of Neuroscience.

[65]  G. Edelman,et al.  Large-scale model of mammalian thalamocortical systems , 2008, Proceedings of the National Academy of Sciences.

[66]  Gilles Laurent,et al.  Olfactory network dynamics and the coding of multidimensional signals , 2002, Nature Reviews Neuroscience.

[67]  D. Buonomano,et al.  The neural basis of temporal processing. , 2004, Annual review of neuroscience.

[68]  Javier F. Medina,et al.  Computer simulation of cerebellar information processing , 2000, Nature Neuroscience.

[69]  R. Tsien,et al.  Synapse-Specific Adaptations to Inactivity in Hippocampal Circuits Achieve Homeostatic Gain Control while Dampening Network Reverberation , 2008, Neuron.

[70]  K. Stratford,et al.  Synaptic transmission between individual pyramidal neurons of the rat visual cortex in vitro , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[71]  Maria V. Sanchez-Vives,et al.  Cellular and network mechanisms of rhythmic recurrent activity in neocortex , 2000, Nature Neuroscience.

[72]  D. Muller,et al.  Time course of synaptic development in hippocampal organotypic cultures. , 1993, Brain research. Developmental brain research.

[73]  Dean V. Buonomano,et al.  A Neural Network Model of Temporal Code Generation and Position-Invariant Pattern Recognition , 1999, Neural Computation.

[74]  John M Beggs,et al.  Critical branching captures activity in living neural networks and maximizes the number of metastable States. , 2005, Physical review letters.

[75]  Xiao-Jing Wang,et al.  Robust Spatial Working Memory through Homeostatic Synaptic Scaling in Heterogeneous Cortical Networks , 2003, Neuron.

[76]  Adam Prügel-Bennett,et al.  Analysis of synfire chains , 1995 .

[77]  L. Abbott,et al.  Synaptic plasticity: taming the beast , 2000, Nature Neuroscience.

[78]  K. D. Punta,et al.  An ultra-sparse code underlies the generation of neural sequences in a songbird , 2002 .

[79]  G. Edelman,et al.  Spike-timing dynamics of neuronal groups. , 2004, Cerebral cortex.

[80]  Gilles Laurent,et al.  Transient Dynamics for Neural Processing , 2008, Science.

[81]  A. Schwartz,et al.  Motor cortical activity during drawing movements: population representation during spiral tracing. , 1999, Journal of neurophysiology.

[82]  Eduardo D. Sontag,et al.  Computational Aspects of Feedback in Neural Circuits , 2006, PLoS Comput. Biol..

[83]  Frank C. Hoppensteadt,et al.  Bursts as a unit of neural information: selective communication via resonance , 2003, Trends in Neurosciences.

[84]  V. Murthy,et al.  Multiple forms of synaptic plasticity triggered by selective suppression of activity in individual neurons , 2002, Nature.

[85]  D. Johnston,et al.  Target Cell-Dependent Normalization of Transmitter Release at Neocortical Synapses , 2005, Science.