Computational modeling of neural plasticity for self-organization of neural networks

Self-organization in biological nervous systems during the lifetime is known to largely occur through a process of plasticity that is dependent upon the spike-timing activity in connected neurons. In the field of computational neuroscience, much effort has been dedicated to building up computational models of neural plasticity to replicate experimental data. Most recently, increasing attention has been paid to understanding the role of neural plasticity in functional and structural neural self-organization, as well as its influence on the learning performance of neural networks for accomplishing machine learning tasks such as classification and regression. Although many ideas and hypothesis have been suggested, the relationship between the structure, dynamics and learning performance of neural networks remains elusive. The purpose of this article is to review the most important computational models for neural plasticity and discuss various ideas about neural plasticity's role. Finally, we suggest a few promising research directions, in particular those along the line that combines findings in computational neuroscience and systems biology, and their synergetic roles in understanding learning, memory and cognition, thereby bridging the gap between computational neuroscience, systems biology and computational intelligence.

[1]  Yaochu Jin,et al.  The emergence of polychronous groups under varying input patterns, plasticity rules and network connectivities , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[2]  Roman Bek,et al.  Discourse on one way in which a quantum-mechanics language on the classical logical base can be built up , 1978, Kybernetika.

[3]  Jean-Pascal Pfister,et al.  Optimality Model of Unsupervised Spike-Timing-Dependent Plasticity: Synaptic Memory and Weight Distribution , 2007, Neural Computation.

[4]  W. Gerstner,et al.  Spike-Timing-Dependent Plasticity: A Comprehensive Overview , 2012, Front. Syn. Neurosci..

[5]  R. Malenka,et al.  Synaptic Plasticity: Multiple Forms, Functions, and Mechanisms , 2008, Neuropsychopharmacology.

[6]  Fangzheng Xue,et al.  Computational capability of liquid state machines with spike-timing-dependent plasticity , 2013, Neurocomputing.

[7]  Mu-Ming Poo,et al.  Spike-Timing Dependent Plasticity Beyond Synapse – Pre- and Post-Synaptic Plasticity of Intrinsic Neuronal Excitability , 2010, Front. Syn. Neurosci..

[8]  N. Spruston,et al.  Questions about STDP as a General Model of Synaptic Plasticity , 2010, Front. Syn. Neurosci..

[9]  Jon T. Brown,et al.  Activity‐dependent depression of the spike after‐depolarization generates long‐lasting intrinsic plasticity in hippocampal CA3 pyramidal neurons , 2009, The Journal of physiology.

[10]  A. Ghysen,et al.  The origin and evolution of the nervous system. , 2003, The International journal of developmental biology.

[12]  Benjamin Schrauwen,et al.  Reservoir Computing Trends , 2012, KI - Künstliche Intelligenz.

[13]  Farren J. Isaacs,et al.  Computational studies of gene regulatory networks: in numero molecular biology , 2001, Nature Reviews Genetics.

[14]  Yan Meng,et al.  Modeling Activity-Dependent Plasticity in BCM Spiking Neural Networks With Application to Human Behavior Recognition , 2011, IEEE Transactions on Neural Networks.

[15]  Gayle M. Wittenberg,et al.  Spike Timing Dependent Plasticity: A Consequence of More Fundamental Learning Rules , 2010, Front. Comput. Neurosci..

[16]  Shun-ichi Amari,et al.  Field theory of self-organizing neural nets , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[17]  Mineichi Kudo,et al.  Multidimensional curve classification using passing-through regions , 1999, Pattern Recognit. Lett..

[18]  Li I. Zhang,et al.  A critical window for cooperation and competition among developing retinotectal synapses , 1998, Nature.

[19]  L. Abbott,et al.  Competitive Hebbian learning through spike-timing-dependent synaptic plasticity , 2000, Nature Neuroscience.

[20]  Eugene M. Izhikevich,et al.  Polychronization: Computation with Spikes , 2006, Neural Computation.

[21]  D. J. Felleman,et al.  Topographic reorganization of somatosensory cortical areas 3b and 1 in adult monkeys following restricted deafferentation , 1983, Neuroscience.

[22]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[23]  Henry Markram,et al.  Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations , 2002, Neural Computation.

[24]  Matthieu Gilson,et al.  Emergence of network structure due to spike-timing-dependent plasticity in recurrent neuronal networks III: Partially connected neurons driven by spontaneous activity , 2009, Biological Cybernetics.

[25]  C. Malsburg Self-organization of orientation sensitive cells in the striate cortex , 2004, Kybernetik.

[26]  M. Cynader,et al.  Somatosensory cortical map changes following digit amputation in adult monkeys , 1984, The Journal of comparative neurology.

[27]  Thomas Nowotny,et al.  Spatial representation of temporal information through spike-timing-dependent plasticity. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[28]  C.J.H. Mann,et al.  Modeling Neural Development , 2004 .

[29]  Dan Ventura,et al.  Preparing More Effective Liquid State Machines Using Hebbian Learning , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[30]  Jochen J. Steil,et al.  Online reservoir adaptation by intrinsic plasticity for backpropagation-decorrelation and echo state learning , 2007, Neural Networks.

[31]  Hiroaki Kitano A simple model of neurogenesis and cell differentiation based on evolutionary large-scale chaos , 1995 .

[32]  N. Brunel,et al.  Calcium-based plasticity model explains sensitivity of synaptic changes to spike pattern, rate, and dendritic location , 2012, Proceedings of the National Academy of Sciences.

[33]  A. V. Ooyen Using theoretical models to analyse neural development , 2011, Nature Reviews Neuroscience.

[34]  Peter A. Appleby,et al.  Triphasic spike-timing-dependent plasticity organizes networks to produce robust sequences of neural activity , 2012, Front. Comput. Neurosci..

[35]  Matthieu Gilson,et al.  Emergence of network structure due to spike-timing-dependent plasticity in recurrent neuronal networks. II. Input selectivity—symmetry breaking , 2009, Biological Cybernetics.

[36]  Jing Wu,et al.  Arc/Arg3.1 Mediates Homeostatic Synaptic Scaling of AMPA Receptors , 2006, Neuron.

[37]  Rick L Jenison,et al.  A window to the amygdala: concurrent encoding of choice preference in multi-unit activity in the amygdala and in eye movements , 2011, BMC Neuroscience.

[38]  Hiroaki Kitano,et al.  A Simple Model of Neurogenesis and Cell Differentiation Based on Evolutionary Large-Scale Chaos , 1994, Artificial Life.

[39]  Matthieu Gilson,et al.  Frontiers in Computational Neuroscience Computational Neuroscience , 2022 .

[40]  Yaochu Jin,et al.  Calcium control of triphasic hippocampal STDP , 2012, Journal of Computational Neuroscience.

[41]  Jiri Pospichal,et al.  Improving the Prediction Accuracy of Echo State Neural Networks by Anti-Oja's Learning , 2007, ICANN.

[42]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[43]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[44]  Bernhard Sendhoff,et al.  Evolution and Analysis of Genetic Networks for Stable Cellular Growth and Regeneration , 2012, Artificial Life.

[45]  W. Gerstner,et al.  Connectivity reflects coding: a model of voltage-based STDP with homeostasis , 2010, Nature Neuroscience.

[46]  Jochen J. Steil,et al.  Improving reservoirs using intrinsic plasticity , 2008, Neurocomputing.

[47]  Mark C. W. van Rossum,et al.  Correlation based learning from spike timing dependent plasticity , 2001, Neurocomputing.

[48]  Lubica Benuskova,et al.  Modeling brain dynamics using computational neurogenetic approach , 2008, Cognitive Neurodynamics.

[49]  D. Feldman,et al.  Timing-Based LTP and LTD at Vertical Inputs to Layer II/III Pyramidal Cells in Rat Barrel Cortex , 2000, Neuron.

[50]  K. Svoboda,et al.  Experience-dependent structural synaptic plasticity in the mammalian brain , 2009, Nature Reviews Neuroscience.

[51]  N. Spruston,et al.  Postsynaptic depolarization requirements for LTP and LTD: a critique of spike timing-dependent plasticity , 2005, Nature Neuroscience.

[52]  Herbert Jaeger,et al.  Reservoir computing approaches to recurrent neural network training , 2009, Comput. Sci. Rev..

[53]  N. Geard,et al.  Dynamical approaches to modeling developmental gene regulatory networks. , 2009, Birth defects research. Part C, Embryo today : reviews.

[54]  Peter Földiák,et al.  Adaptation and decorrelation in the cortex , 1989 .

[55]  Ana Freire,et al.  Potential role of the glyoxalase pathway as a drug target in Leishmania infantum: an exact steady-state model analysis , 2007, BMC Systems Biology.

[56]  Chunguang Li,et al.  Synergies between Intrinsic and Synaptic Plasticity Based on Information Theoretic Learning , 2013, PloS one.

[57]  Nicolas Le Novère,et al.  The long journey to a Systems Biology of neuronal function , 2007, BMC systems biology.

[58]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.

[59]  P. Érdi,et al.  Self-organizing mechanism for the formation of ordered neural mappings , 2004, Biological Cybernetics.

[60]  Xin Yao,et al.  Evolving Functional Symmetry in a Three Dimensional Model of an Elongated Organism , 2008, ALIFE.

[61]  E. Bienenstock,et al.  Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[62]  E. Oja Simplified neuron model as a principal component analyzer , 1982, Journal of mathematical biology.

[63]  Samy Bengio,et al.  Delay learning and polychronization for reservoir computing , 2008, Neurocomputing.

[64]  Gordon Pipa,et al.  2007 Special Issue: Fading memory and time series prediction in recurrent networks with different forms of plasticity , 2007 .

[65]  Steven W. Flavell,et al.  Signaling mechanisms linking neuronal activity to gene expression and plasticity of the nervous system. , 2008, Annual review of neuroscience.

[66]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[67]  E. Izhikevich Solving the distal reward problem through linkage of STDP and dopamine signaling , 2007, BMC Neuroscience.

[68]  Yan Meng,et al.  > Replace This Line with Your Paper Identification Number (double-click Here to Edit) < 1 , 2022 .

[69]  G. Wagner,et al.  Self-stabilization of neuronal networks , 1986, Biological Cybernetics.

[70]  Yaochu Jin,et al.  A unified computational model of the genetic regulatory networks underlying synaptic, intrinsic and homeostatic plasticity , 2011, BMC Neuroscience.

[71]  Robert A. Legenstein,et al.  A Learning Theory for Reward-Modulated Spike-Timing-Dependent Plasticity with Application to Biofeedback , 2008, PLoS Comput. Biol..

[72]  S. Wang,et al.  Malleability of Spike-Timing-Dependent Plasticity at the CA3–CA1 Synapse , 2006, The Journal of Neuroscience.

[73]  Matthieu Gilson,et al.  Emergence of network structure due to spike-timing-dependent plasticity in recurrent neuronal networks IV , 2009, Biological Cybernetics.

[74]  Srdjan Ostojic,et al.  Natural firing patterns reduce sensitivity of synaptic plasticity to spike-timing , 2013, BMC Neuroscience.

[75]  Simei Gomes Wysoski,et al.  Computational Neurogenetic Modelling: a Pathway to New Discoveries in Genetic Neuroscience , 2006, Int. J. Neural Syst..

[76]  Jason Dennis Shepherd Arc mediates homeostatic synaptic scaling of AMPA receptors via its interaction with the endocytic machinery , 2008 .

[77]  Gustavo Pedraza-Alva,et al.  Shaping synaptic plasticity: The role of activity-mediated epigenetic regulation on gene transcription , 2013, International Journal of Developmental Neuroscience.

[78]  Sander M. Bohte,et al.  Reducing the Variability of Neural Responses: A Computational Theory of Spike-Timing-Dependent Plasticity , 2007, Neural Computation.

[79]  Matthieu Gilson,et al.  Emergence of network structure due to spike-timing-dependent plasticity in recurrent neuronal networks. I. Input selectivity–strengthening correlated input pathways , 2009, Biological Cybernetics.

[80]  H. Jaeger,et al.  Reservoir riddles: suggestions for echo state network research , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[81]  Bernhard Sendhoff,et al.  A Gene Regulatory Model for the Development of Primitive Nervous Systems , 2008, ICONIP.

[82]  C. Malsburg,et al.  How patterned neural connections can be set up by self-organization , 1976, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[83]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[84]  Geoffrey E. Hinton Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.

[85]  I E Dammasch,et al.  Self-stabilization of neuronal networks , 1988, Biological Cybernetics.

[86]  Herbert Jaeger,et al.  The''echo state''approach to analysing and training recurrent neural networks , 2001 .

[87]  D J Willshaw,et al.  A marker induction mechanism for the establishment of ordered neural mappings: its application to the retinotectal problem. , 1979, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[88]  M. Bear,et al.  Metaplasticity: the plasticity of synaptic plasticity , 1996, Trends in Neurosciences.

[89]  Jochen Triesch,et al.  Optimizing Generic Neural Microcircuits through Reward Modulated STDP , 2009, ICANN.

[90]  Xin Yao,et al.  Emergent Distribution of Computational Workload in the Evolution of an Undulatory Animat , 2010, SAB.

[91]  V. Han,et al.  Synaptic plasticity in a cerebellum-like structure depends on temporal order , 1997, Nature.

[92]  Eric Shea-Brown,et al.  Consistency requirements determine optimal noise correlations in neural populations , 2013, BMC Neuroscience.

[93]  W. Gerstner,et al.  Generalized Bienenstock-Cooper-Munro rule for spiking neurons that maximizes information transmission. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[94]  Jean-Pascal Pfister,et al.  STDP in Adaptive Neurons Gives Close-To-Optimal Information Transmission , 2010, Front. Comput. Neurosci..

[95]  Alexander Zien,et al.  Semi-Supervised Learning , 2006 .

[96]  Andreas Knoblauch,et al.  STDP, Hebbian cell assemblies, and temporal coding by spike synchronization , 2011, BMC Neuroscience.