Effects of Cellular Homeostatic Intrinsic Plasticity on Dynamical and Computational Properties of Biological Recurrent Neural Networks

Homeostatic intrinsic plasticity (HIP) is a ubiquitous cellular mechanism regulating neuronal activity, cardinal for the proper functioning of nervous systems. In invertebrates, HIP is critical for orchestrating stereotyped activity patterns. The functional impact of HIP remains more obscure in vertebrate networks, where higher order cognitive processes rely on complex neural dynamics. The hypothesis has emerged that HIP might control the complexity of activity dynamics in recurrent networks, with important computational consequences. However, conflicting results about the causal relationships between cellular HIP, network dynamics, and computational performance have arisen from machine-learning studies. Here, we assess how cellular HIP effects translate into collective dynamics and computational properties in biological recurrent networks. We develop a realistic multiscale model including a generic HIP rule regulating the neuronal threshold with actual molecular signaling pathways kinetics, Dale's principle, sparse connectivity, synaptic balance, and Hebbian synaptic plasticity (SP). Dynamic mean-field analysis and simulations unravel that HIP sets a working point at which inputs are transduced by large derivative ranges of the transfer function. This cellular mechanism ensures increased network dynamics complexity, robust balance with SP at the edge of chaos, and improved input separability. Although critically dependent upon balanced excitatory and inhibitory drives, these effects display striking robustness to changes in network architecture, learning rates, and input features. Thus, the mechanism we unveil might represent a ubiquitous cellular basis for complex dynamics in neural networks. Understanding this robustness is an important challenge to unraveling principles underlying self-organization around criticality in biological recurrent neural networks.

[1]  Matthias H Hennig,et al.  A diffusive homeostatic signal maintains neural heterogeneity and responsiveness in cortical networks , 2015, bioRxiv.

[2]  Wytse J. Wadman,et al.  Source (or Part of the following Source): Type Article Title Homeostatic Scaling of Excitability in Recurrent Neural Networks. Author(s) Homeostatic Scaling of Excitability in Recurrent Neural Networks , 2022 .

[3]  J. Naudé,et al.  A Theory of Rate Coding Control by Intrinsic Plasticity Effects , 2012, PLoS Comput. Biol..

[4]  Claudius Gros,et al.  Intrinsic Adaptation in Autonomous Recurrent Neural Networks , 2011, Neural Computation.

[5]  G. Turrigiano Too many cooks? Intrinsic and synaptic homeostatic mechanisms in cortical circuit refinement. , 2011, Annual review of neuroscience.

[6]  Niraj S. Desai,et al.  Homeostatic Plasticity and STDP: Keeping a Neuron's Cool in a Fluctuating World , 2010, Front. Syn. Neurosci..

[7]  Mark C. W. van Rossum,et al.  Homeostasis of intrinsic excitability in hippocampal neurones: dynamics and mechanism of the response to chronic depolarization , 2010, The Journal of physiology.

[8]  L. F. Abbott,et al.  Generating Coherent Patterns of Activity from Chaotic Neural Networks , 2009, Neuron.

[9]  Gordon Pipa,et al.  SORN: A Self-Organizing Recurrent Neural Network , 2009, Front. Comput. Neurosci..

[10]  Olivier D. Faugeras,et al.  A Constructive Mean-Field Analysis of Multi-Population Neural Networks with Random Synaptic Weights and Stochastic Inputs , 2008, Front. Comput. Neurosci..

[11]  W. Abraham Metaplasticity: tuning synapses and networks for plasticity , 2008, Nature Reviews Neuroscience.

[12]  Gina G. Turrigiano,et al.  Multiple Modes of Network Homeostasis in Visual Cortical Layer 2/3 , 2008, The Journal of Neuroscience.

[13]  Jochen J. Steil,et al.  Improving reservoirs using intrinsic plasticity , 2008, Neurocomputing.

[14]  Bruno Cessac,et al.  A Mathematical Analysis of the Effects of Hebbian Learning Rules on the Dynamics and Structure of Discrete-Time Random Recurrent Neural Networks , 2007, Neural Computation.

[15]  D. Ringach,et al.  The Operating Point of the Cortex: Neurons as Large Deviation Detectors , 2007, The Journal of Neuroscience.

[16]  Bruno Cessac,et al.  Effects of Hebbian learning on the dynamics and structure of random networks with inhibitory and excitatory neurons , 2007, Journal of Physiology-Paris.

[17]  Emmanuel Guigon,et al.  A New Principle for Information Storage in an Enzymatic Pathway Model , 2007, PLoS Comput. Biol..

[18]  Jochen J. Steil,et al.  Online reservoir adaptation by intrinsic plasticity for backpropagation-decorrelation and echo state learning , 2007, Neural Networks.

[19]  Gordon Pipa,et al.  2007 Special Issue: Fading memory and time series prediction in recurrent networks with different forms of plasticity , 2007 .

[20]  Jochen J. Steil,et al.  Intrinsic plasticity for reservoir learning algorithms , 2007, ESANN.

[21]  D. Schulz Plasticity and stability in neuronal output via changes in intrinsic excitability: it's what's inside that counts , 2006, Journal of Experimental Biology.

[22]  E. Marder,et al.  Variability, compensation and homeostasis in neuron and network function , 2006, Nature Reviews Neuroscience.

[23]  J. Gibson,et al.  Role for the subthreshold currents ILeak and IH in the homeostatic control of excitability in neocortical somatostatin-positive inhibitory neurons. , 2006, Journal of neurophysiology.

[24]  W. Wadman,et al.  Background activity regulates excitability of rat hippocampal CA1 pyramidal neurons by adaptation of a K+ conductance. , 2006, Journal of neurophysiology.

[25]  U. Karmarkar,et al.  Different forms of homeostatic plasticity are engaged with distinct temporal profiles , 2006, The European journal of neuroscience.

[26]  Lyle J. Graham,et al.  Contrasting Effects of the Persistent Na+ Current on Neuronal Excitability and Spike Timing , 2006, Neuron.

[27]  Gordon Pipa,et al.  The combination of STDP and intrinsic plasticity yields complex dynamics in recurrent spiking networks , 2006, ESANN.

[28]  R. Chitwood,et al.  Activity-dependent decrease of excitability in rat hippocampal neurons through increases in Ih , 2005, Nature Neuroscience.

[29]  Jochen Triesch,et al.  A Gradient Rule for the Plasticity of a Neuron's Intrinsic Excitability , 2005, ICANN.

[30]  L. Abbott,et al.  Neural network dynamics. , 2005, Annual review of neuroscience.

[31]  Wei Zhang,et al.  Persistent changes in the intrinsic excitability of rat deep cerebellar nuclear neurones induced by EPSP or IPSP bursts , 2004, The Journal of physiology.

[32]  James S Trimmer,et al.  Regulation of ion channel localization and phosphorylation by neuronal activity , 2004, Nature Neuroscience.

[33]  Robert H. Cudmore,et al.  Long-term potentiation of intrinsic excitability in LV visual cortical neurons. , 2004, Journal of neurophysiology.

[34]  Nils Bertschinger,et al.  Real-Time Computation at the Edge of Chaos in Recurrent Neural Networks , 2004, Neural Computation.

[35]  W. Wadman,et al.  Homeostatic scaling of neuronal excitability by synaptic modulation of somatic hyperpolarization-activated Ih channels. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[36]  Y. Ben-Ari,et al.  Long-term plasticity at GABAergic and glycinergic synapses: mechanisms and functional significance , 2002, Trends in Neurosciences.

[37]  M. Samuelides,et al.  Large deviations and mean-field theory for asymmetric random recurrent neural networks , 2002 .

[38]  John M. Bekkers,et al.  Modulation of Excitability by α-Dendrotoxin-Sensitive Potassium Channels in Neocortical Pyramidal Neurons , 2001, The Journal of Neuroscience.

[39]  William Wisden,et al.  Adaptive regulation of neuronal excitability by a voltage- independent potassium conductance , 2001, Nature.

[40]  M. Poo,et al.  Enhancement of presynaptic neuronal excitability by correlated presynaptic and postsynaptic spiking , 2000, Nature Neuroscience.

[41]  Niraj S. Desai,et al.  Plasticity in the intrinsic excitability of cortical pyramidal neurons , 1999, Nature Neuroscience.

[42]  Christof Koch,et al.  How voltage-dependent conductances can adapt to maximize the information encoded by neuronal firing rate , 1999, Nature Neuroscience.

[43]  G. Turrigiano Homeostatic plasticity in neuronal networks: the more things change, the more they stay the same , 1999, Trends in Neurosciences.

[44]  X J Wang,et al.  Calcium coding and adaptive temporal computation in cortical pyramidal neurons. , 1998, Journal of neurophysiology.

[45]  Firdaus E. Udwadia,et al.  An efficient QR based method for the computation of Lyapunov exponents , 1997 .

[46]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[47]  B. Sakmann,et al.  Ca2+ buffering and action potential-evoked Ca2+ signaling in dendrites of pyramidal neurons. , 1996, Biophysical journal.

[48]  G. B. Arous,et al.  Large deviations for Langevin spin glass dynamics , 1995 .

[49]  B Cessac,et al.  Mean-field equations, bifurcation map and chaos in discrete time, continuous state, random neural networks , 1995, Acta biotheoretica.

[50]  B. Cessac Increase in Complexity in Random Neural Networks , 1995 .

[51]  Terrence J. Sejnowski,et al.  RAPID STATE SWITCHING IN BALANCED CORTICAL NETWORK MODELS , 1995 .

[52]  B. Cessac,et al.  On bifurcations and chaos in random neural networks , 1994 .

[53]  Michael N. Shadlen,et al.  Noise, neural codes and cortical organization , 1994, Current Opinion in Neurobiology.

[54]  E. Marder,et al.  Activity-dependent regulation of conductances in model neurons. , 1993, Science.

[55]  Sommers,et al.  Chaos in random neural networks. , 1988, Physical review letters.

[56]  D. Ruelle,et al.  Ergodic theory of chaos and strange attractors , 1985 .

[57]  D. Rand,et al.  Dynamical Systems and Turbulence, Warwick 1980 , 1981 .

[58]  F. Takens Detecting strange attractors in turbulence , 1981 .