Introducing Astrocytes on a Neuromorphic Processor: Synchronization, Local Plasticity and Edge of Chaos

While there is still a lot to learn about astrocytes and their neuromodulatory role in the spatial and temporal integration of neuronal activity, their introduction to neuromorphic hardware is timely, facilitating their computational exploration in basic science questions as well as their exploitation in real-world applications. Here, we present an astrocytic module that enables the development of a spiking Neuronal-Astrocytic Network (SNAN) into Intel's Loihi neuromorphic chip. The basis of the Loihi module is an end-to-end biophysically plausible compartmental model of an astrocyte that simulates the intracellular activity in response to the synaptic activity in space and time. To demonstrate the functional role of astrocytes in SNAN, we describe how an astrocyte may sense and induce activity-dependent neuronal synchronization, switch on and off spike-time-dependent plasticity (STDP) to introduce single-shot learning, and monitor the transition between ordered and chaotic activity at the synaptic space. Our module may serve as an extension for neuromorphic hardware, by either replicating or exploring the distinct computational roles that astrocytes have in forming biological intelligence.

[1]  Robert A. Legenstein,et al.  Long short-term memory and Learning-to-learn in networks of spiking neurons , 2018, NeurIPS.

[2]  Maiken Nedergaard,et al.  How do astrocytes participate in neural plasticity? , 2015, Cold Spring Harbor perspectives in biology.

[3]  Garrick Orchard,et al.  SLAYER: Spike Layer Error Reassignment in Time , 2018, NeurIPS.

[4]  Eduardo D. Martín,et al.  Astrocytes Mediate In Vivo Cholinergic-Induced Synaptic Plasticity , 2012, PLoS biology.

[5]  James P. Crutchfield,et al.  Revisiting the Edge of Chaos: Evolving Cellular Automata to Perform Computations , 1993, Complex Syst..

[6]  J. Meldolesi,et al.  Astrocytes, from brain glue to communication elements: the revolution continues , 2005, Nature Reviews Neuroscience.

[7]  Nils Bertschinger,et al.  Real-Time Computation at the Edge of Chaos in Recurrent Neural Networks , 2004, Neural Computation.

[8]  P. Fries A mechanism for cognitive dynamics: neuronal communication through neuronal coherence , 2005, Trends in Cognitive Sciences.

[9]  Mu-ming Poo,et al.  ATP Released by Astrocytes Mediates Glutamatergic Activity-Dependent Heterosynaptic Suppression , 2003, Neuron.

[10]  S. Finkbeiner,et al.  Glutamate induces calcium waves in cultured astrocytes: long-range glial signaling. , 1990, Science.

[11]  Hong Wang,et al.  Loihi: A Neuromorphic Manycore Processor with On-Chip Learning , 2018, IEEE Micro.

[12]  Ioannis Polykretis,et al.  The Astrocytic Microdomain as a Generative Mechanism for Local Plasticity , 2018, BI.

[13]  Ricard V. Solé,et al.  Information at the edge of chaos in fluid neural networks , 1995 .

[14]  David Fitzpatrick,et al.  Local Order within Global Disorder: Synaptic Architecture of Visual Space , 2017, Neuron.

[15]  Misha B. Ahrens,et al.  Glia Accumulate Evidence that Actions Are Futile and Suppress Unsuccessful Behavior , 2019, Cell.

[16]  John M. Beggs,et al.  Neuronal Avalanches in Neocortical Circuits , 2003, The Journal of Neuroscience.

[17]  Enzo Pasquale Scilingo,et al.  Novel Spiking Neuron-Astrocyte Networks based on nonlinear transistor-like models of tripartite synapses , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[18]  Robert A. Legenstein,et al.  2007 Special Issue: Edge of chaos and prediction of computational performance for neural circuit models , 2007 .

[19]  Michael Chen,et al.  Forebrain engraftment by human glial progenitor cells enhances synaptic plasticity and learning in adult mice. , 2013, Cell stem cell.

[20]  C. Thompson The Statistical Mechanics of Phase Transitions , 1978 .

[21]  Kostis P. Michmizos,et al.  Computational Astrocyence: Astrocytes encode inhibitory activity into the frequency and spatial extent of their calcium elevations , 2019, 2019 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI).

[22]  Steve B. Furber,et al.  The SpiNNaker Project , 2014, Proceedings of the IEEE.

[23]  Alois Knoll,et al.  End to End Learning of Spiking Neural Network Based on R-STDP for a Lane Keeping Vehicle , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[24]  Matthew Cook,et al.  Unsupervised learning of digit recognition using spike-timing-dependent plasticity , 2015, Front. Comput. Neurosci..

[25]  Victor B. Kazantsev,et al.  Astrocyte as Spatiotemporal Integrating Detector of Neuronal Activity , 2019, Front. Physiol..

[26]  Johannes Schemmel,et al.  A wafer-scale neuromorphic hardware system for large-scale neural modeling , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[27]  Hong Wang,et al.  Programming Spiking Neural Networks on Intel’s Loihi , 2018, Computer.

[28]  S. Duan,et al.  Heterosynaptic long‐term depression mediated by ATP released from astrocytes , 2013, Glia.

[29]  A. X. Xie,et al.  Bidirectional Scaling of Astrocytic Metabotropic Glutamate Receptor Signaling following Long-Term Changes in Neuronal Firing Rates , 2012, PloS one.

[30]  Zbigniew R Struzik,et al.  Universal scaling law in human behavioral organization. , 2007, Physical review letters.

[31]  E. Maywood,et al.  Astrocytes Control Circadian Timekeeping in the Suprachiasmatic Nucleus via Glutamatergic Signaling , 2017, Neuron.

[32]  Pablo Mesejo,et al.  Artificial Astrocytes Improve Neural Network Performance , 2011, PloS one.

[33]  Y. Goda,et al.  Astrocytes regulate heterogeneity of presynaptic strengths in hippocampal networks , 2016, Proceedings of the National Academy of Sciences.

[34]  Kostis P. Michmizos,et al.  The Causal Role of Astrocytes in Slow-Wave Rhythmogenesis: A Computational Modelling Study , 2017, ArXiv.

[35]  R. Cunha,et al.  Adenosine A2A Receptors Are Essential for Long-Term Potentiation of NMDA-EPSCs at Hippocampal Mossy Fiber Synapses , 2008, Neuron.

[36]  J. Lacaille,et al.  GABAergic Network Activation of Glial Cells Underlies Hippocampal Heterosynaptic Depression , 2006, The Journal of Neuroscience.

[37]  G. Lynch,et al.  Heterosynaptic depression: a postsynaptic correlate of long-term potentiation , 1977, Nature.

[38]  P. Haydon,et al.  Physiological astrocytic calcium levels stimulate glutamate release to modulate adjacent neurons. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[39]  Kostis P. Michmizos,et al.  Spiking Neural Network on Neuromorphic Hardware for Energy-Efficient Unidimensional SLAM , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[40]  P. Fries Rhythms for Cognition: Communication through Coherence , 2015, Neuron.

[41]  J. Huguenard,et al.  Astrocytes potentiate GABAergic transmission in the thalamic reticular nucleus via endozepine signaling , 2013, Proceedings of the National Academy of Sciences.

[42]  E. Hanse,et al.  Astrocyte-mediated short-term synaptic depression in the rat hippocampal CA1 area: two modes of decreasing release probability , 2011, BMC Neuroscience.

[43]  S. Gobbo,et al.  Neuronal Synchrony Mediated by Astrocytic Glutamate through Activation of Extrasynaptic NMDA Receptors , 2004, Neuron.

[44]  Mriganka Sur,et al.  Neuron-glia networks: integral gear of brain function , 2014, Front. Cell. Neurosci..

[45]  M. London,et al.  Astrocytic Activation Generates De Novo Neuronal Potentiation and Memory Enhancement , 2018, Cell.

[46]  S. Oliet,et al.  Long term potentiation depends on release of D-serine from astrocytes , 2009, Nature.

[47]  G. Perea,et al.  Astrocytes Potentiate Transmitter Release at Single Hippocampal Synapses , 2007, Science.

[48]  D. Rusakov,et al.  Multiplexed calcium imaging of single-synapse activity and astroglial responses in the intact brain , 2019, Neuroscience Letters.

[49]  M. Sur,et al.  Optogenetic astrocyte activation modulates response selectivity of visual cortex neurons in vivo , 2014, Nature Communications.

[50]  Bartlett W. Mel,et al.  Impact of Active Dendrites and Structural Plasticity on the Memory Capacity of Neural Tissue , 2001, Neuron.

[51]  Enzo Tagliazucchi,et al.  Brain complexity born out of criticality , 2012, 1211.0309.

[52]  James P. Crutchfield,et al.  Computation at the Onset of Chaos , 1991 .

[53]  E. Shigetomi,et al.  Probing the Complexities of Astrocyte Calcium Signaling. , 2016, Trends in cell biology.

[54]  Cathryn L. Kubera,et al.  Astrocytic Purinergic Signaling Coordinates Synaptic Networks , 2005, Science.

[55]  B. Barres The Mystery and Magic of Glia: A Perspective on Their Roles in Health and Disease , 2008, Neuron.

[56]  Jason Lloyd-Price,et al.  Mutual information in random Boolean models of regulatory networks. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[57]  Khaleel Bhaukaurally,et al.  Local Ca2+ detection and modulation of synaptic release by astrocytes , 2011, Nature Neuroscience.

[58]  Grant R. Gordon,et al.  Astrocyte-Mediated Distributed Plasticity at Hypothalamic Glutamate Synapses , 2009, Neuron.

[59]  C. Giaume,et al.  Astrocyte calcium waves: What they are and what they do , 2006, Glia.

[60]  Christopher G. Langton,et al.  Computation at the edge of chaos: Phase transitions and emergent computation , 1990 .

[61]  N. Spruston,et al.  Astrocytes integrate and drive action potential firing in inhibitory subnetworks , 2018, Nature Communications.

[62]  Vladimir Ivanov,et al.  A Neural-Astrocytic Network Architecture: Astrocytic calcium waves modulate synchronous neuronal activity , 2018, Proceedings of the International Conference on Neuromorphic Systems.

[63]  S. Oliet,et al.  Gliotransmitters Travel in Time and Space , 2014, Neuron.

[64]  Nicolas Liaudet,et al.  Astrocyte Ca2+ signalling: an unexpected complexity , 2014, Nature Reviews Neuroscience.

[65]  John M. Beggs,et al.  Universal critical dynamics in high resolution neuronal avalanche data. , 2012, Physical review letters.

[66]  Bartlett W. Mel The Clusteron: Toward a Simple Abstraction for a Complex Neuron , 1991, NIPS.

[67]  Vladimir Parpura,et al.  A possible role of astrocytes in contextual memory retrieval: An analysis obtained using a quantitative framework , 2013, Front. Comput. Neurosci..

[68]  G. Perea,et al.  Tripartite synapses: astrocytes process and control synaptic information , 2009, Trends in Neurosciences.

[69]  Peter Blouw,et al.  Benchmarking Keyword Spotting Efficiency on Neuromorphic Hardware , 2018, NICE '19.

[70]  Andrew S. Cassidy,et al.  A million spiking-neuron integrated circuit with a scalable communication network and interface , 2014, Science.