Exploring Self-Repair in a Coupled Spiking Astrocyte Neural Network

It is now known that astrocytes modulate the activity at the tripartite synapses where indirect signaling via the retrograde messengers, endocannabinoids, leads to a localized self-repairing capability. In this paper, a self-repairing spiking astrocyte neural network (SANN) is proposed to demonstrate a distributed self-repairing capability at the network level. The SANN uses a novel learning rule that combines the spike-timing-dependent plasticity (STDP) and Bienenstock, Cooper, and Munro (BCM) learning rules (hereafter referred to as the BSTDP rule). In this learning rule, the synaptic weight potentiation is not only driven by the temporal difference between the presynaptic and postsynaptic neuron firing times but also by the postsynaptic neuron activity. We will show in this paper that the BSTDP modulates the height of the plasticity window to establish an input–output mapping (in the learning phase) and also maintains this mapping (via self-repair) if synaptic pathways become dysfunctional. It is the functional dependence of postsynaptic neuron firing activity on the height of the plasticity window that underpins how the proposed SANN self-repairs on the fly. The SANN also uses the coupling between the tripartite synapses and $\gamma $ -GABAergic interneurons. This interaction gives rise to a presynaptic neuron frequency filtering capability that serves to route information, represented as spike trains, to different neurons in the subsequent layers of the SANN. The proposed SANN follows a feedforward architecture with multiple interneuron pathways and astrocytes modulate synaptic activity at the hidden and output neuronal layers. The self-repairing capability will be demonstrated in a robotic obstacle avoidance application, and the simulation results will show that the SANN can maintain learned maneuvers at synaptic fault densities of up to 80% regardless of the fault locations.

[1]  S. Yoshizawa,et al.  An Active Pulse Transmission Line Simulating Nerve Axon , 1962, Proceedings of the IRE.

[2]  Jim Harkin,et al.  Online traffic-aware fault detection for networks-on-chip , 2014, J. Parallel Distributed Comput..

[3]  Jonathan Timmis,et al.  The Psi Swarm: A Low-Cost Robotics Platform and Its Use in an Education Setting , 2016, TAROS.

[4]  Jim Harkin,et al.  Fault-Tolerant Networks-on-Chip Routing With Coarse and Fine-Grained Look-Ahead , 2016, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[5]  Tanya Vladimirova,et al.  Mitigation of Radiation Effects in SRAM-Based FPGAs for Space Applications , 2014, ACM Comput. Surv..

[6]  A. Araque,et al.  Endocannabinoids Potentiate Synaptic Transmission through Stimulation of Astrocytes , 2010, Neuron.

[7]  Gianluca Tempesti,et al.  Fault Tolerance Using Dynamic Reconfiguration on the POEtic Tissue , 2007, IEEE Transactions on Evolutionary Computation.

[8]  Wulfram Gerstner,et al.  SPIKING NEURON MODELS Single Neurons , Populations , Plasticity , 2002 .

[9]  R. Service The brain chip. , 2014, Science.

[10]  Jonathan Timmis,et al.  Self-repairing mobile robotic car using astrocyte-neuron networks , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[11]  K. McCarthy,et al.  Sorting out astrocyte physiology from pharmacology. , 2009, Annual review of pharmacology and toxicology.

[12]  R. FitzHugh Impulses and Physiological States in Theoretical Models of Nerve Membrane. , 1961, Biophysical journal.

[13]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1952, The Journal of physiology.

[14]  Xiao-Jing Wang,et al.  Spike-Frequency Adaptation of a Generalized Leaky Integrate-and-Fire Model Neuron , 2004, Journal of Computational Neuroscience.

[15]  Liam McDaid,et al.  Self-repair in a bidirectionally coupled astrocyte-neuron (AN) system based on retrograde signaling , 2012, Front. Comput. Neurosci..

[16]  Jonathan Timmis,et al.  An FPGA-based hardware-efficient fault-tolerant astrocyte-neuron network , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[17]  Rodrigo Alvarez-Icaza,et al.  Neurogrid: A Mixed-Analog-Digital Multichip System for Large-Scale Neural Simulations , 2014, Proceedings of the IEEE.

[18]  Jim Harkin,et al.  SPANNER: A Self-Repairing Spiking Neural Network Hardware Architecture , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[19]  Jim D. Garside,et al.  Overview of the SpiNNaker System Architecture , 2013, IEEE Transactions on Computers.

[20]  Kwang-Ting Cheng,et al.  Comprehensive online defect diagnosis in on-chip networks , 2012, 2012 IEEE 30th VLSI Test Symposium (VTS).

[21]  Liam McDaid,et al.  On the role of astroglial syncytia in self-repairing spiking neural networks , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[22]  D.L. McMurtrey,et al.  A Comparison of TMR With Alternative Fault-Tolerant Design Techniques for FPGAs , 2007, IEEE Transactions on Nuclear Science.

[23]  Liam McDaid,et al.  Case study: Bio-inspired self-adaptive strategy for spike-based PID controller , 2015, 2015 IEEE International Symposium on Circuits and Systems (ISCAS).

[24]  Eduardo D. Martín,et al.  Activity-dependent switch of GABAergic inhibition into glutamatergic excitation in astrocyte-neuron networks , 2016, eLife.

[25]  Jia Wang,et al.  DaDianNao: A Machine-Learning Supercomputer , 2014, 2014 47th Annual IEEE/ACM International Symposium on Microarchitecture.

[26]  S. Oliet,et al.  Gliotransmitters Travel in Time and Space , 2014, Neuron.

[27]  Michael M. Halassa,et al.  Synaptic Islands Defined by the Territory of a Single Astrocyte , 2007, The Journal of Neuroscience.

[28]  Irith Pomeranz,et al.  Robust Fault Models Where Undetectable Faults Imply Logic Redundancy , 2010, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[29]  Beth Stevens,et al.  Neuron-Astrocyte Signaling in the Development and Plasticity of Neural Circuits , 2008, Neurosignals.

[30]  Jim Harkin,et al.  Homeostatic Fault Tolerance in Spiking Neural Networks: A Dynamic Hardware Perspective , 2018, IEEE Transactions on Circuits and Systems I: Regular Papers.

[31]  Axel Jantsch,et al.  Methods for fault tolerance in networks-on-chip , 2013, CSUR.

[32]  Ninghui Sun,et al.  DianNao: a small-footprint high-throughput accelerator for ubiquitous machine-learning , 2014, ASPLOS.

[33]  Shih-Chii Liu,et al.  Minitaur, an Event-Driven FPGA-Based Spiking Network Accelerator , 2014, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[34]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[35]  Wulfram Gerstner,et al.  How Good Are Neuron Models? , 2009, Science.

[36]  Haizhou Li,et al.  A Spiking Neural Network System for Robust Sequence Recognition , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[37]  Jim Harkin,et al.  Tile implementation strategy for Self-Repairing systems , 2006 .

[38]  A. Araque,et al.  Tripartite synapses: glia, the unacknowledged partner , 1999, Trends in Neurosciences.