Spiking Neural Networks: Modification and Digital Implementation

Real-time large-scale simulation of biological systems is a challenging task due to nonlinear functions describing biochemical reactions in the cells. Being fast, cost and power efficient alongside of capability to work in parallel have made hardware an attractive choice for simulation platform. This thesis proposes a neuromorphic platform for online Spike Timing Dependant Plasticity (STDP) learning, based on the COordinate Rotation DIgital Computer (CORDIC) algorithms. The implemented platform comprises two main components. First, the Izhikevich neuron model is modified for implementation using the CORDIC algorithm and simulated to ensure the model accuracy. Afterwards, the model was described as hardware and implemented on Field Programmable Gate Array (FPGA). Second, the STDP learning algorithm is adapted and optimized using the CORDIC method, synthesized for hardware, and implemented to perform on-FPGA online learning on a network of CORDIC Izhikevich neurons to demonstrate competitive Hebbian learning. The implementation results are compared with the original model and state-ofthe-art to verify accuracy, effectiveness, and higher speed of the system. These comparisons confirm that the proposed neuromorphic system offers better performance and higher accuracy while being straightforward to implement and suitable to scale. New findings show that astrocytes are important parts of the information processing in brain and believed to be responsible for some brain diseases such as Alzheimer

[1]  Michael M. Halassa,et al.  Synaptic Islands Defined by the Territory of a Single Astrocyte , 2007, The Journal of Neuroscience.

[2]  Stephan Henker,et al.  A 32 GBit/s communication SoC for a waferscale neuromorphic system , 2012, Integr..

[3]  Liam McDaid,et al.  Scalable Networks-on-Chip Interconnected Architecture for Astrocyte-Neuron Networks , 2016, IEEE Transactions on Circuits and Systems I: Regular Papers.

[4]  Hamid Soleimani,et al.  Digital Multiplierless Realization of a Calcium-Based Plasticity Model , 2017, IEEE Transactions on Circuits and Systems II: Express Briefs.

[5]  J. Kelso,et al.  Bidirectional Coupling between Astrocytes and Neurons Mediates Learning and Dynamic Coordination in the Brain: A Multiple Modeling Approach , 2011, PloS one.

[6]  Kwabena Boahen,et al.  A Neuromorph's Prospectus , 2017, Computing in Science & Engineering.

[7]  Jiang Wang,et al.  A real-time FPGA implementation of a biologically inspired central pattern generator network , 2017, Neurocomputing.

[8]  E. Ben-Jacob,et al.  Multimodal encoding in a simplified model of intracellular calcium signaling , 2009, Cognitive Processing.

[9]  S. Goldman,et al.  New roles for astrocytes: Redefining the functional architecture of the brain , 2003, Trends in Neurosciences.

[10]  Sander M. Bohte,et al.  Spiking Neural Networks: Principles and Challenges , 2014, ESANN.

[11]  R. Eckhorn,et al.  Coherent oscillations: A mechanism of feature linking in the visual cortex? , 1988, Biological Cybernetics.

[12]  Liam McDaid,et al.  Self-repairing hardware with astrocyte-neuron networks , 2016, 2016 IEEE International Symposium on Circuits and Systems (ISCAS).

[13]  Steve B. Furber,et al.  The SpiNNaker Project , 2014, Proceedings of the IEEE.

[14]  Johannes Schemmel,et al.  A wafer-scale neuromorphic hardware system for large-scale neural modeling , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[15]  Xiangxiang Zeng,et al.  Performing Four Basic Arithmetic Operations With Spiking Neural P Systems , 2012, IEEE Transactions on NanoBioscience.

[16]  Hassan Mostafa,et al.  A Low Power CORDIC-Based Hardware Implementation of Izhikevich Neuron Model , 2018, 2018 16th IEEE International New Circuits and Systems Conference (NEWCAS).

[17]  C. Morris,et al.  Voltage oscillations in the barnacle giant muscle fiber. , 1981, Biophysical journal.

[18]  Alain Destexhe,et al.  Tunable Neuromimetic Integrated System for Emulating Cortical Neuron Models , 2011, Front. Neurosci..

[19]  Julie A. Wall,et al.  Spiking Neural Network Model of Sound Localization Using the Interaural Intensity Difference , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[20]  Mostafa Rahimi Azghadi,et al.  Unsupervised Character Recognition with a Simplified FPGA Neuromorphic System , 2018, 2018 IEEE International Symposium on Circuits and Systems (ISCAS).

[21]  Gert Cauwenberghs,et al.  Large-Scale Neuromorphic Spiking Array Processors: A Quest to Mimic the Brain , 2018, Front. Neurosci..

[22]  Eshel Ben-Jacob,et al.  Astrocyte regulation of sleep circuits: experimental and modeling perspectives , 2012, Front. Comput. Neurosci..

[23]  Rodrigo Alvarez-Icaza,et al.  Neurogrid: A Mixed-Analog-Digital Multichip System for Large-Scale Neural Simulations , 2014, Proceedings of the IEEE.

[24]  Humberto Sossa,et al.  The step size impact on the computational cost of spiking neuron simulation , 2017, 2017 Computing Conference.

[25]  Hiroyuki Torikai,et al.  A Novel Asynchronous Cellular Automaton Multicompartment Neuron Model , 2015, IEEE Transactions on Circuits and Systems II: Express Briefs.

[26]  Miroslav Skrbek,et al.  High-Performance Spiking Neural Network Simulator , 2019, 2019 8th Mediterranean Conference on Embedded Computing (MECO).

[27]  Mostafa Rahimi Azghadi,et al.  A neuromorphic VLSI design for spike timing and rate based synaptic plasticity , 2013, Neural Networks.

[28]  N. Brunel,et al.  Astrocytes: Orchestrating synaptic plasticity? , 2015, Neuroscience.

[29]  Bin Deng,et al.  Real-Time Neuromorphic System for Large-Scale Conductance-Based Spiking Neural Networks , 2019, IEEE Transactions on Cybernetics.

[30]  Evangelos Stromatias,et al.  Supervised learning in Spiking Neural Networks with limited precision: SNN/LP , 2014, 2015 International Joint Conference on Neural Networks (IJCNN).

[31]  Hong Wang,et al.  Loihi: A Neuromorphic Manycore Processor with On-Chip Learning , 2018, IEEE Micro.

[32]  André van Schaik,et al.  Neuromorphic Hardware Architecture Using the Neural Engineering Framework for Pattern Recognition , 2017, IEEE Transactions on Biomedical Circuits and Systems.

[33]  Wulfram Gerstner,et al.  SPIKING NEURON MODELS Single Neurons , Populations , Plasticity , 2002 .

[34]  E. D’Angelo The human brain project. , 2012, Functional neurology.

[35]  Mostafa Rahimi Azghadi,et al.  Programmable Spike-Timing-Dependent Plasticity Learning Circuits in Neuromorphic VLSI Architectures , 2015, ACM J. Emerg. Technol. Comput. Syst..

[36]  Yueqing Li,et al.  Collaborative Brain-Computer Interface for People with Motor Disabilities [Research Frontier] , 2016, IEEE Computational Intelligence Magazine.

[37]  Hamid Soleimani,et al.  An Efficient and Reconfigurable Synchronous Neuron Model , 2018, IEEE Transactions on Circuits and Systems II: Express Briefs.

[38]  Janusz A. Starzyk,et al.  Memristor Crossbar Architecture for Synchronous Neural Networks , 2014, IEEE Transactions on Circuits and Systems I: Regular Papers.

[39]  Filip Ponulak,et al.  Introduction to spiking neural networks: Information processing, learning and applications. , 2011, Acta neurobiologiae experimentalis.

[40]  Narayan Srinivasa,et al.  Self-Organizing Spiking Neural Model for Learning Fault-Tolerant Spatio-Motor Transformations , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[41]  Michael Pfeiffer,et al.  Deep Learning With Spiking Neurons: Opportunities and Challenges , 2018, Front. Neurosci..

[42]  Hojjat Adeli,et al.  A new supervised learning algorithm for multiple spiking neural networks with application in epilepsy and seizure detection , 2009, Neural Networks.

[43]  Tobi Delbrück,et al.  Real-Time Gesture Interface Based on Event-Driven Processing From Stereo Silicon Retinas , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[44]  Wulfram Gerstner,et al.  Adaptive exponential integrate-and-fire model as an effective description of neuronal activity. , 2005, Journal of neurophysiology.

[45]  Jonathan Timmis,et al.  An FPGA-based hardware-efficient fault-tolerant astrocyte-neuron network , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[46]  Eshel Ben-Jacob,et al.  The Astrocyte as a Gatekeeper of Synaptic Information Transfer , 2006, Neural Computation.

[47]  Kaushik Kumar Majumdar,et al.  A mathematical model of the tripartite synapse: astrocyte-induced synaptic plasticity , 2011, Journal of Biological Physics.

[48]  Anthony G. Pipe,et al.  Novel Bio-Inspired Approach for Fault-Tolerant VLSI Systems , 2013, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[49]  N. González,et al.  Induction of emotional states in people with disabilities through film clips using brain computer interfaces , 2016, IEEE Latin America Transactions.

[50]  N. Brunel,et al.  Modulation of Synaptic Plasticity by Glutamatergic Gliotransmission: A Modeling Study , 2016, Neural plasticity.

[51]  Andrew S. Cassidy,et al.  Design of silicon brains in the nano-CMOS era: Spiking neurons, learning synapses and neural architecture optimization , 2013, Neural Networks.

[52]  E. Ben-Jacob,et al.  Glutamate regulation of calcium and IP3 oscillating and pulsating dynamics in astrocytes , 2009, Journal of biological physics.

[53]  Bin Deng,et al.  Cost-efficient FPGA implementation of basal ganglia and their Parkinsonian analysis , 2015, Neural Networks.

[54]  Gert Cauwenberghs,et al.  Neuromorphic Silicon Neuron Circuits , 2011, Front. Neurosci.

[55]  Alice C. Parker,et al.  A CMOS circuit implementation of retrograde signaling in astrocyte-neuron networks , 2016, 2016 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[56]  Rashid Rashidzadeh,et al.  A CORDIC Based Digital Hardware For Adaptive Exponential Integrate and Fire Neuron , 2016, IEEE Transactions on Circuits and Systems I: Regular Papers.

[57]  Daniel Gutierrez-Galan,et al.  Multilayer Spiking Neural Network for Audio Samples Classification Using SpiNNaker , 2016, ICANN.

[58]  Kea-Tiong Tang,et al.  A high learning capability probabilistic spiking neural network chip , 2018, 2018 International Symposium on VLSI Design, Automation and Test (VLSI-DAT).

[59]  Yannick Bornat,et al.  FPGA-based architecture for real-time synaptic plasticity computation , 2008, 2008 15th IEEE International Conference on Electronics, Circuits and Systems.

[60]  Derek Abbott,et al.  Digital Multiplierless Realization of Two Coupled Biological Morris-Lecar Neuron Model , 2015, IEEE Transactions on Circuits and Systems I: Regular Papers.

[61]  Arash Ahmadi,et al.  An integrated astrocyte-adaptive exponential (AAdEx) neuron and circuit implementation , 2016, 2016 24th Iranian Conference on Electrical Engineering (ICEE).

[62]  G. Buzsáki,et al.  NeuroGrid: recording action potentials from the surface of the brain , 2014, Nature Neuroscience.

[63]  Hiroyuki Torikai,et al.  A Novel Generalized Hardware-Efficient Neuron Model Based on Asynchronous CA Dynamics and Its Biologically Plausible On-FPGA Learnings , 2019, IEEE Transactions on Circuits and Systems II: Express Briefs.

[64]  M. Maurin,et al.  REVIEW ARTICLE doi: 10.1111/j.1472-8206.2008.00633.x The Hill equation: a review of its capabilities in pharmacological modelling , 2008 .

[65]  Hamid Soleimani,et al.  A Compact Synchronous Cellular Model of Nonlinear Calcium Dynamics: Simulation and FPGA Synthesis Results , 2017, IEEE Transactions on Biomedical Circuits and Systems.

[66]  Arash Ahmadi,et al.  An analog implementation of biologically plausible neurons using CCII building blocks , 2012, Neural Networks.

[67]  Stefano Brivio,et al.  Synaptic potentiation and depression in Al , 2015 .

[68]  Wulfram Gerstner,et al.  A neuronal learning rule for sub-millisecond temporal coding , 1996, Nature.

[69]  Rob J Hyndman,et al.  Another look at measures of forecast accuracy , 2006 .

[70]  Ch. von der Malsburg,et al.  A neural cocktail-party processor , 1986, Biological Cybernetics.

[71]  D. Abbott,et al.  Tunable Low Energy, Compact and High Performance Neuromorphic Circuit for Spike-Based Synaptic Plasticity , 2014, PloS one.

[72]  Y. Buskila,et al.  Impairments in Motor Neurons, Interneurons and Astrocytes Contribute to Hyperexcitability in ALS: Underlying Mechanisms and Paths to Therapy , 2018, Molecular Neurobiology.

[73]  Wayne Luk,et al.  NeuroFlow: A General Purpose Spiking Neural Network Simulation Platform using Customizable Processors , 2016, Front. Neurosci..

[74]  Takashi Matsubara,et al.  Asynchronous Cellular Automaton-Based Neuron: Theoretical Analysis and On-FPGA Learning , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[75]  H. Wilson Simplified dynamics of human and mammalian neocortical neurons. , 1999, Journal of theoretical biology.

[76]  Hiroyuki Torikai,et al.  A Novel Hardware-Efficient Asynchronous Cellular Automaton Model of Spike-Timing-Dependent Synaptic Plasticity , 2016, IEEE Transactions on Circuits and Systems II: Express Briefs.

[77]  G. Carmignoto,et al.  Crucial role of astrocytes in temporal lobe epilepsy , 2016, Neuroscience.

[78]  Giacomo Indiveri,et al.  On-chip unsupervised learning in winner-take-all networks of spiking neurons , 2017, 2017 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[79]  Romain Brette,et al.  Simulating spiking neural networks on GPU , 2012, Network.

[80]  Arash Ahmadi,et al.  Biologically Inspired Spiking Neurons: Piecewise Linear Models and Digital Implementation , 2012, IEEE Transactions on Circuits and Systems I: Regular Papers.

[81]  Seul Jung,et al.  Implementation of the RBF neural chip with the on-line learning back-propagation algorithm , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[82]  N. Brunel,et al.  Calcium-based plasticity model explains sensitivity of synaptic changes to spike pattern, rate, and dendritic location , 2012, Proceedings of the National Academy of Sciences.

[83]  G. Perea,et al.  Tripartite synapses: astrocytes process and control synaptic information , 2009, Trends in Neurosciences.

[84]  Arash Ahmadi,et al.  A digital implementation of 2D Hindmarsh–Rose neuron , 2017 .

[85]  Dharmendra S. Modha,et al.  A digital neurosynaptic core using embedded crossbar memory with 45pJ per spike in 45nm , 2011, 2011 IEEE Custom Integrated Circuits Conference (CICC).

[86]  Jack E. Volder The CORDIC Trigonometric Computing Technique , 1959, IRE Trans. Electron. Comput..

[87]  Shih-Chii Liu,et al.  Minitaur, an Event-Driven FPGA-Based Spiking Network Accelerator , 2014, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[88]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[89]  Olivier Temam,et al.  Hardware spiking neurons design: Analog or digital? , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[90]  Witold Pedrycz,et al.  Contrastive divergence for memristor-based restricted Boltzmann machine , 2015, Engineering applications of artificial intelligence.

[91]  Nikola Kasabov,et al.  A Feasibility Study of Using the NeuCube Spiking Neural Network Architecture for Modelling Alzheimer's Disease EEG Data , 2015, Advances in Neural Networks.

[92]  Jonathan Timmis,et al.  Assessing Self-Repair on FPGAs with Biologically Realistic Astrocyte-Neuron Networks , 2017, 2017 IEEE Computer Society Annual Symposium on VLSI (ISVLSI).

[93]  Tom Kazmierski,et al.  A dedicated bit-serial hardware neuron for massively-parallel neural networks in fast epilepsy diagnosis , 2017, 2017 IEEE Healthcare Innovations and Point of Care Technologies (HI-POCT).

[94]  Hiroyuki Torikai,et al.  A Novel PWC Spiking Neuron Model: Neuron-Like Bifurcation Scenarios and Responses , 2012, IEEE Transactions on Circuits and Systems I: Regular Papers.

[95]  A. Verkhratsky,et al.  Astrocytes in physiological aging and Alzheimer’s disease , 2016, Neuroscience.

[96]  F. Grassia,et al.  Silicon neuron: digital hardware implementation of the quartic model , 2014, Artificial Life and Robotics.

[97]  Derek Abbott,et al.  Digital Implementation of a Biological Astrocyte Model and Its Application , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[98]  Wulfram Gerstner,et al.  Phenomenological models of synaptic plasticity based on spike timing , 2008, Biological Cybernetics.

[99]  Bernard Brezzo,et al.  TrueNorth: Design and Tool Flow of a 65 mW 1 Million Neuron Programmable Neurosynaptic Chip , 2015, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[100]  Byoung Hun Lee,et al.  Neuromorphic Hardware System for Visual Pattern Recognition With Memristor Array and CMOS Neuron , 2015, IEEE Transactions on Industrial Electronics.

[101]  Yilda Irizarry-Valle,et al.  A CMOS neuromorphic approach to emulate neuro-astrocyte interactions , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[102]  Ammar Belatreche,et al.  Challenges for large-scale implementations of spiking neural networks on FPGAs , 2007, Neurocomputing.

[103]  Tara Julia Hamilton,et al.  Efficient FPGA Implementations of Pair and Triplet-Based STDP for Neuromorphic Architectures , 2019, IEEE Transactions on Circuits and Systems I: Regular Papers.

[104]  Arash Ahmadi,et al.  Digital Multiplierless Implementation of Biological Adaptive-Exponential Neuron Model , 2014, IEEE Transactions on Circuits and Systems I: Regular Papers.

[105]  M. Falcke Reading the patterns in living cells —the physics of ca2+ signaling , 2004 .

[106]  Saraju P. Mohanty,et al.  Low-Power High-Level Synthesis for Nanoscale CMOS Circuits , 2008 .

[107]  Majid Ahmadi,et al.  Digital Realization of PSTDP and TSTDP Learning , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[108]  Mingoo Seok,et al.  Energy-Efficient Neuromorphic Classifiers , 2016, Neural Computation.

[109]  Arash Ahmadi,et al.  A Novel Nonlinear Function Evaluation Approach for Efficient FPGA Mapping of Neuron and Synaptic Plasticity Models , 2019, IEEE Transactions on Biomedical Circuits and Systems.

[110]  Liam McDaid,et al.  Astrocyte to spiking neuron communication using Networks-on-Chip ring topology , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[111]  Jonathan Timmis,et al.  Self-repairing mobile robotic car using astrocyte-neuron networks , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[112]  Jilles Vreeken,et al.  Spiking neural networks, an introduction , 2003 .

[113]  Tetsuya Hishiki,et al.  A Generalized Rotate-and-Fire Digital Spiking Neuron Model and Its On-FPGA Learning , 2011, IEEE Transactions on Circuits and Systems II: Express Briefs.

[114]  Dmitry E. Postnov,et al.  Functional modeling of neural-glial interaction , 2007, Biosyst..

[115]  Frederico A. C. Azevedo,et al.  Equal numbers of neuronal and nonneuronal cells make the human brain an isometrically scaled‐up primate brain , 2009, The Journal of comparative neurology.

[116]  Izhar Wallach,et al.  AtomNet: A Deep Convolutional Neural Network for Bioactivity Prediction in Structure-based Drug Discovery , 2015, ArXiv.

[117]  Arindam Basu,et al.  A Learning-Enabled Neuron Array IC Based Upon Transistor Channel Models of Biological Phenomena , 2013, IEEE Transactions on Biomedical Circuits and Systems.

[118]  Sergio Davies,et al.  Learning in spiking neural networks , 2013 .

[119]  Steve B. Furber,et al.  Building a Spiking Neural Network Model of the Basal Ganglia on SpiNNaker , 2018, IEEE Transactions on Cognitive and Developmental Systems.

[120]  Yingxue Wang,et al.  A Two-Dimensional Configurable Active Silicon Dendritic Neuron Array , 2011, IEEE Transactions on Circuits and Systems I: Regular Papers.

[121]  R. FitzHugh Impulses and Physiological States in Theoretical Models of Nerve Membrane. , 1961, Biophysical journal.

[122]  André van Schaik,et al.  A mixed-signal implementation of a polychronous spiking neural network with delay adaptation , 2014, Front. Neurosci..

[123]  Georg Schnitger,et al.  On the computational power of sigmoid versus Boolean threshold circuits , 1991, [1991] Proceedings 32nd Annual Symposium of Foundations of Computer Science.

[124]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1952, The Journal of physiology.

[125]  René Schüffny,et al.  A Biological-Realtime Neuromorphic System in 28 nm CMOS Using Low-Leakage Switched Capacitor Circuits , 2014, IEEE Transactions on Biomedical Circuits and Systems.

[126]  Ana B. Porto-Pazos,et al.  Deep Artificial Neural Networks and Neuromorphic Chips for Big Data Analysis: Pharmaceutical and Bioinformatics Applications , 2016, International journal of molecular sciences.

[127]  S. Nadkarni,et al.  Modeling synaptic transmission of the tripartite synapse , 2007, Physical biology.

[128]  Majid Ahmadi,et al.  CORDIC-SNN: On-FPGA STDP Learning With Izhikevich Neurons , 2019, IEEE Transactions on Circuits and Systems I: Regular Papers.

[129]  Wulfram Gerstner,et al.  Neuronal Dynamics: From Single Neurons To Networks And Models Of Cognition , 2014 .

[130]  Johannes Schemmel,et al.  A VLSI Implementation of the Adaptive Exponential Integrate-and-Fire Neuron Model , 2010, NIPS.

[131]  Andrew S. Cassidy,et al.  Conversion of artificial recurrent neural networks to spiking neural networks for low-power neuromorphic hardware , 2016, 2016 IEEE International Conference on Rebooting Computing (ICRC).

[132]  J. Hindmarsh,et al.  The assembly of ionic currents in a thalamic neuron I. The three-dimensional model , 1989, Proceedings of the Royal Society of London. B. Biological Sciences.

[133]  Angelika Peer,et al.  Human-Inspired Neurorobotic System for Classifying Surface Textures by Touch , 2016, IEEE Robotics and Automation Letters.

[134]  Mostafa Rahimi Azghadi,et al.  Spike-Based Synaptic Plasticity in Silicon: Design, Implementation, Application, and Challenges , 2014, Proceedings of the IEEE.

[135]  PAUL C. BRESSLOFF,et al.  Spike Timing–dependent Plasticity (stdp) , 2022 .

[136]  Indranil Saha,et al.  journal homepage: www.elsevier.com/locate/neucom , 2022 .

[137]  Juan Humberto Sossa Azuela,et al.  On the accuracy and computational cost of spiking neuron implementation. , 2020, Neural networks : the official journal of the International Neural Network Society.

[138]  Eugene M. Izhikevich,et al.  Which model to use for cortical spiking neurons? , 2004, IEEE Transactions on Neural Networks.