A comparative study on spiking neural network encoding schema: implemented with cloud computing

Spiking neural networks (SNN) represents the third generation of neural network models, it differs significantly from the early neural network generation. The time is becoming the most important input. The presence and precise timing of spikes encapsulate have a meaning such as human brain behavior. However, deferent techniques are therefore required to submit a stimulus to the neural network to build the timing spike. The characteristics of these spikes are based on their firing time because of the stereotypical nature of the human brain. Neural networks (NN) as engineering tools Operate on analog quantities (analog input, analog output), SNN More powerful than classic NN Interesting to implement in hardware. But the Problem that is internally work with spike trains unequal analog signal, so this algorithm design to firstly convert analog function into spike trains which calling encoding (E) then Convert spike trains into analog function: which calling decoding (D), so to use spiking NN as engineering tool: communication problem must be solved using some international encoding algorithms. This paper discusses techniques of transforming data into a suitable form for SNN submission. We present a comparative study on SNN encoding schema that effect on SNN performance in hardware and software implementation, however, this is the first comprehensive study to discuss encoding algorithms in SNNs in details, which involved the advantages, disadvantages and when and where we can use and implements the encoding algorithms, with focusing on some examples implement SNN in cloud computing generally, and which algorithms still unused in the world of cloud computing to make the door open for new researcher.

[1]  Eugenio Martinelli,et al.  Spike encoding of artificial olfactory sensor signals , 2006 .

[2]  Shaun Donachy Spiking Neural Networks: Neuron Models, Plasticity, and Graph Applications , 2015 .

[3]  Kay Chen Tan,et al.  A brain-inspired spiking neural network model with temporal encoding and learning , 2014, Neurocomputing.

[4]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[5]  Yue Tian,et al.  Photonic Neuromorphic Signal Processing and Computing , 2014 .

[6]  Alex M. Andrew,et al.  Spiking Neuron Models: Single Neurons, Populations, Plasticity , 2003 .

[7]  J. J. Hopfield,et al.  Pattern recognition computation using action potential timing for stimulus representation , 1995, Nature.

[8]  Sander M. Bohte,et al.  Unsupervised clustering with spiking neurons by sparse temporal coding and multilayer RBF networks , 2002, IEEE Trans. Neural Networks.

[9]  Christopher J. Bishop,et al.  Pulsed Neural Networks , 1998 .

[10]  Simei Gomes Wysoski,et al.  Evolving spiking neural networks for audiovisual information processing , 2010, Neural Networks.

[11]  André Grüning,et al.  Supervised Learning in Spiking Neural Networks for Precise Temporal Encoding , 2016, PloS one.

[12]  Dingkun Du,et al.  An energy-efficient spike encoding circuit for speech edge detection , 2013 .

[13]  W. Gerstner,et al.  Time structure of the activity in neural network models. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[14]  Alyssa A. Carey,et al.  Optimizing for generalization in the decoding of internally generated activity in the hippocampus , 2016, bioRxiv.

[15]  A. Hodgkin,et al.  Currents carried by sodium and potassium ions through the membrane of the giant axon of Loligo , 1952, The Journal of physiology.

[16]  C. Gross Genealogy of the “Grandmother Cell” , 2002, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[17]  Wulfram Gerstner,et al.  Reduction of the Hodgkin-Huxley Equations to a Single-Variable Threshold Model , 1997, Neural Computation.

[18]  Carlos D. Brody,et al.  Simple networks for spike-timing based computation , 2003 .

[19]  Snjezana Soltic,et al.  FPGA Implementation of an Evolving Spiking Neural Network , 2008, ICONIP.

[20]  Ammar Belatreche,et al.  Challenges for large-scale implementations of spiking neural networks on FPGAs , 2007, Neurocomputing.

[21]  Christof Koch,et al.  Linear Stimulus Encoding and Decoding , 1999 .

[22]  Michael Defoin-Platel,et al.  Integrated feature and parameter optimization for an evolving spiking neural network: Exploring heterogeneous probabilistic models , 2009, Neural Networks.

[23]  Dimitris Gritzalis,et al.  The Insider Threat in Cloud Computing , 2011, CRITIS.

[24]  Christian W. Eurich,et al.  Multidimensional Encoding Strategy of Spiking Neurons , 2000, Neural Computation.

[25]  Paul H. E. Tiesinga,et al.  Anti-correlations in the degree distribution increase stimulus detection performance in noisy spiking neural networks , 2016, Journal of Computational Neuroscience.

[26]  Juan Humberto Sossa Azuela,et al.  Encoding Polysomnographic Signals into Spike Firing Rate for Sleep Staging , 2015, MCPR.

[27]  Arnaud Delorme,et al.  Face identification using one spike per neuron: resistance to image degradations , 2001, Neural Networks.

[28]  Tobi Delbrück,et al.  Fast sensory motor control based on event-based hybrid neuromorphic-procedural system , 2007, 2007 IEEE International Symposium on Circuits and Systems.

[29]  Simon J Thorpe Grandmother Cells and Distributed Representations , 2010 .

[30]  T. Delbruck,et al.  A 64x64 aer logarithmic temporal derivative silicon retina , 2005, Research in Microelectronics and Electronics, 2005 PhD.

[31]  Ammar Belatreche,et al.  Advances in Design and Application of Spiking Neural Networks , 2006, Soft Comput..

[32]  Kshitij Dhoble Spatio-/spectro-temporal pattern recognition using evolving probabilistic spiking neural networks , 2013 .

[33]  C. Bouton,et al.  Cracking the neural code, treating paralysis and the future of bioelectronic medicine , 2017, Journal of internal medicine.

[34]  Eugene M. Izhikevich,et al.  Which model to use for cortical spiking neurons? , 2004, IEEE Transactions on Neural Networks.

[35]  Sander M. Bohte,et al.  Computing with Spiking Neuron Networks , 2012, Handbook of Natural Computing.

[36]  Gary Fehr,et al.  Evolving hardware on a large scale , 2000, Proceedings. The Second NASA/DoD Workshop on Evolvable Hardware.

[37]  Haizhou Li,et al.  Rapid Feedforward Computation by Temporal Encoding and Learning With Spiking Neurons , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[38]  Rufin van Rullen,et al.  Rate Coding Versus Temporal Order Coding: What the Retinal Ganglion Cells Tell the Visual Cortex , 2001, Neural Computation.

[39]  Hiroyuki Torikai,et al.  A novel chaotic spiking neuron and its paralleled spike encoding function , 2009, 2009 International Joint Conference on Neural Networks.

[40]  Hieu Tat Nguyen,et al.  A gradient descent rule for spiking neurons emitting multiple spikes , 2005, Inf. Process. Lett..

[41]  Wulfram Gerstner,et al.  What is Different with Spiking Neurons , 2001 .

[42]  Firas AlBalas,et al.  An Online Intrusion Detection System to Cloud Computing Based on Neucube Algorithms , 2018, Int. J. Cloud Appl. Comput..

[43]  Stephen J. Heinen,et al.  A mechanism for decision rule discrimination by supplementary eye field neurons , 2014, Experimental Brain Research.

[44]  Izhikevich Eugene,et al.  Spike-timing theory of working memory , 2010 .

[45]  Jacques Gautrais,et al.  Rank order coding , 1998 .

[46]  Wolfgang Maass,et al.  Computing with spiking neurons , 1999 .

[47]  Munchurl Kim,et al.  A Novel Fast CU Encoding Scheme Based on Spatiotemporal Encoding Parameters for HEVC Inter Coding , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[48]  A. Dhilipan,et al.  A Survey on Pattern Recognition Using Spiking Neura l Networks with Temporal Encoding and Learning , 2014 .

[49]  Gabbiani,et al.  Encoding and processing of sensory information in neuronal spike trains , 1999, The Journal of experimental biology.

[50]  Mikhail V. Kiselev Rate coding vs. temporal coding - is optimum between? , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[51]  Nikola Kasabov,et al.  Dynamic evolving spiking neural networks for on-line spatio- and spectro-temporal pattern recognition. , 2013, Neural networks : the official journal of the International Neural Network Society.

[52]  Bruno A. Olshausen,et al.  Book Review , 2003, Journal of Cognitive Neuroscience.

[53]  Soni Chaturvedi,et al.  Image Processing with Spiking Neuron Networks , 2013, Artificial Intelligence, Evolutionary Computing and Metaheuristics.

[54]  Maryam Gholami Doborjeh,et al.  Evolving spatio-temporal data machines based on the NeuCube neuromorphic framework: Design methodology and selected applications , 2016, Neural Networks.

[55]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[56]  Kay Chen Tan,et al.  Pattern recognition computation in a spiking neural network with temporal encoding and learning , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[57]  J. Koenderink Q… , 2014, Les noms officiels des communes de Wallonie, de Bruxelles-Capitale et de la communaute germanophone.

[58]  Wulfram Gerstner,et al.  SPIKING NEURON MODELS Single Neurons , Populations , Plasticity , 2002 .

[59]  Nikola K. Kasabov,et al.  Probabilistic Evolving Spiking Neural Network Optimization Using Dynamic Quantum-inspired Particle Swarm Optimization , 2010, Aust. J. Intell. Inf. Process. Syst..

[60]  Steve Furber,et al.  Information recovery from rank-order encoded images , 2006 .

[61]  Carlos D. Brody,et al.  Simple Networks for Spike-Timing-Based Computation, with Application to Olfactory Processing , 2003, Neuron.

[62]  Arnaud Delorme,et al.  Networks of integrate-and-fire neurons using Rank Order Coding B: Spike timing dependent plasticity and emergence of orientation selectivity , 2001, Neurocomputing.

[63]  B. Schrauwen,et al.  BSA, a fast and accurate spike train encoding scheme , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[64]  Eugene M. Izhikevich,et al.  Dynamical Systems in Neuroscience: The Geometry of Excitability and Bursting , 2006 .

[65]  Fabrizio Gabbiani,et al.  Coding of time-varying signals in spike trains of linear and half-wave rectifying neurons. , 1996, Network.

[66]  Wulfram Gerstner,et al.  Spiking Neuron Models , 2002 .

[67]  Yiannis Andreopoulos,et al.  Video Classification With CNNs: Using the Codec as a Spatio-Temporal Activity Sensor , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[68]  J. Rouat,et al.  Exploration of rank order coding with spiking neural networks for speech recognition , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[69]  Cameron Muhammad Neuromodulation Based Control of Autonomous Robots on a Cloud Computing Platform , 2014 .