A Survey of Robotics Control Based on Learning-Inspired Spiking Neural Networks

Biological intelligence processes information using impulses or spikes, which makes those living creatures able to perceive and act in the real world exceptionally well and outperform state-of-the-art robots in almost every aspect of life. To make up the deficit, emerging hardware technologies and software knowledge in the fields of neuroscience, electronics, and computer science have made it possible to design biologically realistic robots controlled by spiking neural networks (SNNs), inspired by the mechanism of brains. However, a comprehensive review on controlling robots based on SNNs is still missing. In this paper, we survey the developments of the past decade in the field of spiking neural networks for control tasks, with particular focus on the fast emerging robotics-related applications. We first highlight the primary impetuses of SNN-based robotics tasks in terms of speed, energy efficiency, and computation capabilities. We then classify those SNN-based robotic applications according to different learning rules and explicate those learning rules with their corresponding robotic applications. We also briefly present some existing platforms that offer an interaction between SNNs and robotics simulations for exploration and exploitation. Finally, we conclude our survey with a forecast of future challenges and some associated potential research topics in terms of controlling robots based on SNNs.

[1]  Miroslav Kubat,et al.  Neural networks: a comprehensive foundation by Simon Haykin, Macmillan, 1994, ISBN 0-02-352781-7. , 1999, The Knowledge Engineering Review.

[2]  D Gamez,et al.  iSpike: a spiking neural interface for the iCub robot , 2012, Bioinspiration & biomimetics.

[3]  Alois Knoll,et al.  Computation by Time , 2015, Neural Processing Letters.

[4]  E. Hugues,et al.  Stereo-olfaction with a sniffing neuromorphic robot using spiking neurons , 2002 .

[5]  Megan R. Carey,et al.  Instructive signals for motor learning from visual cortical area MT , 2005, Nature Neuroscience.

[6]  Surya P. N. Singh,et al.  V-REP: A versatile and scalable robot simulation framework , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  J. Rouat,et al.  Exploration of rank order coding with spiking neural networks for speech recognition , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[8]  W. Senn,et al.  Reinforcement learning in populations of spiking neurons , 2008, Nature Neuroscience.

[9]  Gerald Steinbauer,et al.  A dependable perception-decision-execution cycle for autonomous robots , 2012, 2012 IEEE International Conference on Robotics and Automation.

[10]  Hojjat Adeli,et al.  Spiking Neural Networks , 2009, Int. J. Neural Syst..

[11]  Fengfu Li,et al.  Biologically Inspired Model for Visual Cognition Achieving Unsupervised Episodic and Semantic Feature Learning , 2016, IEEE Transactions on Cybernetics.

[12]  W. Lytton,et al.  Reinforcement Learning of Targeted Movement in a Spiking Neuronal Model of Motor Cortex , 2012, PloS one.

[13]  P. Arena,et al.  STDP-based behavior learning on the TriBot robot , 2009, Microtechnologies.

[14]  Daniel D. Lee,et al.  Equilibrium properties of temporally asymmetric Hebbian plasticity. , 2000, Physical review letters.

[15]  DeLiang Wang,et al.  Unsupervised Learning: Foundations of Neural Computation , 2001, AI Mag..

[16]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[17]  R. Kempter,et al.  Hebbian learning and spiking neurons , 1999 .

[18]  Fengfu Li,et al.  Biologically Inspired Visual Model With Preliminary Cognition and Active Attention Adjustment , 2015, IEEE Transactions on Cybernetics.

[19]  Mounir Boukadoum,et al.  Classical conditioning in different temporal constraints: an STDP learning rule for robots controlled by spiking neural networks , 2012, Adapt. Behav..

[20]  Douglas H. Norrie,et al.  Agent-Based Systems for Intelligent Manufacturing: A State-of-the-Art Survey , 1999, Knowledge and Information Systems.

[21]  Anthony N. Burkitt,et al.  A Review of the Integrate-and-fire Neuron Model: I. Homogeneous Synaptic Input , 2006, Biological Cybernetics.

[22]  Vincent Padois,et al.  Tools for simulating humanoid robot dynamics: A survey based on user feedback , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[23]  Mohammad Biglarbegian,et al.  Bio-inspired Navigation of Mobile Robots , 2012, AIS.

[24]  M. Brecht,et al.  Behavioural report of single neuron stimulation in somatosensory cortex , 2008, Nature.

[25]  Wulfram Gerstner,et al.  Reinforcement Learning Using a Continuous Time Actor-Critic Framework with Spiking Neurons , 2013, PLoS Comput. Biol..

[26]  Sander M. Bohte,et al.  Spiking Neural Networks: Principles and Challenges , 2014, ESANN.

[27]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[28]  Eduardo Ros,et al.  A real-time spiking cerebellum model for learning robot control , 2008, Biosyst..

[29]  Nicholas T. Carnevale,et al.  Simulation of networks of spiking neurons: A review of tools and strategies , 2006, Journal of Computational Neuroscience.

[30]  Ying Zhu,et al.  AnimatLab: A 3D graphics environment for neuromechanical simulations , 2010, Journal of Neuroscience Methods.

[31]  Alois Knoll,et al.  Musculoskeletal Robots: Scalability in Neural Control , 2016, IEEE Robotics & Automation Magazine.

[32]  A. Oliver,et al.  Spiking neural networks signal processing , 2014, Design of Circuits and Integrated Systems.

[33]  H. Sompolinsky,et al.  The tempotron: a neuron that learns spike timing–based decisions , 2006, Nature Neuroscience.

[34]  Markus Diesmann,et al.  A Spiking Neural Network Model of an Actor-Critic Learning Agent , 2009, Neural Computation.

[35]  Lu Li,et al.  Kinematic gait synthesis for snake robots , 2016, Int. J. Robotics Res..

[36]  Razvan V. Florian,et al.  Reinforcement Learning Through Modulation of Spike-Timing-Dependent Synaptic Plasticity , 2007, Neural Computation.

[37]  J. David Schaffer,et al.  Evolving spiking neural networks for robot control , 2011, Complex Adaptive Systems.

[38]  Rüdiger Dillmann,et al.  Towards a framework for end-to-end control of a simulated vehicle with spiking neural networks , 2016, 2016 IEEE International Conference on Simulation, Modeling, and Programming for Autonomous Robots (SIMPAR).

[39]  D. Bodznick,et al.  Error-driven motor learning in fish. , 2002, The Biological bulletin.

[40]  Zbigniew Michalewicz GAs: What Are They? , 1996 .

[41]  Murray Shanahan,et al.  Training a spiking neural network to control a 4-DoF robotic arm based on Spike Timing-Dependent Plasticity , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[42]  Lukasz A. Kurgan,et al.  Recognition of Partially Occluded and Rotated Images With a Network of Spiking Neurons , 2010, IEEE Transactions on Neural Networks.

[43]  L. Abbott,et al.  Competitive Hebbian learning through spike-timing-dependent synaptic plasticity , 2000, Nature Neuroscience.

[44]  Auke Jan Ijspeert,et al.  Central pattern generators for locomotion control in animals and robots: A review , 2008, Neural Networks.

[45]  Marco Taisch,et al.  On the Use of Quantum-inspired Optimization Techniques for Training Spiking Neural Networks: A New Method Proposed , 2015, Advances in Neural Networks.

[46]  Henry Markram,et al.  An Algorithm for Synaptic Modification Based on Exact Timing of Pre- and Post-Synaptic Action Potentials , 1997, ICANN.

[47]  Luigi Fortuna,et al.  Learning Anticipation via Spiking Networks: Application to Navigation Control , 2009, IEEE Transactions on Neural Networks.

[48]  Romain Brette,et al.  The Brian Simulator , 2009, Front. Neurosci..

[49]  John Salvatier,et al.  Theano: A Python framework for fast computation of mathematical expressions , 2016, ArXiv.

[50]  Dario Floreano,et al.  Evolution of spiking neural circuits in autonomous mobile robots , 2006, Int. J. Intell. Syst..

[51]  Eric Nichols,et al.  Case Study on a Self-Organizing Spiking Neural Network for Robot Navigation , 2010, Int. J. Neural Syst..

[52]  Thomas Schultz,et al.  An Artificial Brain Mechanism to Develop a Learning Paradigm for Robot Navigation , 2016 .

[53]  Paolo Arena,et al.  Insect inspired unsupervised learning for tactic and phobic behavior enhancement in a hybrid robot , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[54]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[55]  E. Knudsen Supervised learning in the brain , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[56]  Thomas Schultz,et al.  Ultra-low energy neuromorphic device based navigation approach for biomimetic robots , 2016, 2016 IEEE National Aerospace and Electronics Conference (NAECON) and Ohio Innovation Summit (OIS).

[57]  X. Zhang,et al.  Digital implementation of a virtual insect trained by spike-timing dependent plasticity , 2016, Integr..

[58]  I-Chen Wu,et al.  Human vs. Computer Go: Review and Prospect [Discussion Forum] , 2016, IEEE Computational Intelligence Magazine.

[59]  Filip Ponulak,et al.  Introduction to spiking neural networks: Information processing, learning and applications. , 2011, Acta neurobiologiae experimentalis.

[60]  William W. Lytton,et al.  Cortical Spiking Network Interfaced with Virtual Musculoskeletal Arm and Robotic Arm , 2015, Front. Neurorobot..

[61]  Wulfram Gerstner,et al.  A neuronal learning rule for sub-millisecond temporal coding , 1996, Nature.

[62]  Eduardo Ros,et al.  Adaptive Robotic Control Driven by a Versatile Spiking Cerebellar Network , 2014, PloS one.

[63]  M. Hasselmo Neuromodulation: acetylcholine and memory consolidation , 1999, Trends in Cognitive Sciences.

[64]  W S McCulloch,et al.  A logical calculus of the ideas immanent in nervous activity , 1990, The Philosophy of Artificial Intelligence.

[65]  T. Wilusz Neural networks — A comprehensive foundation: By Simon Haykin. Macmillan, pp. 696, ISBN 0-02-352761-7, 1994 , 1995 .

[66]  C. Koch,et al.  From stimulus encoding to feature extraction in weakly electric fish , 1996, Nature.

[67]  H. Markram,et al.  Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs , 1997, Science.

[68]  Hong Qiao,et al.  A reference model approach to stability analysis of neural networks , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[69]  Alois Knoll,et al.  Retina Color-Opponency Based Pursuit Implemented Through Spiking Neural Networks in the Neurorobotics Platform , 2016, Living Machines.

[70]  Wolfgang Rosenstiel,et al.  A spiking neuronal model learning a motor control task by reinforcement learning and structural synaptic plasticity , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[71]  Naoyuki Kubota,et al.  The Role of Spiking Neurons for Visual Perception of a Partner Robot , 2006, 2006 IEEE International Conference on Fuzzy Systems.

[72]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[73]  Dario Floreano,et al.  Evolution of Spiking Neural Controllers for Autonomous Vision-Based Robots , 2001, EvoRobots.

[74]  Michael Schmitt,et al.  Unsupervised Learning in Networks of Spiking Neurons Using Temporal Coding , 1997, ICANN.

[75]  F Gabbiani,et al.  Feature Extraction by Burst-Like Spike Patterns in Multiple Sensory Maps , 1998, The Journal of Neuroscience.

[76]  Tadashi Yamazaki,et al.  The cerebellum as a liquid state machine , 2007, Neural Networks.

[77]  Wulfram Gerstner,et al.  SPIKING NEURON MODELS Single Neurons , Populations , Plasticity , 2002 .

[78]  A. Ijspeert,et al.  From Swimming to Walking with a Salamander Robot Driven by a Spinal Cord Model , 2007, Science.

[79]  E. Adrian,et al.  The impulses produced by sensory nerve‐endings , 1926 .

[80]  Florentin Wörgötter,et al.  A computational model of conditioning inspired by Drosophila olfactory system , 2017, Neural Networks.

[81]  Xu Zhang,et al.  Spike-based indirect training of a spiking neural network-controlled virtual insect , 2013, 52nd IEEE Conference on Decision and Control.

[82]  E. Izhikevich Solving the distal reward problem through linkage of STDP and dopamine signaling , 2007, BMC Neuroscience.

[83]  Henry Markram,et al.  Liquid Computing in a Simplified Model of Cortical Layer IV: Learning to Balance a Ball , 2012, ICANN.

[84]  Cristian Jimenez-Romero,et al.  A Model for Foraging Ants, Controlled by Spiking Neural Networks and Double Pheromones , 2015, ArXiv.

[85]  Robert Hecht-Nielsen,et al.  Theory of the backpropagation neural network , 1989, International 1989 Joint Conference on Neural Networks.

[86]  Masahito Yamamoto,et al.  An Artificial Neural Network Based on the Architecture of the Cerebellum for Behavior Learning , 2014, Soft Computing in Artificial Intelligence.

[87]  Clément Farabet,et al.  Torch7: A Matlab-like Environment for Machine Learning , 2011, NIPS 2011.

[88]  A. Cooper,et al.  Predictive Reward Signal of Dopamine Neurons , 2011 .

[89]  Tobi Delbrück,et al.  Training Deep Spiking Neural Networks Using Backpropagation , 2016, Front. Neurosci..

[90]  Roland Strauss,et al.  Motor-Skill Learning in an Insect Inspired Neuro-Computational Control System , 2017, Front. Neurorobot..

[91]  Wofgang Maas,et al.  Networks of spiking neurons: the third generation of neural network models , 1997 .

[92]  Trevor Bekolay,et al.  A Large-Scale Model of the Functioning Brain , 2012, Science.

[93]  Wulfram Gerstner,et al.  Mathematical formulations of Hebbian learning , 2002, Biological Cybernetics.

[94]  K. Svoboda,et al.  Sparse optical microstimulation in barrel cortex drives learned behaviour in freely moving mice , 2008, Nature.

[95]  Mounir Boukadoum,et al.  Operant conditioning: a minimal components requirement in artificial spiking neurons designed for bio-inspired robot's controller , 2014, Front. Neurorobot..

[96]  Jilles Vreeken,et al.  Spiking neural networks, an introduction , 2003 .

[97]  Pinaki Mazumder,et al.  Digital implementation of a spiking neural network (SNN) capable of spike-timing-dependent plasticity (STDP) learning , 2014, 14th IEEE International Conference on Nanotechnology.

[98]  Alberto Elfes,et al.  Evolving Spiking Networks for Turbulence-Tolerant Quadrotor Control , 2014, ALIFE.

[99]  Ralph Etienne-Cummings,et al.  Toward biomorphic control using custom aVLSI CPG chips , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[100]  Andrew Howard,et al.  Design and use paradigms for Gazebo, an open-source multi-robot simulator , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[101]  Hani Hagras,et al.  Evolving spiking neural network controllers for autonomous robots , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[102]  E. Fischer Conditioned Reflexes , 1942, American journal of physical medicine.

[103]  G. Beslon,et al.  Learning at the edge of chaos : Temporal Coupling of Spiking Neurons Controller for Autonomous Robotic , 2005 .

[104]  Robert Hecht-Nielsen III.3 – Theory of the Backpropagation Neural Network* , 1992 .

[105]  William W. Lytton,et al.  Reinforcement Learning of Two-Joint Virtual Arm Reaching in a Computer Model of Sensorimotor Cortex , 2013, Neural Computation.

[106]  Wolfgang Maass,et al.  Networks of Spiking Neurons: The Third Generation of Neural Network Models , 1996, Electron. Colloquium Comput. Complex..

[107]  M. Bazhenov,et al.  A Spiking Network Model of Decision Making Employing Rewarded STDP , 2014, PloS one.

[108]  Wayne Luk,et al.  NeuroFlow: A General Purpose Spiking Neural Network Simulation Platform using Customizable Processors , 2016, Front. Neurosci..

[109]  Yongji Wang,et al.  The Wall-Following Controller for the Mobile Robot Using Spiking Neurons , 2009, 2009 International Conference on Artificial Intelligence and Computational Intelligence.

[110]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[111]  Mitsuo Kawato,et al.  A computational model of four regions of the cerebellum based on feedback-error learning , 2004, Biological Cybernetics.

[112]  Alois Knoll,et al.  Towards autonomous locomotion: CPG-based control of smooth 3D slithering gait transition of a snake-like robot , 2017, Bioinspiration & biomimetics.

[113]  Andrew S. Cassidy,et al.  A million spiking-neuron integrated circuit with a scalable communication network and interface , 2014, Science.

[114]  Tomoki Fukai,et al.  A Stochastic Method to Predict the Consequence of Arbitrary Forms of Spike-Timing-Dependent Plasticity , 2003, Neural Computation.

[115]  Cristian Jimenez-Romero,et al.  Designing Behaviour in Bio-inspired Robots Using Associative Topologies of Spiking-Neural-Networks , 2016, EAI Endorsed Trans. Collab. Comput..

[116]  J. J. Hopfield,et al.  Pattern recognition computation using action potential timing for stimulus representation , 1995, Nature.

[117]  Sander M. Bohte,et al.  Unsupervised clustering with spiking neurons by sparse temporal coding and multilayer RBF networks , 2002, IEEE Trans. Neural Networks.

[118]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1952, The Journal of physiology.

[119]  Mounir Boukadoum,et al.  Robotic implementation of classical and Operant Conditioning as a single STDP learning process , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[120]  Rüdiger Dillmann,et al.  Connecting Artificial Brains to Robots in a Comprehensive Simulation Framework: The Neurorobotics Platform , 2017, Front. Neurorobot..

[121]  Richard Evans,et al.  Reinforcement Learning in a Neurally Controlled Robot Using Dopamine Modulated STDP , 2015, ArXiv.

[122]  Wulfram Gerstner,et al.  Why spikes? Hebbian learning and retrieval of time-resolved excitation patterns , 1993, Biological Cybernetics.

[123]  Eugene M. Izhikevich,et al.  Which model to use for cortical spiking neurons? , 2004, IEEE Transactions on Neural Networks.

[124]  S. Thorpe,et al.  Spike times make sense , 2005, Trends in Neurosciences.

[125]  Rufin VanRullen,et al.  Temporal codes and sparse representations: A key to understanding rapid processing in the visual system , 2004, Journal of Physiology-Paris.

[126]  Alois Knoll,et al.  Neuromorphic implementations of neurobiological learning algorithms for spiking neural networks , 2015, Neural Networks.

[127]  Silvia Ferrari,et al.  Indirect training of a spiking neural network for flight control via spike-timing-dependent synaptic plasticity , 2010, 49th IEEE Conference on Decision and Control (CDC).

[128]  Yiping Dong,et al.  High performance and low latency mapping for neural network into network on chip architecture , 2009, 2009 IEEE 8th International Conference on ASIC.

[129]  Martin Stemmler,et al.  Power Consumption During Neuronal Computation , 2014, Proceedings of the IEEE.

[130]  Jeffrey L. Krichmar,et al.  A self-driving robot using deep convolutional neural networks on neuromorphic hardware , 2016, 2017 International Joint Conference on Neural Networks (IJCNN).

[131]  Tobi Delbrück,et al.  A 128$\times$ 128 120 dB 15 $\mu$s Latency Asynchronous Temporal Contrast Vision Sensor , 2008, IEEE Journal of Solid-State Circuits.

[132]  Martin P. Nawrot,et al.  Conditioned behavior in a robot controlled by a spiking neural network , 2013, 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER).

[133]  Yuval Tassa,et al.  Continuous control with deep reinforcement learning , 2015, ICLR.

[134]  Liam McDaid,et al.  SWAT: A Spiking Neural Network Training Algorithm for Classification Problems , 2010, IEEE Transactions on Neural Networks.

[135]  A. Cassidy,et al.  A biologically inspired tactile sensor array utilizing phase-based computation , 2006, 2006 IEEE Biomedical Circuits and Systems Conference.

[136]  Simon J. Thorpe,et al.  Sparse spike coding in an asynchronous feed-forward multi-layer neural network using matching pursuit , 2004, Neurocomputing.

[137]  M. Potter,et al.  A two-stage model for multiple target detection in rapid serial visual presentation. , 1995, Journal of experimental psychology. Human perception and performance.

[138]  Eric Nichols,et al.  Biologically Inspired SNN for Robot Control , 2013, IEEE Transactions on Cybernetics.

[139]  Jim D. Garside,et al.  Overview of the SpiNNaker System Architecture , 2013, IEEE Transactions on Computers.

[140]  Cristian Jimenez-Romero,et al.  A heterosynaptic spiking neural system for the development of autonomous agents , 2017 .

[141]  Wulfram Gerstner,et al.  Spike-Based Reinforcement Learning in Continuous State and Action Space: When Policy Gradient Methods Fail , 2009, PLoS Comput. Biol..

[142]  Daniel M. Wolpert,et al.  Forward Models for Physiological Motor Control , 1996, Neural Networks.

[143]  Alex M. Andrew,et al.  Spiking Neuron Models: Single Neurons, Populations, Plasticity , 2003 .

[144]  Georg Schnitger,et al.  The Power of Approximation: A Comparison of Activation Functions , 1992, NIPS.

[145]  Steve B. Furber,et al.  The SpiNNaker Project , 2014, Proceedings of the IEEE.

[146]  W. T. Thach Motor Learning and Synaptic Plasticity in the Cerebellum: On the specific role of the cerebellum in motor learning and cognition: Clues from PET activation and lesion studies in man , 1997 .

[147]  Hong Qiao,et al.  Introducing Memory and Association Mechanism Into a Biologically Inspired Visual Model , 2014, IEEE Transactions on Cybernetics.

[148]  R. Stein A THEORETICAL ANALYSIS OF NEURONAL VARIABILITY. , 1965, Biophysical journal.

[149]  Gian Luca Mariottini,et al.  A survey and comparison of commercial and open-source robotic simulator software , 2011, PETRA '11.

[150]  T. Delbruck,et al.  > Replace This Line with Your Paper Identification Number (double-click Here to Edit) < 1 , 2022 .

[151]  Máté Lengyel,et al.  Goal-Directed Decision Making with Spiking Neurons , 2016, The Journal of Neuroscience.

[152]  Matthew Cook,et al.  Unsupervised learning of digit recognition using spike-timing-dependent plasticity , 2015, Front. Comput. Neurosci..

[153]  Anders Krogh,et al.  Neural Network Ensembles, Cross Validation, and Active Learning , 1994, NIPS.

[154]  S. Herculano‐Houzel The remarkable, yet not extraordinary, human brain as a scaled-up primate brain and its associated cost , 2012, Proceedings of the National Academy of Sciences of the United States of America.

[155]  Wulfram Gerstner,et al.  Hebbian learning of pulse timing in the Barn Owl auditory system , 1999 .

[156]  M. Brecht,et al.  Sparse and powerful cortical spikes , 2010, Current Opinion in Neurobiology.

[157]  Jeffrey L. Krichmar,et al.  Learning touch preferences with a tactile robot using dopamine modulated STDP in a model of insular cortex , 2015, Front. Neurorobot..

[158]  Kazuyuki Murase,et al.  Self-Organization of Spiking Neural Network Generating Autonomous Behavior in a Miniature Mobile Robot , 2005, AMiRE.

[159]  Yongji Wang,et al.  Mobile robots' modular navigation controller using spiking neural networks , 2014, Neurocomputing.

[160]  Trevor Bekolay,et al.  Nengo: a Python tool for building large-scale functional brain models , 2014, Front. Neuroinform..

[161]  Günther Palm,et al.  Cell assemblies in the cerebral cortex , 2014, Biological Cybernetics.

[162]  Arnaud Delorme,et al.  Spike-based strategies for rapid processing , 2001, Neural Networks.

[163]  André Cyr,et al.  Action Selection and Operant Conditioning: A Neurorobotic Implementation , 2015, J. Robotics.

[164]  Urszula Markowska-Kaczmar,et al.  Spiking neural network vs multilayer perceptron: who is the winner in the racing car computer game , 2015, Soft Comput..

[165]  Rodrigo Alvarez-Icaza,et al.  Neurogrid: A Mixed-Analog-Digital Multichip System for Large-Scale Neural Simulations , 2014, Proceedings of the IEEE.

[166]  Halil Özcan Gülçür,et al.  Toward Building Hybrid Biological/in silico Neural Networks for Motor Neuroprosthetic Control , 2015, Front. Neurorobot..

[167]  Trevor Hastie,et al.  Overview of Supervised Learning , 2001 .

[168]  Xu Zhang,et al.  A Radial Basis Function Spike Model for Indirect Learning via Integrate-and-Fire Sampling and Reconstruction Techniques , 2012, Adv. Artif. Neural Syst..

[169]  Patrick D. Roberts,et al.  Computational Consequences of Temporally Asymmetric Learning Rules: I. Differential Hebbian Learning , 1999, Journal of Computational Neuroscience.

[170]  Naoyuki Kubota,et al.  A spiking neural network for behavior learning of a mobile robot in a dynamic environment , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[171]  Kleber Neves,et al.  The elephant brain in numbers , 2014, Front. Neuroanat..

[172]  Robert J. Wood,et al.  Spiking neural network (SNN) control of a flapping insect-scale robot , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[173]  R C Garry,et al.  The absorption of water from the colon of the rat under urethane anaesthesia , 1940, The Journal of physiology.

[174]  D Ferster,et al.  Cracking the Neuronal Code , 1995, Science.

[175]  Jianwei Zhang,et al.  A Survey on CPG-Inspired Control Models and System Implementation , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[176]  Thomas Voegtlin CLONES : a closed-loop simulation framework for body, muscles and neurons , 2011, BMC Neuroscience.

[177]  Stephane Cotin,et al.  EP4A: Software and Computer Based Simulator Research: Development and Outlook SOFA—An Open Source Framework for Medical Simulation , 2007, MMVR.

[178]  Wolfgang Maass,et al.  On the relevance of time in neural computation and learning , 2001, Theor. Comput. Sci..

[179]  Long Cheng,et al.  A behavior controller based on spiking neural networks for mobile robots , 2008, Neurocomputing.

[180]  James M. Conrad,et al.  Survey of popular robotics simulators, frameworks, and toolkits , 2011, 2011 Proceedings of IEEE Southeastcon.

[181]  Jan Peters,et al.  Recurrent Spiking Networks Solve Planning Tasks , 2016, Scientific Reports.

[182]  Claudio Moraga,et al.  The Influence of the Sigmoid Function Parameters on the Speed of Backpropagation Learning , 1995, IWANN.

[183]  Michael Sivak,et al.  A Survey of Public Opinion about Autonomous and Self-Driving Vehicles in the U.S., the U.K., and Australia , 2014 .

[184]  Mounir Boukadoum,et al.  Robotic implementation of classical and operant conditioning within a single SNN architecture , 2016, 2016 IEEE 15th International Conference on Cognitive Informatics & Cognitive Computing (ICCI*CC).