Optimization Methods for Spiking Neurons and Networks

Spiking neurons and spiking neural circuits are finding uses in a multitude of tasks such as robotic locomotion control, neuroprosthetics, visual sensory processing, and audition. The desired neural output is achieved through the use of complex neuron models, or by combining multiple simple neurons into a network. In either case, a means for configuring the neuron or neural circuit is required. Manual manipulation of parameters is both time consuming and non-intuitive due to the nonlinear relationship between parameters and the neuron's output. The complexity rises even further as the neurons are networked and the systems often become mathematically intractable. In large circuits, the desired behavior and timing of action potential trains may be known but the timing of the individual action potentials is unknown and unimportant, whereas in single neuron systems the timing of individual action potentials is critical. In this paper, we automate the process of finding parameters. To configure a single neuron we derive a maximum likelihood method for configuring a neuron model, specifically the Mihalas-Niebur Neuron. Similarly, to configure neural circuits, we show how we use genetic algorithms (GAs) to configure parameters for a network of simple integrate and fire with adaptation neurons. The GA approach is demonstrated both in software simulation and hardware implementation on a reconfigurable custom very large scale integration chip.

[1]  Randall D. Beer,et al.  Evolution and Analysis of Model CPGs for Walking: I. Dynamical Modules , 1999, Journal of Computational Neuroscience.

[2]  KasabovNikola,et al.  Fast and adaptive network of spiking neurons for multi-view visual pattern recognition , 2008 .

[3]  C. Morris,et al.  Voltage oscillations in the barnacle giant muscle fiber. , 1981, Biophysical journal.

[4]  Ralph Etienne-Cummings,et al.  Configuring of Spiking Central Pattern Generator Networks for Bipedal Walking Using Genetic Algorthms , 2007, 2007 IEEE International Symposium on Circuits and Systems.

[5]  R. Etienne-Cummings,et al.  Spike-Based MAX Networks for Nonlinear Pooling in Hierarchical Vision Processing , 2007, 2007 IEEE Biomedical Circuits and Systems Conference.

[6]  M. Hanson,et al.  Characterization of the Circuits That Generate Spontaneous Episodes of Activity in the Early Embryonic Mouse Spinal Cord , 2003, The Journal of Neuroscience.

[7]  Ernst Niebur,et al.  A Generalized Linear Integrate-and-Fire Neural Model Produces Diverse Spiking Behaviors , 2009, Neural Computation.

[8]  Eugene M. Izhikevich,et al.  Which model to use for cortical spiking neurons? , 2004, IEEE Transactions on Neural Networks.

[9]  J. Victor,et al.  Nature and precision of temporal coding in visual cortex: a metric-space analysis. , 1996, Journal of neurophysiology.

[10]  Ralph Etienne-Cummings,et al.  A programmable array of silicon neurons for the control of legged locomotion , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).

[11]  R.J. Vogelstein,et al.  Conveying tactile feedback using a model of mechanotransduction , 2008, 2008 IEEE Biomedical Circuits and Systems Conference.

[12]  Simei Gomes Wysoski,et al.  On-Line Learning with Structural Adaptation in a Network of Spiking Neurons for Visual Pattern Recognition , 2006, ICANN.

[13]  Ralph Etienne-Cummings,et al.  A First-Order Nonhomogeneous Markov Model for the Response of Spiking Neurons Stimulated by Small Phase-Continuous Signals , 2008, Neural Computation.

[14]  Eero P. Simoncelli,et al.  Maximum Likelihood Estimation of a Stochastic Integrate-and-Fire Neural Encoding Model , 2004, Neural Computation.

[15]  P. Katz Neurons, Networks, Meeting Review and Motor Behavior , 1996 .

[16]  K. Vahala Handbook of stochastic methods for physics, chemistry and the natural sciences , 1986, IEEE Journal of Quantum Electronics.

[17]  Bernhard Schölkopf,et al.  Four-legged Walking Gait Control Using a Neuromorphic Chip Interfaced to a Support Vector Learning Algorithm , 2000, NIPS.

[18]  Luigi Fortuna,et al.  Learning Anticipation via Spiking Networks: Application to Navigation Control , 2009, IEEE Transactions on Neural Networks.

[19]  Wulfram Gerstner,et al.  How Good Are Neuron Models? , 2009, Science.

[20]  Ralph Etienne-Cummings,et al.  Configuring silicon neural networks using genetic algorithms , 2008, 2008 IEEE International Symposium on Circuits and Systems.

[21]  Phill Rowcliffe,et al.  Training Spiking Neuronal Networks With Applications in Engineering Tasks , 2008, IEEE Transactions on Neural Networks.

[22]  Andrew H. Fagg,et al.  Genetic programming approach to the construction of a neural network for control of a walking robot , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[23]  Bernhard Sendhoff,et al.  Evolutionary Multi-objective Optimization of Spiking Neural Networks , 2007, ICANN.

[24]  Ralph Etienne-Cummings,et al.  CPG Design using Inhibitory Networks , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[25]  Simei Gomes Wysoski,et al.  Fast and adaptive network of spiking neurons for multi-view visual pattern recognition , 2008, Neurocomputing.

[26]  S. Karlin,et al.  A second course in stochastic processes , 1981 .

[27]  David R. Ladle,et al.  Assembly of Motor Circuits in the Spinal Cord: Driven to Function by Genetic and Experience-Dependent Mechanisms , 2007, Neuron.

[28]  Ralph Etienne-Cummings,et al.  An in silico central pattern generator: silicon oscillator, coupling, entrainment, and physical computation , 2003, Biological Cybernetics.

[29]  Avis H. Cohen,et al.  Modeling Alternation to Synchrony with Inhibitory Coupling: A Neuromorphic VLSI Approach , 2000, Neural Computation.

[30]  Hugo de Garis,et al.  Genetic programming: building nanobrains with genetically programmed neural network modules , 1990, IJCNN.

[31]  Kazuo Ishii,et al.  Bipedal walk using a Central Pattern Generator , 2004 .

[32]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1952, The Journal of physiology.

[33]  G Kumar,et al.  Optimal parameter estimation of the Izhikevich single neuron model using experimental inter-spike interval (ISI) data , 2010, Proceedings of the 2010 American Control Conference.

[34]  Luigi Fortuna,et al.  A CNN-based chip for robot locomotion control , 2005, IEEE Transactions on Circuits and Systems I: Regular Papers.

[35]  Ralph Etienne-Cummings,et al.  A switched capacitor implementation of the generalized linear integrate-and-fire neuron , 2009, 2009 IEEE International Symposium on Circuits and Systems.

[36]  L. Landmesser,et al.  Cholinergic and GABAergic Inputs Drive Patterned Spontaneous Motoneuron Activity before Target Contact , 1999, The Journal of Neuroscience.

[37]  J. G. Elias,et al.  Evolving synaptic connections for a silicon neuromorph , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[38]  André van Schaik,et al.  Spike response properties of an AER EAR , 2006, 2006 IEEE International Symposium on Circuits and Systems.

[39]  M. Perc The dynamics of human gait , 2005 .

[40]  J. Crank,et al.  A practical method for numerical evaluation of solutions of partial differential equations of the heat-conduction type , 1947 .

[41]  N. Kasabov,et al.  Evolving Intelligence in Humans and Machines: Integrative Evolving Connectionist Systems Approach , 2008, IEEE Computational Intelligence Magazine.

[42]  Neil Davey,et al.  Evolution of bilateral symmetry in agents controlled by spiking neural networks , 2009, 2009 IEEE Symposium on Artificial Life.

[43]  Bin Li,et al.  Serpentine locomotion of a snake-like robot controlled by cyclic inhibitory CPG model , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[44]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .