Achieving Swarm Intelligence with Spiking Neural Oscillators

Mimicking the collaborative behavior of biological swarms, such as bird flocks and ant colonies, Swarm Intelligence algorithms provide efficient solutions for various optimization problems. On the other hand, a computational model of the human brain, spiking neural networks, has been showing great promise in recognition, inference, and learning, due to recent emergence of neuromorphic hardware for high-efficient and low-power computing. Through bridging these two distinct research fields, we propose a novel computing paradigm that implements the swarm intelligence with a population of coupled spiking neural oscillators in basic leaky integrate-and-fire (LIF) model. Our model behaves as a meta-heuristic searching conducted by multiple collaborative agents. In this design, the oscillating neurons serve as agents in the swarm, search for solutions in frequency coding and communicate with each other through spikes. The firing rate of each agent is adaptive to other agents with better solutions and the optimal solution is rendered as the swarm synchronization is reached. We apply the proposed method to the parameter optimization in several test objective functions and demonstrate its effectiveness and efficiency. Our new computing paradigm expands the computational power of coupled spiking neurons in the field of solving optimization problem and brings opportunities for the connection between individual intelligence and swarm intelligence.

[1]  Janez Brest,et al.  A comprehensive review of firefly algorithms , 2013, Swarm Evol. Comput..

[2]  Marjan Mernik,et al.  Analysis of exploration and exploitation in evolutionary algorithms by ancestry trees , 2011 .

[3]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[4]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[5]  G. Di Caro,et al.  Ant colony optimization: a new meta-heuristic , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[6]  W. Marsden.  I and J , 2012 .

[7]  Stefan Habenschuss,et al.  Solving Constraint Satisfaction Problems with Networks of Spiking Neurons , 2016, Front. Neurosci..

[8]  Tadashi Shibata,et al.  Non-Boolean Associative Processing: Circuits, System Architecture, and Algorithms , 2015, IEEE Journal on Exploratory Solid-State Computational Devices and Circuits.

[9]  Mauro Birattari,et al.  Swarm Intelligence , 2012, Lecture Notes in Computer Science.

[10]  Xiaodong Li,et al.  Swarm Intelligence in Optimization , 2008, Swarm Intelligence.

[11]  Romain Brette,et al.  Equation-oriented specification of neural models for simulations , 2013, Front. Neuroinform..

[12]  Marco Dorigo,et al.  The ant colony optimization meta-heuristic , 1999 .

[13]  Jongkil Park,et al.  Live demonstration: Hierarchical Address-Event Routing architecture for reconfigurable large scale neuromorphic systems , 2012, 2012 IEEE International Symposium on Circuits and Systems.

[14]  Andrew S. Cassidy,et al.  Conversion of artificial recurrent neural networks to spiking neural networks for low-power neuromorphic hardware , 2016, 2016 IEEE International Conference on Rebooting Computing (ICRC).

[15]  Andrew S. Cassidy,et al.  A million spiking-neuron integrated circuit with a scalable communication network and interface , 2014, Science.

[16]  Deepak Khosla,et al.  Spiking Deep Convolutional Neural Networks for Energy-Efficient Object Recognition , 2014, International Journal of Computer Vision.

[17]  Russell C. Eberhart,et al.  The particle swarm: social adaptation in information-processing systems , 1999 .

[18]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[19]  Haibin Duan,et al.  New progresses in swarm intelligence-based computation , 2015, Int. J. Bio Inspired Comput..

[20]  Andrew D. Back,et al.  A spiking neural network architecture for nonlinear function approximation , 2001, Neural Networks.

[21]  Xin-She Yang,et al.  A New Metaheuristic Bat-Inspired Algorithm , 2010, NICSO.

[22]  K. Roy,et al.  Injection-Locked Spin Hall-Induced Coupled-Oscillators for Energy Efficient Associative Computing , 2015, IEEE Transactions on Nanotechnology.

[23]  Neil Genzlinger.  A. and Q , 2006 .