Self-organization of Spiking Neural Network that Generates Autonomous Behavior in a Real Mobile Robot

In this paper, we propose self-organization algorithm of spiking neural network (SNN) applicable to autonomous robot for generation of adoptive and goal-directed behavior. First, we formulated a SNN model whose inputs and outputs were analog and the hidden unites are interconnected each other. Next, we implemented it into a miniature mobile robot Khepera. In order to see whether or not a solution(s) for the given task(s) exists with the SNN, the robot was evolved with the genetic algorithm in the environment. The robot acquired the obstacle avoidance and navigation task successfully, exhibiting the presence of the solution. After that, a self-organization algorithm based on a use-dependent synaptic potentiation and depotentiation at synapses of input layer to hidden layer and of hidden layer to output layer was formulated and implemented into the robot. In the environment, the robot incrementally organized the network and the given tasks were successfully performed. The time needed to acquire the desired adoptive and goal-directed behavior using the proposed self-organization method was much less than that with the genetic evolution, approximately one fifth.

[1]  Michael Schmitt,et al.  Unsupervised learning and self-organization in networks of spiking neurons , 2001 .

[2]  Eduardo Zalama Casanova,et al.  Adaptive behavior navigation of a mobile robot , 2002, IEEE Trans. Syst. Man Cybern. Part A.

[3]  Babul Islam.  Incremental Evolution with Learning to Develop the Control System of Autonomous Robots for Complex Task , 2002 .

[4]  Dario Floreano,et al.  From Wheels to Wings with Evolutionary Spiking Circuits , 2003, Artificial Life.

[5]  Juan López Coronado,et al.  A real-time, unsupervised neural network for the low-level control of a mobile robot in a nonstationary environment , 1995, Neural Networks.

[6]  Amir Reza Saffari Azar Alamdari.  Unknown Environment Representation for Mobile Robot Using Spiking Neural Networks , 2007 .

[7]  Mark Kröll,et al.  Movement Prediction from Real-World Images Using a Liquid State Machine , 2005, IEA/AIE.

[8]  Geoffrey E. Hinton,et al.  Unsupervised learning : foundations of neural computation , 1999 .

[9]  Jun Tani,et al.  Motor primitive and sequence self-organization in a hierarchical recurrent neural network , 2004, Neural Networks.

[10]  Dario Floreano,et al.  Hardware spiking neural network with run-time reconfigurable connectivity in an autonomous robot , 2003, NASA/DoD Conference on Evolvable Hardware, 2003. Proceedings..

[11]  Wolfgang Maass,et al.  Networks of Spiking Neurons: The Third Generation of Neural Network Models , 1996, Electron. Colloquium Comput. Complex..

[12]  Wolfgang Maass,et al.  Movement Generation with Circuits of Spiking Neurons , 2005, Neural Computation.

[13]  Dario Floreano,et al.  Evolving Spiking Neurons from Wheels to Wings , 2003 .

[14]  Angelo Arleo,et al.  Cognitive navigation based on nonuniform Gabor space sampling, unsupervised growing networks, and reinforcement learning , 2004, IEEE Transactions on Neural Networks.

[15]  Ben J. A. Kröse,et al.  Distributed adaptive control: The self-organization of structured behavior , 1992, Robotics Auton. Syst..

[16]  Risto Miikkulainen,et al.  Self-Organization and Segmentation with Laterally Connected Spiking Neurons , 1997, IJCAI.

[17]  Juan López Coronado,et al.  An unsupervised neural network for low-level control of a wheeled mobile robot: noise resistance, stability, and hardware implementation , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[18]  Michael Schmitt,et al.  Self-organization of spiking neurons using action potential timing , 1998, IEEE Trans. Neural Networks.

[19]  Carolina Chang,et al.  Using sensor habituation in mobile robots to reduce oscillatory movements in narrow corridors , 2005, IEEE Transactions on Neural Networks.

[20]  Lakhmi C. Jain,et al.  Self-Organizing Neural Networks , 2002 .

[21]  Dario Floreano,et al.  Evolution of Spiking Neural Controllers for Autonomous Vision-Based Robots , 2001, EvoRobots.

[22]  Michael Schmitt,et al.  Learning Temporally Encoded Patterns in Networks of Spiking Neurons , 2004, Neural Processing Letters.

[23]  Wulfram Gerstner,et al.  Spiking Neuron Models , 2002 .

[24]  Jun Tani,et al.  Self-organization of distributedly represented multiple behavior schemata in a mirror system: reviews of robot experiments using RNNPB , 2004, Neural Networks.

[25]  Sebastian A. Wills,et al.  Computation with Spiking Neurons , 2004 .

[26]  Jacob Nielsen,et al.  Spiking neural building block robot with Hebbian learning , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).