Hybrid autonomous control for heterogeneous multi-agent system

Reinforcement learning is an adaptive and flexible control method for autonomous system. In our previous works, we had proposed a reinforcement learning algorithm for redundant systems: "Q-learning with dynamic structuring of exploration space based on GA (QDSEGA)", and applied it to multi-agent systems. However previous works of the QDSEGA have been restricted to homogeneous agents. In this paper, we extend our previous works of multi-agent systems, and propose a hybrid autonomous control method for heterogeneous multi-agent systems. To demonstrate the effectiveness of the proposed method, simulations of transportation task by 10 heterogeneous mobile robots have been carried out. As a result effective behaviors have been obtained.

[1]  B. Achiriloaie,et al.  VI REFERENCES , 1961 .

[2]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[3]  Kazuyuki Ito,et al.  A study of reinforcement learning for the robot with many degrees of freedom - acquisition of locomotion patterns for multi-legged robot , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[4]  K. Ito.  A study of Q-learning : dynamic structuring of exploration space based on genetic algorithm , 2001 .

[5]  Peter Dayan,et al.  Technical Note: Q-Learning , 2004, Machine Learning.

[6]  Jun'ichi Takeno,et al.  Coordinating Mobile Robots By Applying Traffic Rules , 1992, Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems.