Action learning to single robot using MAS — A proposal of agents action decision method based repeated consultation

Robots can employ a multi-agent system (MAS) as a technique to adapt to complex environments. In a MAS, numerous agents operate autonomously, but each agent is required to make decisions by considering other agents. Thus, agent cooperation is an important feature of a MAS. In this study, we focus on a MAS where the agents make connections by reinforcement learning. We propose a method that allows agents to learn and cooperate via communication. The actions of other agents are added to the state of each agent. Each agent performs virtual action selection and communicates with other agents to produce each action output.

[1]  Hao Ren haoren,et al.  Reinforcement Learning in Cooperative Multi – Agent Systems , 2006 .

[2]  Victoria Y. Yoon,et al.  Agent learning in the multi-agent contracting system [MACS] , 2008, Decis. Support Syst..

[3]  Jun Ota,et al.  Multi-agent robot systems as distributed autonomous systems , 2006, Adv. Eng. Informatics.

[4]  Jacques Ferber,et al.  Multi-agent systems - an introduction to distributed artificial intelligence , 1999 .

[5]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[6]  Andrew G. Barto,et al.  Reinforcement learning , 1998 .

[7]  Ronald C. Arkin,et al.  Robot behavioral selection using q-learning , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[9]  Ying Wang,et al.  A machine-learning approach to multi-robot coordination , 2008, Eng. Appl. Artif. Intell..

[10]  J. V. Rauff,et al.  Multi-Agent Systems: An Introduction to Distributed Artificial Intelligence , 2005 .

[11]  Wenwei Yu,et al.  Obstacle avoidance learning for a multi-agent linked robot in the real world , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[12]  José del R. Millán,et al.  Continuous-Action Q-Learning , 2002, Machine Learning.

[13]  Joaquim Salvi,et al.  A multi-agent architecture with cooperative fuzzy control for a mobile robot , 2007, Robotics Auton. Syst..

[14]  Leslie Pack Kaelbling,et al.  Automated Design of Adaptive Controllers for Modular Robots using Reinforcement Learning , 2008, Int. J. Robotics Res..

[15]  Bart De Schutter,et al.  Multi-Agent Reinforcement Learning: A Survey , 2006, 2006 9th International Conference on Control, Automation, Robotics and Vision.

[16]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[17]  Sean Luke,et al.  Cooperative Multi-Agent Learning: The State of the Art , 2005, Autonomous Agents and Multi-Agent Systems.

[18]  Peter Stone,et al.  Reinforcement learning , 2019, Scholarpedia.