Multi-Robot Q-Learning over Community Perception Network with Homogeneous Delays

With the more robots, the information interaction of multi-robot system becomes more sophisticated and important in a community perception network environment. By exploiting and fusing the learning information of robots in a perception community, the community information sharing mechanism is proposed, as well as updating rules of the community Q-value table. Moreover, considering the existence of delays of learning information transmission, an improved Q-learning method based on homogeneous delays is presented to improve the robot learning efficiency over the community perception network. Finally, the test experiments demonstrate the effectiveness of the proposed scheme.

[1]  Zhu Qing-bao Path planning of robot for unknown environment based on prior knowledge rolling Q-learning , 2010 .

[2]  Alessandro Saffiotti,et al.  Network robot systems , 2008, Robotics Auton. Syst..

[3]  Takayuki Kanda,et al.  Easy development of communicative behaviors in social robots , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Shen Jin,et al.  A Survey of Hierarchical Reinforcement Learning , 2005 .

[5]  Zhiqiang Cao,et al.  Study on Q-Learning of Multi-Robot Systems Based on Community Perception Networks , 2012 .

[6]  Hu Zi-ying Q-Learning based on the Experience knowledge , 2006 .

[7]  Wang Chang A Shared Experience Tuples Multi-Agent Cooperative Reinforcement Learning Algorithm , 2005 .

[8]  Mao Jun-xin Robot's Behavioral Decision-making Strategy Based on Artificial Emotion and Q-learning , 2011 .

[9]  Li Long-shu Hierarchical regional cooperative Q-learning , 2009 .

[10]  Zhang Wen Q-learning with prior knowledge in multi-agent systems , 2005 .

[11]  Chen Zhe-pin Application of the Experience-shared Distributed Q-learning Model in RoboCup , 2010 .

[12]  Yuequan Yang,et al.  Study on Online εNN Q-Learning for Multi-Robot System Based on Community Perception Network , 2013 .

[13]  Takayuki Kanda,et al.  A Communication Robot in a Shopping Mall , 2010, IEEE Transactions on Robotics.

[14]  Xia Yang,et al.  A survey of reinforcement learning research and its application for multi-robot systems , 2012, Proceedings of the 31st Chinese Control Conference.