A Distributed Control Method Based on Neighbor Reward for Robot Swarm

Real-time control strategy development remains challenging in the field of controlling multi-robot system. Due to frequent and massive interactions among robots, it is hard to implement a real-time control strategy in the multi-robot system. This phenomenon further limits the development of multi-robot application which adopts the real-time control strategy. To deal with above challenges, this paper proposes a decentralized control policy for multi-robot to avoid collision in an unknown environment. This policy adopts reward value to measure robots' motion and states. With reward value, robots can determine which neighbor robot to communicate with and to learn from, which decreases the interaction cost incurred in the multi-robot system. By the reward, the control strategy of each robot can be optimized through learning from its neighbors. Comparative experiments are conducted in a simulator to evaluate the effectiveness of our policy.

[1]  Reza Olfati-Saber,et al.  Flocking for multi-agent dynamic systems: algorithms and theory , 2006, IEEE Transactions on Automatic Control.

[2]  Ali Emre Turgut,et al.  Self-organized flocking in mobile robot swarms , 2008, Swarm Intelligence.

[3]  Adam T. Hayes,et al.  Self-organized flocking with agent failure: Off-line optimization and demonstration with real robots , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[4]  R. Eberhart,et al.  Fuzzy adaptive particle swarm optimization , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[5]  Craig W. Reynolds Flocks, herds, and schools: a distributed behavioral model , 1987, SIGGRAPH.

[6]  Francesco Mondada,et al.  Mergeable nervous systems for robots , 2017, Nature Communications.

[7]  Fernando Matía,et al.  A Survey of Collective Movement of Mobile Robots , 2013 .

[8]  Luiz Chaimowicz,et al.  Aerial Shepherds: Coordination among UAVs and Swarms of Robots , 2004, DARS.

[9]  Eliseo Ferrante,et al.  Self-organized flocking with a mobile robot swarm: a novel motion control method , 2012, Adapt. Behav..

[10]  V. Isaeva Self-organization in biological systems , 2012, Biology Bulletin.

[11]  Alan F. T. Winfield,et al.  Special issue on swarm robotics , 2008, Swarm Intelligence.

[12]  Gerardo Beni,et al.  From Swarm Intelligence to Swarm Robotics , 2004, Swarm Robotics.

[13]  Qiang Lai,et al.  A local flocking algorithm of multi-agent dynamic systems , 2015, Int. J. Control.

[14]  Zhongyang Zheng,et al.  Research Advance in Swarm Robotics , 2013 .

[15]  Belkacem Khaldi,et al.  An Overview of Swarm Robotics: Swarm Intelligence Applied to Multi-robotics , 2015 .