Adaptive Robot Coordination Using Interference Metrics

One key issue facing robotic teams is effective coordination mechanisms. Many robotic groups operate within domains where restrictions such as limiting areas of operation are liable to cause spatial conflicts between robots. Our previous work proposed a measure of coordination, interference, that measured the total time robots dealt with resolving such conflicts. We found that a robotic group's productivity was negatively correlated with interference: Effective coordination techniques minimized interference and thus achieved higher productivity. This paper uses this result to create adaptive coordination techniques that are able to dynamically adjust the efforts spent on coordination to match the number of perceived coordination conflicts in a group. Our robots independently calculate a projected level of interference they will encounter. By using this metric as a guide, we are able to create adaptive coordination methods that can quickly and effectively adjust to changing conditions within their environment. We present an adaptation heuristic that is completely distributed and requires no communication between robots. Using thousands of simulated trials, we found that groups using this approach achieved a statistically significant improvement in productivity over non-adaptive coordination methods.

[1]  Lynne E. Parker,et al.  Robot Teams: From Diversity to Polymorphism , 2002 .

[2]  Maja J. Mataric,et al.  Reinforcement Learning in the Multi-Robot Domain , 1997, Auton. Robots.

[3]  Pattie Maes,et al.  A Study of Territoriality: The Role of Critical Mass in Adaptive Task Division , 1996 .

[4]  Gaurav S. Sukhatme,et al.  Go ahead, make my day: Robot conflict resolution by aggressive competition , 2000 .

[5]  Sandip Sen,et al.  Learning to Coordinate without Sharing Information , 1994, AAAI.

[6]  Dani Goldberg Design and Evaluation of Robust Behavior-Based Controllers for Distributed Multi-Robot Collection Tasks , 2001 .

[7]  Ronald C. Arkin,et al.  Cooperative multiagent robotic systems , 1998 .

[8]  Sarit Kraus,et al.  A study of marginal performance properties in robotic groups , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[9]  Sridhar Mahadevan,et al.  Automatic Programming of Behavior-Based Robots Using Reinforcement Learning , 1991, Artif. Intell..

[10]  Ming Tan,et al.  Multi-Agent Reinforcement Learning: Independent versus Cooperative Agents , 1997, ICML.

[11]  Maja J. Mataric,et al.  Interference as a Tool for Designing and Evaluating Multi-Robot Controllers , 1997, AAAI/IAAI.

[12]  Bernhard Nebel,et al.  Dynamic decentralized area partitioning for cooperating cleaning robots , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).