Weighted synergy graphs for effective team formation with heterogeneous ad hoc agents

Previous approaches to select agents to form a team rely on single-agent capabilities, and team performance is treated as a sum of such known capabilities. Motivated by complex team formation situations, we address the problem where both single-agent capabilities may not be known upfront, e.g., as in ad hoc teams, and where team performance goes beyond single-agent capabilities and depends on the specific synergy among agents. We formally introduce a novel weighted synergy graph model to capture new interactions among agents. Agents are represented as vertices in the graph, and their capabilities are represented as Normally-distributed variables. The edges of the weighted graph represent how well the agents work together, i.e., their synergy in a team. We contribute a learning algorithm that learns the weighted synergy graph using observations of performance of teams of only two and three agents. Further, we contribute two team formation algorithms, one that finds the optimal team in exponential time, and one that approximates the optimal team in polynomial time. We extensively evaluate our learning algorithm, and demonstrate the expressiveness of the weighted synergy graph in a variety of problems. We show our approach in a rich ad hoc team formation problem capturing a rescue domain, namely the RoboCup Rescue domain, where simulated robots rescue civilians and put out fires in a simulated urban disaster. We show that the weighted synergy graph outperforms a competing algorithm, thus illustrating the efficacy of our model and algorithms.

[1]  Marie desJardins,et al.  Local strategy learning in networked multi-agent team formation , 2006, Autonomous Agents and Multi-Agent Systems.

[2]  Feng Wu,et al.  Online Planning for Ad Hoc Autonomous Agent Teams , 2011, IJCAI.

[3]  Somchaya Liemhetcharat,et al.  Mutual State Capability-Based Role Assignment Model (Extended Abstract) , 2010 .

[4]  Rosbi Mamat,et al.  Market-based approach for multi-team robot cooperation , 2000, 2009 4th International Conference on Autonomous Robots and Agents.

[5]  Manuela M. Veloso,et al.  Weighted synergy graphs for role assignment in ad hoc heterogeneous robot teams , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Marie desJardins,et al.  Agent-organized networks for dynamic team formation , 2005, AAMAS '05.

[7]  J. M. George,et al.  Multiple UAV Coalition Formation Strategies (Extended Abstract) , 2010 .

[8]  Bikramjit Banerjee,et al.  Coalition structure generation in multi-agent systems with mixed externalities , 2010, AAMAS.

[9]  Ana L. C. Bazzan,et al.  RoboCup Rescue as multiagent task allocation among teams: experiments with task interdependencies , 2010, Autonomous Agents and Multi-Agent Systems.

[10]  Sarit Kraus,et al.  Empirical evaluation of ad hoc teamwork in the pursuit domain , 2011, AAMAS.

[11]  Nicholas R. Jennings,et al.  A logic-based representation for coalitional games with externalities , 2010, AAMAS.

[12]  Yu Zhang,et al.  Task allocation with executable coalitions in multirobot tasks , 2012, 2012 IEEE International Conference on Robotics and Automation.

[13]  Cheng-Te Li,et al.  Team Formation for Generalized Tasks in Expertise Social Networks , 2010, 2010 IEEE Second International Conference on Social Computing.

[14]  Manuela M. Veloso,et al.  Forming an effective multi-robot team robust to failures , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Lovekesh Vig,et al.  Coalition Formation: From Software Agents to Robots , 2007, J. Intell. Robotic Syst..

[16]  P. B. Sujit,et al.  Multiple UAV coalition formation strategies , 2010, AAMAS.

[17]  Sarvapali D. Ramchurn,et al.  Coalition formation with spatial and temporal constraints , 2010, AAMAS.

[18]  Peter Stone,et al.  Leading a Best-Response Teammate in an Ad Hoc Team , 2009, AMEC/TADA.

[19]  Yingqian Zhang,et al.  Distributed task allocation in social networks , 2007, AAMAS '07.

[20]  Bernhard Nebel,et al.  Successful Search and Rescue in Simulated Disaster Areas , 2005, RoboCup.

[21]  Lynne E. Parker,et al.  A Complete Methodology for Generating Multi-Robot Task Solutions using ASyMTRe-D and Market-Based Task Allocation , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[22]  Manuela M. Veloso,et al.  Mutual state capability-based role assignment model , 2010, AAMAS.

[23]  Onn Shehory,et al.  Coalition structure generation with worst case guarantees , 2022 .

[24]  Manuela M. Veloso,et al.  Learning the synergy of a new teammate , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Manuela M. Veloso,et al.  Modeling and learning synergy for team formation with heterogeneous agents , 2012, AAMAS.

[26]  Anthony Stentz,et al.  Multi-robot exploration controlled by a market economy , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[27]  Sarit Kraus,et al.  Ad Hoc Autonomous Agent Teams: Collaboration without Pre-Coordination , 2010, AAAI.

[28]  Noa Agmon,et al.  Role-Based Ad Hoc Teamwork , 2011, AAAI.

[29]  Hiroaki Kitano,et al.  RoboCup Rescue: search and rescue in large-scale disasters as a domain for autonomous agents research , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[30]  Sarit Kraus,et al.  To teach or not to teach?: decision making under uncertainty in ad hoc teams , 2010, AAMAS.

[31]  Richard M. Karp,et al.  Reducibility Among Combinatorial Problems , 1972, 50 Years of Integer Programming.

[32]  Schahram Dustdar,et al.  Composing Near-Optimal Expert Teams: A Trade-Off between Skills and Connectivity , 2010, OTM Conferences.

[33]  Hans Utz,et al.  Coordination Without Negotiation in Teams of Heterogeneous Robots , 2006, RoboCup.

[34]  Jian Chen,et al.  Resource constrained multirobot task allocation based on leader–follower coalition methodology , 2011, Int. J. Robotics Res..

[35]  Samuel Barrett and Peter Stone Ad Hoc Teamwork Modeled with Multi-armed Bandits: An Extension to Discounted Infinite Rewards , 2011 .

[36]  Julie A. Adams,et al.  Coalition formation for task allocation: theory and algorithms , 2011, Autonomous Agents and Multi-Agent Systems.

[37]  Ana L. C. Bazzan,et al.  Towards efficient multiagent task allocation in the RoboCup Rescue: a biologically-inspired approach , 2011, Autonomous Agents and Multi-Agent Systems.

[38]  Anthony Stentz,et al.  A Free Market Architecture for Distributed Control of a Multirobot System , 2000 .

[39]  Manuela M. Veloso,et al.  Modeling mutual capabilities in heterogeneous teams for role assignment , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[40]  Anthony Stentz,et al.  Traderbots: a new paradigm for robust and efficient multirobot coordination in dynamic environments , 2004 .

[41]  Manuela M. Veloso,et al.  Synergy graphs for configuring robot team members , 2013, AAMAS.

[42]  Gul A. Agha,et al.  Maximal Clique Based Distributed Coalition Formation for Task Allocation in Large-Scale Multi-agent Systems , 2004, MMAS.

[43]  Noa Agmon,et al.  Leading Multiple Ad Hoc Teammates in Joint Action Settings , 2011, Interactive Decision Theory and Game Theory.

[44]  Lynne E. Parker,et al.  Building Multirobot Coalitions Through Automated Task Solution Synthesis , 2006, Proceedings of the IEEE.

[45]  Anthony Stentz,et al.  Opportunistic optimization for market-based multirobot control , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[46]  Theodoros Lappas,et al.  Finding a team of experts in social networks , 2009, KDD.

[47]  Lovekesh Vig,et al.  Market-Based Multi-robot Coalition Formation , 2006, DARS.

[48]  Katia Sycara,et al.  A STABLE AND EFFICIENT SCHEME FOR TASK ALLOCATION VIA AGENT COALITION FORMATION , 2004 .