Market Clearing–based Dynamic Multi-agent Task Allocation

Realistic multi-agent team applications often feature dynamic environments with soft deadlines that penalize late execution of tasks. This puts a premium on quickly allocating tasks to agents. However, when such problems include temporal and spatial constraints that require tasks to be executed sequentially by agents, they are NP-hard, and thus are commonly solved using general and specifically designed incomplete heuristic algorithms. We propose FMC_TA, a novel such incomplete task allocation algorithm that allows tasks to be easily sequenced to yield high-quality solutions. FMC_TA first finds allocations that are fair (envy-free), balancing the load and sharing important tasks among agents, and efficient (Pareto optimal) in a simplified version of the problem. It computes such allocations in polynomial or pseudo-polynomial time (centrally or distributedly, respectively) using a Fisher market with agents as buyers and tasks as goods. It then heuristically schedules the allocations, taking into account inter-agent constraints on shared tasks. We empirically compare our algorithm to state-of-the-art incomplete methods, both centralized and distributed, on law enforcement problems inspired by real police logs. We present a novel formalization of the law enforcement problem, which we use to perform our empirical study. The results show a clear advantage for FMC_TA in total utility and in measures in which law enforcement authorities measure their own performance. Besides problems with realistic properties, the algorithms were compared on synthetic problems in which we increased the size of different elements of the problem to investigate the algorithm’s behavior when the problem scales. The domination of the proposed algorithm was found to be consistent.

[1]  Steven Okamoto,et al.  Dynamic Multi-Agent Task Allocation with Spatial and Temporal Constraints , 2014, AAAI.

[2]  Nicholas R. Jennings,et al.  Decentralised coordination of low-power embedded devices using the max-sum algorithm , 2008, AAMAS.

[3]  Li Zhang,et al.  Proportional response dynamics in the Fisher market , 2009, Theor. Comput. Sci..

[4]  Weixiong Zhang,et al.  Distributed stochastic search and distributed breakout: properties, comparison and applications to constraint optimization problems in sensor networks , 2005, Artif. Intell..

[5]  Richard Wolski,et al.  Analyzing Market-Based Resource Allocation Strategies for the Computational Grid , 2001, Int. J. High Perform. Comput. Appl..

[6]  Li Zhang,et al.  Tycoon: An implementation of a distributed, market-based resource allocation system , 2004, Multiagent Grid Syst..

[7]  Maria L. Gini,et al.  Tasks with cost growing over time and agent reallocation delays , 2014, AAMAS.

[8]  Sarit Kraus,et al.  Methods for Task Allocation via Agent Coalition Formation , 1998, Artif. Intell..

[9]  Maria L. Gini,et al.  Repeated auctions for robust task execution by a robot team , 2010, Robotics Auton. Syst..

[10]  Sarvapali D. Ramchurn,et al.  Decentralized Coordination in RoboCup Rescue , 2010, Comput. J..

[11]  Sarvapali D. Ramchurn,et al.  Coalition formation with spatial and temporal constraints , 2010, AAMAS.

[12]  Peter M. A. Sloot,et al.  On the complexity of task allocation , 1997, Complex..

[13]  Athanasios V. Vasilakos,et al.  A Survey of Self-Organization Mechanisms in Multiagent Systems , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[14]  Maria L. Gini,et al.  Task Allocation for Spatially and Temporally Distributed Tasks , 2012, IAS.

[15]  Yichuan Jiang,et al.  A Survey of Task Allocation and Load Balancing in Distributed Systems , 2016, IEEE Transactions on Parallel and Distributed Systems.

[16]  Evangelos Markakis,et al.  The Power of Sequential Single-Item Auctions for Agent Coordination , 2006, AAAI.

[17]  T. Martin McGinnity,et al.  A Distributed Task Allocation Algorithm for a Multi-Robot System in Healthcare Facilities , 2015, J. Intell. Robotic Syst..

[18]  Hakim Mitiche,et al.  A taxonomy for task allocation problems with temporal and ordering constraints , 2017, Robotics Auton. Syst..

[19]  Sameera S. Ponda,et al.  Distributed chance-constrained task allocation for autonomous multi-agent teams , 2012, 2012 American Control Conference (ACC).

[20]  Mauro Birattari,et al.  Self-organized task allocation to sequentially interdependent tasks in swarm robotics , 2012, Autonomous Agents and Multi-Agent Systems.

[21]  Anthony Stentz,et al.  Learning-enhanced market-based task allocation for oversubscribed domains , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  Sarvapali D. Ramchurn,et al.  A Distributed Anytime Algorithm for Dynamic Task Allocation in Multi-Agent Systems , 2011, AAAI.

[23]  Steven Okamoto,et al.  Explorative anytime local search for distributed constraint optimization , 2014, Artif. Intell..

[24]  Theo Tryfonas,et al.  Frontiers in Artificial Intelligence and Applications , 2009 .

[25]  Milind Tambe,et al.  Distributed Algorithms for DCOP: A Graphical-Game-Based Approach , 2004, PDCS.

[26]  Nikhil R. Devanur,et al.  Market equilibrium via a primal-dual-type algorithm , 2002, The 43rd Annual IEEE Symposium on Foundations of Computer Science, 2002. Proceedings..

[27]  Ernesto Nunes,et al.  Exploiting Spatial Locality and Heterogeneity of Agents for Search and Rescue Teamwork * , 2016, J. Field Robotics.

[28]  Michael P. Wellman,et al.  A market protocol for decentralized task allocation , 1998, Proceedings International Conference on Multi Agent Systems (Cat. No.98EX160).

[29]  Koen V. Hindriks,et al.  Dynamic task allocation for multi-robot search and retrieval tasks , 2016, Applied Intelligence.

[30]  Alan K. Mackworth,et al.  Artificial Intelligence - Foundations of Computational Agents , 2010 .

[31]  Hans Reijnierse,et al.  On finding an envy-free Pareto-optimal division , 1998, Math. Program..

[32]  Anthony Stentz,et al.  Market-based Multirobot Coordination for Complex Tasks , 2006, Int. J. Robotics Res..

[33]  Roie Zivan,et al.  Applying max-sum to teams of mobile sensing agents , 2018, Eng. Appl. Artif. Intell..

[34]  Nicholas R. Jennings,et al.  Agent-based decentralised coordination for sensor networks using the max-sum algorithm , 2014, Autonomous Agents and Multi-Agent Systems.

[35]  H. Scarf,et al.  How to Compute Equilibrium Prices in 1891 , 2005 .

[36]  F. Glover,et al.  In Modern Heuristic Techniques for Combinatorial Problems , 1993 .

[37]  Nidhi Kalra,et al.  Market-Based Multirobot Coordination: A Survey and Analysis , 2006, Proceedings of the IEEE.

[38]  Daniele Nardi,et al.  Distributed on-line dynamic task assignment for multi-robot patrolling , 2017, Auton. Robots.

[39]  Steven Vajda,et al.  The Theory of Linear Economic Models , 1960 .

[40]  Michael Wooldridge,et al.  Adaptive task resources allocation in multi-agent systems , 2001, AGENTS '01.

[41]  Han-Lim Choi,et al.  Consensus-Based Decentralized Auctions for Robust Task Allocation , 2009, IEEE Transactions on Robotics.

[42]  Robin Cohen,et al.  Using reservations for multiagent resource allocation with costly preemption , 2018, Multiagent and Grid Systems.

[43]  Ernesto Nunes,et al.  Multi-Robot Auctions for Allocation of Tasks with Temporal Constraints , 2015, AAAI.

[44]  Steven Skiena,et al.  The Algorithm Design Manual , 2020, Texts in Computer Science.