Distributed Strategy Adaptation with a Prediction Function in Multi-Agent Task Allocation

Coordinating multiple agents to complete a set of tasks under time constraints is a complex problem. Distributed consensus-based task allocation algorithms address this problem without the need for human supervision. With such algorithms, agents add tasks to their own schedule according to specified allocation strategies. Various factors, such as the available resources and number of tasks, may affect the efficiency of a particular allocation strategy. The novel idea we suggest is that each individual agent can predict locally the best task inclusion strategy, based on the limited task assignment information communicated among networked agents. Using supervised classification learning, a function is trained to predict the most appropriate strategy between two well known insertion heuristics. Using the proposed method, agents are shown to correctly predict and select the optimal insertion heuristic to achieve the overall highest number of task allocations. The adaptive agents consistently match the performances of the best non-adaptive agents across a variety of scenarios. This study aims to demonstrate the possibility and potential performance benefits of giving agents greater decision making capabilities to independently adapt the task allocation process in line with the problem of interest.

[1]  Gerhard Weiß,et al.  Adaptation and Learning in Multi-Agent Systems: Some Remarks and a Bibliography , 1995, Adaption and Learning in Multi-Agent Systems.

[2]  Han-Lim Choi,et al.  The role of information assumptions in decentralized task allocation: A tutorial , 2016, IEEE Control Systems.

[3]  Han-Lim Choi,et al.  Consensus-Based Decentralized Auctions for Robust Task Allocation , 2009, IEEE Transactions on Robotics.

[4]  Yichuan Jiang,et al.  A Survey of Task Allocation and Load Balancing in Distributed Systems , 2016, IEEE Transactions on Parallel and Distributed Systems.

[5]  Han-Lim Choi,et al.  Distributed Planning Strategies to Ensure Network Connectivity for Dynamic Heterogeneous Teams , 2012, IEEE Journal on Selected Areas in Communications.

[6]  Anthony Stentz,et al.  A comprehensive taxonomy for multi-robot task allocation , 2013, Int. J. Robotics Res..

[7]  Milind Tambe,et al.  Towards Flexible Teamwork , 1997, J. Artif. Intell. Res..

[8]  Manuela M. Veloso,et al.  Multiagent Systems: A Survey from a Machine Learning Perspective , 2000, Auton. Robots.

[9]  Han-Lim Choi,et al.  Decentralized planning for complex missions with dynamic communication constraints , 2010, Proceedings of the 2010 American Control Conference.

[10]  Bart De Schutter,et al.  A Comprehensive Survey of Multiagent Reinforcement Learning , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[11]  David Naso,et al.  Decentralized task allocation for surveillance systems with critical tasks , 2013, Robotics Auton. Syst..

[12]  Frank L. Lewis,et al.  Decentralized dynamic task planning for heterogeneous robotic networks , 2015, Auton. Robots.

[13]  Richard Alterman,et al.  Autonomous Agents that Learn to Better Coordinate , 2004, Autonomous Agents and Multi-Agent Systems.

[14]  Gerald Schaefer,et al.  Distributed Task Rescheduling With Time Constraints for the Optimization of Total Task Allocations in a Multirobot System , 2018, IEEE Transactions on Cybernetics.

[15]  Sameera S. Ponda Robust distributed planning strategies for autonomous multi-agent teams , 2012 .

[16]  Florin Pop,et al.  New scheduling approach using reinforcement learning for heterogeneous distributed systems , 2017, J. Parallel Distributed Comput..

[17]  Han-Lim Choi,et al.  Improving the Efficiency of a Decentralized Tasking Algorithm for UAV Teams with Asynchronous Communications , 2010 .

[18]  Gerald Schaefer,et al.  Fast consensus for fully distributed multi-agent task allocation , 2018, SAC.

[19]  Han-Lim Choi,et al.  Decentralized task allocation for heterogeneous teams with cooperation constraints , 2010, Proceedings of the 2010 American Control Conference.

[20]  Yujing Hu,et al.  Learning in Multi-agent Systems with Sparse Interactions by Knowledge Transfer and Game Abstraction , 2015, AAMAS.

[21]  Han-Lim Choi,et al.  Allowing non-submodular score functions in distributed task allocation , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[22]  Bo Gao,et al.  Game theory-based negotiation for multiple robots task allocation , 2013, Robotica.

[23]  Michael L. Littman,et al.  Markov Games as a Framework for Multi-Agent Reinforcement Learning , 1994, ICML.

[24]  Nidhi Kalra,et al.  Market-Based Multirobot Coordination: A Survey and Analysis , 2006, Proceedings of the IEEE.

[25]  Julie A. Shah,et al.  Apprenticeship Scheduling: Learning to Schedule from Human Experts , 2016, IJCAI.

[26]  Sean Luke,et al.  Cooperative Multi-Agent Learning: The State of the Art , 2005, Autonomous Agents and Multi-Agent Systems.

[27]  Hakim Mitiche,et al.  Efficient heuristics for a time-extended multi-robot task allocation problem , 2015, 2015 First International Conference on New Technologies of Information and Communication (NTIC).

[28]  Nils J. Nilsson,et al.  A Formal Basis for the Heuristic Determination of Minimum Cost Paths , 1968, IEEE Trans. Syst. Sci. Cybern..