An auction-based approach with closed-loop bid adjustment to dynamic task allocation in robot teams

—Dynamic task allocation is among the most difficult issues in multi-robot coordination, although it is imperative for a multitude of applications. Auction-based approaches are popular methods that allocate tasks to robots by assembling team information at a single location to make practicable decisions. However, a main deficiency of auction-based methods is that robots generally do not have sufficient information to estimate reliable bids to perform tasks, particularly in dynamic environments. While some techniques have been developed to improve bidding, they are mostly open-looped without feedback adjustments to tune the bid prices for subsequent tasks of the same type. Robots' bids, if not assessed and adjusted accordingly, may not be trustworthy and would indeed impede team performance. To address this issue, we propose a closed-loop bid adjustment mechanism for auction-based multi-robot task allocation, with an aim to evaluate and improve robots' bids, and hence enhance the overall team performance. Each robot in a team maintains and uses its own track record as closed-loop feedback information to adjust and improve its bid prices. After a robot has completed a task, it assesses and records its performance to reflect the discrepancy between the bid price and the actual cost of the task. Such performance records, with time-discounting factors, are taken into account to damp out fluctuations of bid prices. Adopting this adjustment mechanism, a task would be more likely allocated to a competent robot that submits a more accurate bid price, and hence improve the overall team performance. Simulation of task allocation of free-range automated guided vehicles serving at a container terminal is presented to demonstrate the effectiveness of the adjustment mechanism.

[1]  J. Huisman The Netherlands , 1996, The Lancet.

[2]  G. Lodewijks,et al.  Dynamic Free Range Routing for Automated Guided Vehicles , 2006, 2006 IEEE International Conference on Networking, Sensing and Control.

[3]  Lynne E. Parker,et al.  Handbook of Robotics Chapter 40 : Multiple Mobile Robot Systems , 2007 .

[4]  Iris F. A. Vis,et al.  Survey of research in the design and control of automated guided vehicle systems , 2006, Eur. J. Oper. Res..

[5]  Jonathan P. How,et al.  COORDINATION AND CONTROL OF MULTIPLE UAVs , 2002 .

[6]  Richard M. Murray,et al.  Recent Research in Cooperative Control of Multivehicle Systems , 2007 .

[7]  Han-Lim Choi,et al.  Real-Time Multi-UAV Task Assignment in Dynamic and Uncertain Environments , 2009 .

[8]  Anju Vyas Print , 2003 .

[9]  Nidhi Kalra,et al.  Hoplites: A Market-Based Framework for Planned Tight Coordination in Multirobot Teams , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[10]  Felix Duvallet,et al.  Imitation learning for task allocation , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Kenneth H. Stokoe,et al.  Proceedings of the World Congress on Engineering 2013, WCE 2013 , 2013 .

[12]  Anthony Stentz,et al.  Time-extended multi-robot coordination for domains with intra-path constraints , 2011, Auton. Robots.

[13]  Kristina Lerman,et al.  Analysis of Dynamic Task Allocation in Multi-Robot Systems , 2006, Int. J. Robotics Res..

[14]  Bernard Ghanem,et al.  Improving cost estimation in market-based coordination of a distributed sensing task , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Lynne E. Parker,et al.  Path Planning and Motion Coordination in Multiple Mobile Robot Teams , 2009 .

[16]  Maurice Pagnucco,et al.  Evaluating Sequential Single-Item Auctions for Dynamic Task Allocation , 2010, Australasian Conference on Artificial Intelligence.

[17]  Reid G. Smith,et al.  The Contract Net Protocol: High-Level Communication and Control in a Distributed Problem Solver , 1980, IEEE Transactions on Computers.

[18]  Reid G. Simmons,et al.  Learning Opportunity Costs in Multi-Robot Market Based Planners , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[19]  S. H. Choi,et al.  A Bio-inspired Intelligent Approach to Motion Planning for Mobile Robots , 2011 .

[20]  Nidhi Kalra,et al.  Market-Based Multirobot Coordination: A Survey and Analysis , 2006, Proceedings of the IEEE.