Heuristics for the stochastic dynamic task-resource allocation problem with retry opportunities

This paper deals with a stochastic multi-period task-resource allocation problem. A team of agents with a set of resources is to be deployed on a multi-period mission with the goal to successfully complete as many tasks as possible. The success probability of an agent assigned to a task depends on the resources available to the agent. Unsuccessful tasks can be tried again at later periods. While the problem can in principle be solved by dynamic programming, in practice this is computationally prohibitive except for tiny problem sizes. To be able to tackle also larger problems, we propose a construction heuristic that assigns agents and resources to tasks sequentially, based on the estimated marginal utility. Based on this heuristic, we furthermore propose various Approximate Dynamic Programming approaches and an Evolutionary Algorithm. All suggested approaches are empirically compared on a number of randomly generated problem instances. We show that the construction heuristic is very fast and provides good results. For even better results, at the expense of longer computational time, Approximate Dynamic Programming seems a suitable alternative.

[1]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[2]  Georgia Perakis,et al.  Business analytics for flexible resource allocation under random emergencies , 2012 .

[3]  Darryl K. Ahner,et al.  Optimal multi-stage allocation of weapons to targets using adaptive dynamic programming , 2015, Optim. Lett..

[4]  Daniel Kuhn,et al.  Multi-resource allocation in stochastic project scheduling , 2012, Ann. Oper. Res..

[5]  Jie Chen,et al.  An Efficient Rule-Based Constructive Heuristic to Solve Dynamic Weapon-Target Assignment Problem , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[6]  Arvind Kumar,et al.  Exact and Heuristic Algorithms for the Weapon-Target Assignment Problem , 2007, Oper. Res..

[7]  Warren B. Powell,et al.  A Distributed Decision-Making Structure for Dynamic Resource Allocation Using Nonlinear Functional Approximations , 2005, Oper. Res..

[8]  D.A. Castanon,et al.  Model predictive control for dynamic unreliable resource allocation , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[9]  Hector Geffner,et al.  Heuristic Planning with Time and Resources , 2014 .

[10]  Jonathan P. How,et al.  Multi-Task Allocation and Path Planning for Cooperating UAVs , 2003 .

[11]  Warren B. Powell,et al.  Approximate Dynamic Programming for Large-Scale Resource Allocation Problems , 2006 .

[12]  Geoffrey J. Gordon,et al.  Decomposition-Based Optimal Market-Based Planning for Multi-Agent Systems with Shared Resources , 2011 .

[13]  Charles I. Nkeki,et al.  On a Dynamic Optimization Technique for Resource Allocation Problems in a Production Company , 2012 .

[14]  Warren B. Powell,et al.  Approximate Dynamic Programming - Solving the Curses of Dimensionality , 2007 .

[15]  Lu Zhen,et al.  Task assignment under uncertainty: stochastic programming and robust optimisation approaches , 2015 .

[16]  Steven R. Rasmussen,et al.  Multiple Task Assignment for a UAV Team , 2002 .

[17]  Liming Liu,et al.  Resource Allocation in Multisite Service Systems with Intersite Customer Flows , 2003, Manag. Sci..

[18]  Andreas T. Ernst,et al.  Exact Solutions to Task Allocation Problems , 2006, Manag. Sci..

[19]  Dimitris Bertsimas,et al.  Dynamic resource allocation: A flexible and tractable modeling framework , 2014, Eur. J. Oper. Res..

[20]  Warren B. Powell,et al.  An Adaptive Dynamic Programming Algorithm for the Heterogeneous Resource Allocation Problem , 2002, Transp. Sci..

[21]  Ningfei Wang,et al.  Cooperative task assignment of multiple heterogeneous unmanned aerial vehicles using a modified genetic algorithm with multi-type genes , 2013 .

[22]  Sven Koenig,et al.  K-swaps: cooperative negotiation for solving task-allocation problems , 2009, IJCAI 2009.

[23]  Nan Liu,et al.  Multi-resource Allocation Scheduling in Dynamic Environments , 2012 .

[24]  Seth D. Guikema,et al.  Resource Allocation for Homeland Defense: Dealing with the Team Effect , 2012, Decis. Anal..

[25]  Jonathan P. How,et al.  A robust approach to the UAV task assignment problem , 2008 .

[26]  Yuval Rabani,et al.  Improved Approximation Algorithms for Resource Allocation , 2002, IPCO.

[27]  Phillip R. Chandler,et al.  Dynamic network flow optimization models for air vehicle resource allocation , 2001, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[28]  Jie Chen,et al.  Evolutionary decision-makings for the dynamic weapon-target assignment problem , 2009, Science in China Series F: Information Sciences.

[29]  Mathijs de Weerdt,et al.  Introduction to planning in multiagent systems , 2009, Multiagent Grid Syst..

[30]  Michail G. Lagoudakis,et al.  The Generation of Bidding Rules for Auction-Based Robot Coordination , 2005 .

[31]  Nalan Gülpinar,et al.  Robust team decision-making under uncertainty , 2010, Int. J. Appl. Decis. Sci..

[32]  Sven Koenig,et al.  Sequential Bundle-Bid Single-Sale Auction Algorithms for Decentralized Control , 2007, IJCAI.

[33]  Warren B. Powell,et al.  The Dynamic Assignment Problem , 2004, Transp. Sci..

[34]  Benjamin Van Roy,et al.  Approximation algorithms for dynamic resource allocation , 2006, Oper. Res. Lett..

[35]  Ahti Salo,et al.  Combining a Multiattribute Value Function with an Optimization Model: An Application to Dynamic Resource Allocation for Infrastructure Maintenance , 2009, Decis. Anal..

[36]  P. M. Pardalos,et al.  Approximation and Complexity in Numerical Optimization: Continuous And Discrete Problems , 2006 .

[37]  Brian J. Lunday,et al.  Approximate dynamic programming for missile defense interceptor fire control , 2017, Eur. J. Oper. Res..

[38]  Warren B. Powell,et al.  A Stochastic Formulation of the Dynamic Assignment Problem, with an Application to Truckload Motor Carriers , 1996, Transp. Sci..

[39]  A. Tharumarajah,et al.  Survey of resource allocation methods for distributed manufacturing systems , 2001 .

[40]  Parag C. Pendharkar.  An ant colony optimization heuristic for constrained task allocation problem , 2015, J. Comput. Sci..

[41]  Warren B. Powell,et al.  Some Fixed-Point Results for the Dynamic Assignment Problem , 2003, Ann. Oper. Res..

[42]  Eitan Wacholder,et al.  A Neural Network-Based Optimization Algorithm for the Static Weapon-Target Assignment Problem , 1989, INFORMS J. Comput..