A Dynamic Programming Approach for the Decentralized Control of Discrete Optimizers with Quadratic Utilities and Shared Constraint

This paper addresses the problem of controlling a large set of agents, each with a quadratic utility function depending on individual combinatorial choices, and all sharing an affine constraint on available resources. Such a problem is formulated as an integer mono-constrained bounded quadratic knapsack problem. Differently from the centralized approaches typically proposed in the related literature, we present a new decentralized algorithm to solve the problem approximately in polynomial time by decomposing it into a finite series of sub-problems. We assume a minimal communication structure through the presence of a central coordinator that ensures the information exchange between agents. The proposed solution relies on a decentralized control algorithm that combines discrete dynamic programming with additive decomposition and value functions approximation. The optimality and complexity of the presented strategy are discussed, highlighting that the algorithm constitutes a fully polynomial approximation scheme. Numerical experiments are presented to show the effectiveness of the approach in the optimal resolution of large-scale instances.

[1]  Panos M. Pardalos,et al.  Approximate dynamic programming: solving the curses of dimensionality , 2009, Optim. Methods Softw..

[2]  David Pisinger,et al.  The quadratic knapsack problem - a survey , 2007, Discret. Appl. Math..

[3]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[4]  MengChu Zhou,et al.  A Polynomial Dynamic Programming Algorithm for Crude Oil Transportation Planning , 2012, IEEE Transactions on Automation Science and Engineering.

[5]  Deeparnab Chakrabarty,et al.  Knapsack Problems , 2008 .

[6]  S. Kataoka,et al.  DP-BASED ALGORITHM AND FPTAS FOR THE KNAPSACK SHARING AND RELATED PROBLEMS , 2019, Journal of the Operations Research Society of Japan.

[7]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[8]  Dimitris Bertsimas,et al.  An Approximate Dynamic Programming Approach to Multidimensional Knapsack Problems , 2002, Manag. Sci..

[9]  M. Sniedovich Dynamic programming : foundations and principles , 2011 .

[10]  Peter B. Luh,et al.  Group Elevator Scheduling With Advance Information for Normal and Emergency Modes , 2008, IEEE Transactions on Automation Science and Engineering.

[11]  Adam N. Letchford,et al.  A Dynamic Programming Heuristic for the Quadratic Knapsack Problem , 2014, INFORMS J. Comput..

[12]  Claudio Talarico,et al.  Real-Time Distance Evaluation System for Wireless Localization , 2020, IEEE Transactions on Circuits and Systems I: Regular Papers.

[13]  Corrado Mencar,et al.  Data Stream Classification by Dynamic Incremental Semi-Supervised Fuzzy Clustering , 2019, Int. J. Artif. Intell. Tools.

[14]  Alessandro Bianchi,et al.  An ASM-based characterisation of starvation-free systems , 2017, Int. J. Parallel Emergent Distributed Syst..

[15]  Francesco Facchini,et al.  Pallet Picking Strategy in Food Collecting Center , 2018, Applied Sciences.

[16]  Neil Genzlinger A. and Q , 2006 .

[17]  Gerhard J. Woeginger,et al.  The quadratic 0-1 knapsack problem with series-parallel support , 2002, Oper. Res. Lett..

[18]  Luigi Piroddi,et al.  Energy Management of a Building Cooling System With Thermal Storage: An Approximate Dynamic Programming Solution , 2017, IEEE Transactions on Automation Science and Engineering.

[19]  Mariagrazia Dotoli,et al.  A decentralized control strategy for energy retrofit planning of large-scale street lighting systems using dynamic programming , 2017, 2017 13th IEEE Conference on Automation Science and Engineering (CASE).

[20]  Hans Kellerer,et al.  Fully Polynomial Approximation Schemes for a Symmetric Quadratic Knapsack Problem and its Scheduling Applications , 2010, Algorithmica.