Approximation Algorithms for Optimization of Combinatorial Dynamical Systems

We consider an optimization problem for a dynamical system whose evolution depends on a collection of binary decision variables. We develop scalable approximation algorithms with provable suboptimality bounds to provide computationally tractable solution methods even when the dimension of the system and the number of the binary variables are large. The proposed method employs a linear approximation of the objective function such that the approximate problem is defined over the feasible space of the binary decision variables, which is a discrete set. To define such a linear approximation, we propose two different variation methods: one uses continuous relaxation of the discrete space and the other uses convex combinations of the vector field and running payoff. The approximate problem is a 0-1 linear program, which can be solved by existing polynomial-time exact or approximation algorithms, and does not require the solution of the dynamical system. Furthermore, we characterize a sufficient condition ensuring the approximate solution has a provable suboptimality bound. We show that this condition can be interpreted as the concavity of the objective function or that of a reformulated objective function.

[1]  Richard M. Murray,et al.  Dynamic state estimation in distributed aircraft electric control systems via adaptive submodularity , 2013, 52nd IEEE Conference on Decision and Control.

[2]  S. Shankar Sastry,et al.  Infinitesimal interconnection variation in nonlinear networked systems , 2013, 52nd IEEE Conference on Decision and Control.

[3]  Laurence A. Wolsey,et al.  Integer and Combinatorial Optimization , 1988 .

[4]  James P. Peerenboom,et al.  Identifying, understanding, and analyzing critical infrastructure interdependencies , 2001 .

[5]  Alberto Bemporad,et al.  Control of systems integrating logic, dynamics, and constraints , 1999, Autom..

[6]  S. Shankar Sastry,et al.  Consistent Approximations for the Optimal Control of Constrained Switched Systems - Part 1: A Conceptual Algorithm , 2013, SIAM J. Control. Optim..

[7]  Tyrone L. Vincent,et al.  A generalized battery model of a collection of Thermostatically Controlled Loads for providing ancillary service , 2013, 2013 51st Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[8]  G. Dantzig Discrete-Variable Extremum Problems , 1957 .

[9]  Lawrence J. Watters Letter to the Editor - Reduction of Integer Polynomial Programming Problems to Zero-One Linear Programming Problems , 1967, Oper. Res..

[10]  Adam Wierman,et al.  Real-time deferrable load control: handling the uncertainties of renewable generation , 2013, e-Energy '13.

[11]  P. Kokotovic,et al.  Direct and adjoint sensitivity equations for parameter optimization , 1967, IEEE Transactions on Automatic Control.

[12]  Duncan S. Callaway,et al.  State Estimation and Control of Electric Loads to Manage Real-Time Energy Imbalance , 2013, IEEE Transactions on Power Systems.

[13]  Satoru Iwata,et al.  A combinatorial strongly polynomial algorithm for minimizing submodular functions , 2001, JACM.

[14]  Gagan Goel,et al.  Approximability of Combinatorial Problems with Multi-agent Submodular Cost Functions , 2009, FOCS.

[15]  Lawrence J. Watters,et al.  REDUCTION OF INTEGER POLYNOMIAL PROGRAMMING PROBLEMS TO ZERO-ONE LINEAR PROGRAMMING PROBLEMS , 2016 .

[16]  Andreas Krause,et al.  Near-Optimal Sensor Placements in Gaussian Processes: Theory, Efficient Algorithms and Empirical Studies , 2008, J. Mach. Learn. Res..

[17]  V. Borkar,et al.  A unified framework for hybrid control: model and optimal control theory , 1998, IEEE Trans. Autom. Control..

[18]  Ellis Horowitz,et al.  Computing Partitions with Applications to the Knapsack Problem , 1974, JACM.

[19]  Elijah Polak,et al.  Optimization: Algorithms and Consistent Approximations , 1997 .

[20]  Panos J. Antsaklis,et al.  Optimal control of switched systems based on parameterization of the switching instants , 2004, IEEE Transactions on Automatic Control.

[21]  R. Malhamé,et al.  Electric load model synthesis by diffusion approximation of a high-order hybrid-state stochastic system , 1985 .

[22]  Jan Vondrák,et al.  Symmetry and Approximability of Submodular Maximization Problems , 2009, 2009 50th Annual IEEE Symposium on Foundations of Computer Science.

[23]  Jure Leskovec,et al.  Inferring Networks of Diffusion and Influence , 2012, ACM Trans. Knowl. Discov. Data.

[24]  Alexander Schrijver,et al.  A Combinatorial Algorithm Minimizing Submodular Functions in Strongly Polynomial Time , 2000, J. Comb. Theory, Ser. B.

[25]  Radha Poovendran,et al.  A Supermodular Optimization Framework for Leader Selection Under Link Noise in Linear Multi-Agent Systems , 2012, IEEE Transactions on Automatic Control.

[26]  Sergio Marinetti,et al.  Experimental analysis of a new method for overfeeding multiple evaporators in refrigeration systems , 2014 .

[27]  Uri M. Ascher,et al.  Computer methods for ordinary differential equations and differential-algebraic equations , 1998 .

[28]  Jean B. Lasserre,et al.  An Explicit Equivalent Positive Semidefinite Program for Nonlinear 0-1 Programs , 2002, SIAM J. Optim..

[29]  M. L. Fisher,et al.  An analysis of approximations for maximizing submodular set functions—I , 1978, Math. Program..

[30]  Franco Blanchini,et al.  Convexity of the cost functional in an optimal control problem for a class of positive switched systems , 2014, Autom..

[31]  Hanif D. Sherali,et al.  A Hierarchy of Relaxations Between the Continuous and Convex Hull Representations for Zero-One Programming Problems , 1990, SIAM J. Discret. Math..

[32]  Saïd Hanafi,et al.  The Multidimensional 0-1 Knapsack Problem—Bounds and Computational Aspects , 2005, Ann. Oper. Res..

[33]  Manfred Morari,et al.  Towards a standardized building assessment for demand response , 2013, 52nd IEEE Conference on Decision and Control.

[34]  Deeparnab Chakrabarty,et al.  Knapsack Problems , 2008 .

[35]  Ailsa H. Land,et al.  An Automatic Method of Solving Discrete Programming Problems , 1960 .

[36]  Laurence A. Wolsey,et al.  Integer and Combinatorial Optimization , 1988, Wiley interscience series in discrete mathematics and optimization.

[37]  Egon Balas,et al.  An Algorithm for Large Zero-One Knapsack Problems , 1980, Oper. Res..

[38]  Warren P. Adams,et al.  A hierarchy of relaxation between the continuous and convex hull representations , 1990 .

[39]  Alberto L. Sangiovanni-Vincentelli,et al.  Model predictive control approach to online computation of demand-side flexibility of commercial buildings HVAC systems for Supply Following , 2014, 2014 American Control Conference.

[40]  Alexander Schrijver,et al.  Cones of Matrices and Set-Functions and 0-1 Optimization , 1991, SIAM J. Optim..

[41]  M. Bardi,et al.  Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations , 1997 .

[42]  Fred W. Glover,et al.  Technical Note - Converting the 0-1 Polynomial Programming Problem to a 0-1 Linear Program , 1974, Oper. Res..

[43]  R. C. Sonderegger Dynamic models of house heating based on equivalent thermal parameters , 1978 .

[44]  Pierre Hansen,et al.  Roof duality, complementation and persistency in quadratic 0–1 optimization , 1984, Math. Program..

[45]  Kien Ming Ng,et al.  An algorithm for nonlinear optimization problems with binary variables , 2010, Comput. Optim. Appl..

[46]  Jeff A. Bilmes,et al.  Approximation Bounds for Inference using Cooperative Cuts , 2011, ICML.

[47]  Ram Rajagopal,et al.  A method for automatically scheduling notified deferrable loads , 2013, 2013 American Control Conference.

[48]  Andreas Krause,et al.  Simultaneous Optimization of Sensor Placements and Balanced Schedules , 2011, IEEE Transactions on Automatic Control.

[49]  George B. Dantzig,et al.  Linear programming and extensions , 1965 .

[50]  Paolo Toth,et al.  Dynamic programming algorithms for the Zero-One Knapsack Problem , 1980, Computing.

[51]  Martin Grötschel,et al.  The ellipsoid method and its consequences in combinatorial optimization , 1981, Comb..

[52]  Munther A. Dahleh,et al.  Robust and Optimal Consumption Policies for Deadline-Constrained Deferrable Loads , 2014, IEEE Transactions on Smart Grid.

[53]  John Lygeros,et al.  On Submodularity and Controllability in Complex Dynamical Networks , 2014, IEEE Transactions on Control of Network Systems.

[54]  Jörg Raisch,et al.  Convex Control Systems and Convex Optimal Control Problems With Constraints , 2008, IEEE Transactions on Automatic Control.

[55]  Oscar H. Ibarra,et al.  Fast Approximation Algorithms for the Knapsack and Sum of Subset Problems , 1975, JACM.

[56]  Satoru Iwata,et al.  Submodular Function Minimization under Covering Constraints , 2009, 2009 50th Annual IEEE Symposium on Foundations of Computer Science.

[57]  Kenneth Steiglitz,et al.  Combinatorial Optimization: Algorithms and Complexity , 1981 .