Decomposition and Mean-Field Approach to Mixed Integer Optimal Compensation Problems

Mixed integer optimal compensation deals with optimization problems with integer- and real-valued control variables to compensate disturbances in dynamic systems. The mixed integer nature of controls could lead to intractability in problems of large dimensions. To address this challenge, we introduce a decomposition method which turns the original n-dimensional optimization problem into n independent scalar problems of lot sizing form. Each of these problems can be viewed as a two-player zero-sum game, which introduces some element of conservatism. Each scalar problem is then reformulated as a shortest path one and solved through linear programming over a receding horizon, a step that mirrors a standard procedure in mixed integer programming. We apply the decomposition method to a mean-field coupled multi-agent system problem, where each agent seeks to compensate a combination of an exogenous signal and the local state average. We discuss a large population mean-field type of approximation and extend our study to opinion dynamics in social networks as a special case of interest.

[1]  Graham C. Goodwin,et al.  Finite Alphabet Control and Estimation , 2003 .

[2]  Daniel Axehill,et al.  Convex relaxations for mixed integer predictive control , 2010, Autom..

[3]  Asuman E. Ozdaglar,et al.  Opinion Fluctuations and Disagreement in Social Networks , 2010, Math. Oper. Res..

[4]  Gerhard Reinelt,et al.  Direct methods with maximal lower bound for mixed-integer optimal control problems , 2009, Math. Program..

[5]  T. Başar,et al.  Risk-sensitive mean field stochastic differential games , 2011 .

[6]  Jan H. van Schuppen,et al.  A Class of Team Problems with Discrete Action Spaces: Optimality Conditions Based on Multimodularity , 2000, SIAM J. Control. Optim..

[7]  P. Lions,et al.  Jeux à champ moyen. II – Horizon fini et contrôle optimal , 2006 .

[8]  P. Caines,et al.  Individual and mass behaviour in large population stochastic wireless power control problems: centralized and Nash equilibrium solutions , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[9]  Munther A. Dahleh,et al.  A Framework for Robust Stability of Systems Over Finite Alphabets , 2008, IEEE Transactions on Automatic Control.

[10]  Hiroshi Imai,et al.  Computational-geometric methods for polygonal approximations of a curve , 1986, Comput. Vis. Graph. Image Process..

[11]  Ravindra K. Ahuja,et al.  Network Flows: Theory, Algorithms, and Applications , 1993 .

[12]  Herbert E. Scarf,et al.  Optimal Policies for a Multi-Echelon Inventory Problem , 1960, Manag. Sci..

[13]  Frédéric Messine,et al.  Efficient upper and lower bounds for global mixed-integer optimal control , 2015, J. Glob. Optim..

[14]  Benjamin Van Roy,et al.  Oblivious Equilibrium: A Mean Field Approximation for Large-Scale Dynamic Games , 2005, NIPS.

[15]  João Pedro Hespanha,et al.  Lyapunov conditions for input-to-state stability of impulsive systems , 2008, Autom..

[16]  V. Borkar,et al.  A unified framework for hybrid control: model and optimal control theory , 1998, IEEE Trans. Autom. Control..

[17]  Laurence A. Wolsey,et al.  Production Planning by Mixed Integer Programming (Springer Series in Operations Research and Financial Engineering) , 2006 .

[18]  Hamidou Tembine,et al.  Robust Mean Field Games , 2016, Dyn. Games Appl..

[19]  Dario Bauso,et al.  Boolean-controlled systems via receding horizon and linear programing , 2009, Math. Control. Signals Syst..

[20]  Quanyan Zhu,et al.  Risk-Sensitive Mean-Field Games , 2012, IEEE Transactions on Automatic Control.

[21]  Yves Achdou,et al.  Mean Field Games: Numerical Methods for the Planning Problem , 2012, SIAM J. Control. Optim..

[22]  A. Lachapelle,et al.  COMPUTATION OF MEAN FIELD EQUILIBRIA IN ECONOMICS , 2010 .

[23]  Peter E. Caines,et al.  Large population stochastic dynamic games: closed-loop McKean-Vlasov systems and the Nash certainty equivalence principle , 2006, Commun. Inf. Syst..

[24]  Quanyan Zhu,et al.  Hybrid risk-sensitive mean-field stochastic differential games with application to molecular biology , 2011, IEEE Conference on Decision and Control and European Control Conference.

[25]  Moritz Diehl,et al.  The integer approximation error in mixed-integer optimal control , 2012, Math. Program..

[26]  Quanyan Zhu,et al.  A multi-resolution large population game framework for smart grid demand response management , 2011, International Conference on NETwork Games, Control and Optimization (NetGCooP 2011).

[27]  P. Lions,et al.  Jeux à champ moyen. I – Le cas stationnaire , 2006 .

[28]  Laurence A. Wolsey,et al.  Integer and Combinatorial Optimization , 1988, Wiley interscience series in discrete mathematics and optimization.

[29]  Yves Achdou,et al.  Mean Field Games: Numerical Methods , 2010, SIAM J. Numer. Anal..

[30]  Laurence A. Wolsey,et al.  Lot-Sizing with Constant Batches: Formulation and Valid Inequalities , 1993, Math. Oper. Res..

[31]  Ted K. Ralphs,et al.  Integer and Combinatorial Optimization , 2013 .

[32]  Laurence A. Wolsey,et al.  Production Planning by Mixed Integer Programming , 2010 .

[33]  Minyi Huang,et al.  Large-Population Cost-Coupled LQG Problems With Nonuniform Agents: Individual-Mass Behavior and Decentralized $\varepsilon$-Nash Equilibria , 2007, IEEE Transactions on Automatic Control.

[34]  Monique Dauge,et al.  Koiter Estimate Revisited , 2010 .

[35]  Hiroshi Imai,et al.  An optimal algorithm for approximating a piecewise linear function , 1986 .

[36]  Quanyan Zhu,et al.  Mixed integer optimal compensation: Decompositions and mean-field approximations , 2012, 2012 American Control Conference (ACC).

[37]  P. Lions,et al.  Mean field games , 2007 .

[38]  Stephen P. Boyd,et al.  Distributed average consensus with least-mean-square deviation , 2007, J. Parallel Distributed Comput..