Surrogate Optimal Control for Strategic Multi-Agent Systems

This paper studies how to design a platform to optimally control constrained multi-agent systems with a single coordinator and multiple strategic agents. In our setting, only the coordinator applies control inputs, however, it must do so based on information provided by the agents. One major challenge is that if the platform is not correctly designed then the agents may provide false information to the coordinator in order to achieve improved outcomes for themselves at the expense of the overall system efficiency. Here, we design an interaction mechanism between the agents and the coordinator such that the mechanism: ensures agents truthfully report their information, has low communication requirements, and leads to a control action that achieves efficiency by achieving a Nash equilibrium. We illustrate our proposed mechanism in a model predictive control (MPC) application involving heating, ventilation, air-conditioning (HVAC) control by a building manager of an apartment building.

[1]  Frank Kelly,et al.  Charging and rate control for elastic traffic , 1997, Eur. Trans. Telecommun..

[2]  Marios M. Polycarpou,et al.  Cooperative Control of Distributed Multi-Agent Systems , 2001 .

[3]  Jhoanna Rhodette Pedrasa,et al.  Control Synthesis for Bilevel Linear Model Predictive Control , 2016, 2018 Annual American Control Conference (ACC).

[4]  E. H. Clarke.  Multipart pricing of public goods , 1971 .

[5]  J. E. Cohen,et al.  Cooperation and self-interest: Pareto-inefficiency of Nash equilibria in finite random games. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[6]  S. Shankar Sastry,et al.  Pricing in linear-quadratic dynamic games , 2012, 2012 50th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[7]  Theodore Groves,et al.  Incentives in Teams , 1973 .

[8]  R. Neck,et al.  Conflict and cooperation in a model of stabilization policies : A differential game approach , 1987 .

[9]  Stephen J. Wright,et al.  Cooperative distributed model predictive control , 2010, Syst. Control. Lett..

[10]  Bart De Schutter,et al.  Distributed model predictive control of irrigation canals , 2009, Networks Heterog. Media.

[11]  Stephen J. Wright,et al.  Stability and optimality of distributed model predictive control , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[12]  Francesco Borrelli,et al.  A distributed predictive control approach to building temperature regulation , 2011, Proceedings of the 2011 American Control Conference.

[13]  David E. Culler,et al.  Identifying models of HVAC systems using semiparametric regression , 2012, 2012 American Control Conference (ACC).

[14]  Eduardo Camponogara,et al.  Distributed model predictive control , 2002 .

[15]  S. Reiter,et al.  Game forms with minimal message spaces , 1988 .

[16]  David E. Culler,et al.  Energy-Efficient Building HVAC Control Using Hybrid System LBMPC , 2012, ArXiv.

[17]  Demosthenis Teneketzis,et al.  A Surrogate Optimization-Based Mechanism for Resource Allocation and Routing in Networks With Strategic Agents , 2019, IEEE Transactions on Automatic Control.

[18]  Jason R. Marden,et al.  Designing games to handle coupled constraints , 2010, 49th IEEE Conference on Decision and Control (CDC).

[19]  Stephen J. Wright,et al.  Distributed MPC Strategies With Application to Power System Automatic Generation Control , 2008, IEEE Transactions on Control Systems Technology.

[20]  John N. Tsitsiklis,et al.  Efficiency of Scalar-Parameterized Mechanisms , 2008, Oper. Res..

[21]  Alberto Bemporad,et al.  Decentralized model predictive control of dynamically coupled linear systems , 2011 .

[22]  Bruce E. Hajek,et al.  VCG-Kelly Mechanisms for Allocation of Divisible Goods: Adapting VCG Mechanisms to One-Dimensional Signals , 2006, 2006 40th Annual Conference on Information Sciences and Systems.

[23]  Marcello Farina,et al.  Distributed non-cooperative MPC with neighbor-to-neighbor communication , 2011 .

[24]  Frank Kelly,et al.  Rate control for communication networks: shadow prices, proportional fairness and stability , 1998, J. Oper. Res. Soc..

[25]  William Vickrey,et al.  Counterspeculation, Auctions, And Competitive Sealed Tenders , 1961 .

[26]  John N. Tsitsiklis,et al.  Efficiency loss in a network resource allocation game: the case of elastic supply , 2004, IEEE Transactions on Automatic Control.

[27]  S. Shankar Sastry,et al.  Energy management via pricing in LQ dynamic games , 2013, 2013 American Control Conference.

[28]  Riccardo Scattolini,et al.  Model Predictive Control Schemes for Consensus in Multi-Agent Systems with Single- and Double-Integrator Dynamics , 2009, IEEE Transactions on Automatic Control.