Sampled-Data Online Feedback Equilibrium Seeking: Stability and Tracking

This paper proposes a general framework for constructing feedback controllers that drive complex dynamical systems to “efficient” steady-state (or slowly varying) operating points. Efficiency is encoded using generalized equations which can model a broad spectrum of useful objectives, such as optimality or equilibria (e.g. Nash, Wardrop, etc.) in noncooperative games. The core idea of the proposed approach is to directly implement iterative solution (or equilibrium seeking) algorithms in closed loop with physical systems. Sufficient conditions for closed-loop stability and robustness are derived; these also serve as the first closed-loop stability results for sampleddata feedback-based optimization. Numerical simulations of smart building automation and game-theoretic robotic swarm coordination support the theoretical results.

[1]  Florian Dörfler,et al.  Non-Convex Feedback Optimization With Input and Output Constraints , 2020, IEEE Control Systems Letters.

[2]  Francisco Facchinei,et al.  Real and Complex Monotone Communication Games , 2012, IEEE Transactions on Information Theory.

[3]  Ian A. Hiskens,et al.  Decentralized charging control for large populations of plug-in electric vehicles , 2010, 49th IEEE Conference on Decision and Control (CDC).

[4]  Marcello Colombino,et al.  Online Optimization as a Feedback Controller: Stability and Tracking , 2018, IEEE Transactions on Control of Network Systems.

[5]  Andrey Bernstein,et al.  Online Primal-Dual Methods With Measurement Feedback for Time-Varying Convex Optimization , 2018, IEEE Transactions on Signal Processing.

[6]  Walid Saad,et al.  Game-Theoretic Methods for the Smart Grid: An Overview of Microgrid Systems, Demand-Side Management, and Smart Grid Communications , 2012, IEEE Signal Processing Magazine.

[7]  A. R. Teelb,et al.  Formulas relating KL stability estimates of discrete-time and sampled-data nonlinear systems , 1999 .

[8]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[9]  Ranran Li,et al.  Optimal Steady-State Regulator Design for a Class of Nonlinear Systems With Arbitrary Relative Degree. , 2020, IEEE transactions on cybernetics.

[10]  Florian Dörfler,et al.  Experimental Validation of Feedback Optimization in Power Distribution Grids , 2019, ArXiv.

[11]  Dick Duffey,et al.  Power Generation , 1932, Transactions of the American Institute of Electrical Engineers.

[12]  Kartik B. Ariyur,et al.  Real-Time Optimization by Extremum-Seeking Control , 2003 .

[13]  Milos S. Stankovic,et al.  Distributed Seeking of Nash Equilibria With Applications to Mobile Sensor Networks , 2012, IEEE Transactions on Automatic Control.

[14]  Lacra Pavel,et al.  A Passivity-Based Approach to Nash Equilibrium Seeking Over Networks , 2017, IEEE Transactions on Automatic Control.

[15]  John W. Simpson-Porco,et al.  Analysis and Synthesis of Low-Gain Integral Controllers for Nonlinear Systems , 2020, IEEE Transactions on Automatic Control.

[16]  Gabriela Hug,et al.  Optimization Algorithms as Robust Feedback Controllers , 2021, Annu. Rev. Control..

[17]  R. Rockafellar,et al.  Implicit Functions and Solution Mappings , 2009 .

[18]  Liam S. P. Lawrence.  The Optimal Steady-State Control Problem , 2019 .

[19]  Allen J. Wood,et al.  Power Generation, Operation, and Control , 1984 .

[20]  Takeshi Hatanaka,et al.  An integrated design of optimization and physical dynamics for energy efficient buildings: A passivity approach , 2017, 2017 IEEE Conference on Control Technology and Applications (CCTA).

[21]  Heinz H. Bauschke,et al.  Convex Analysis and Monotone Operator Theory in Hilbert Spaces , 2011, CMS Books in Mathematics.

[22]  Manfred Morari,et al.  BRCM Matlab Toolbox: Model generation for model predictive building control , 2014, 2014 American Control Conference.

[23]  Zhong-Ping Jiang,et al.  Input-to-state stability for discrete-time nonlinear systems , 1999 .

[24]  Georgios B. Giannakis,et al.  Time-Varying Convex Optimization: Time-Structured Algorithms and Applications , 2020, Proceedings of the IEEE.

[25]  Fernando Paganini,et al.  Internet congestion control , 2002 .

[26]  Helen Durand,et al.  A tutorial review of economic model predictive control methods , 2014 .

[27]  Kevin Barraclough,et al.  I and i , 2001, BMJ : British Medical Journal.

[28]  M. Diehl,et al.  Nominal stability of real-time iteration scheme for nonlinear model predictive control , 2005 .

[29]  Eduardo Sontag,et al.  On characterizations of the input-to-state stability property , 1995 .

[30]  Marcello Colombino,et al.  Towards robustness guarantees for feedback-based optimization , 2019, 2019 IEEE 58th Conference on Decision and Control (CDC).

[31]  Gabriela Hug,et al.  Time-varying Projected Dynamical Systems with Applications to Feedback Optimization of Power Systems , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[32]  Francisco Facchinei,et al.  Generalized Nash Equilibrium Problems , 2010, Ann. Oper. Res..

[33]  Ilya Kolmanovsky,et al.  Time-distributed optimization for real-time model predictive control: Stability, robustness, and constraint satisfaction , 2020, Autom..

[34]  W. Marsden.  I and J , 2012 .

[35]  Lacra Pavel,et al.  Dynamic NE Seeking for Multi-Integrator Networked Agents With Disturbance Rejection , 2019, IEEE Transactions on Control of Network Systems.

[36]  Gorjan Alagic,et al.  #p , 2019, Quantum information & computation.

[37]  Myung Hwangbo,et al.  A stable target-tracking control for unicycle mobile robots , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[38]  Gabriela Hug,et al.  Timescale Separation in Autonomous Optimization , 2019, IEEE Transactions on Automatic Control.

[39]  Jorge Barrera,et al.  Dynamic Incentives for Congestion Control , 2015, IEEE Transactions on Automatic Control.

[40]  Yi Jiang,et al.  A novel approach for building occupancy simulation , 2011 .

[41]  Sergio Grammatico,et al.  Learning generalized Nash equilibria in multi-agent dynamical systems via extremum seeking control , 2020, Autom..

[42]  Andrey Bernstein,et al.  A Feedback-Based Regularized Primal-Dual Gradient Method for Time-Varying Nonconvex Optimization , 2018, 2018 IEEE Conference on Decision and Control (CDC).