Event-triggered Pulse Control with Model Learning (if Necessary)

In networked control systems, communication is a shared and therefore scarce resource. Event-triggered control (ETC) can achieve high performance control with a significantly reduced amount of samples compared to classical, periodic control schemes. However, ETC methods usually rely on the availability of an accurate dynamics model, which is oftentimes not readily available. In this paper, we propose a novel event-triggered pulse control strategy that learns dynamics models if necessary. In addition to adapting to changing dynamics, the method also represents a suitable replacement for the integral part typically used in periodic control.

[1]  R. Bellman,et al.  On the “bang-bang” control problem , 1956 .

[2]  W. Hoeffding Probability Inequalities for sums of Bounded Random Variables , 1963 .

[3]  John T. Wen,et al.  An algorithm for obtaining bang-bang control laws , 1987 .

[4]  Karl Johan Åström,et al.  PID Controllers: Theory, Design, and Tuning , 1995 .

[5]  C. Yalçın Kaya,et al.  Computations and time-optimal controls , 1996 .

[6]  Karl-Erik Årzén,et al.  A simple event-based PID controller , 1999 .

[7]  Tore Hägglund,et al.  Advanced PID Control , 2005 .

[8]  Karl Johan Åström,et al.  On limit cycles in event-based control systems , 2007, 2007 46th IEEE Conference on Decision and Control.

[9]  Karl Henrik Johansson,et al.  Event-triggered strategies for industrial control over wireless networks , 2008, WICON.

[10]  Anton Cervin,et al.  Sporadic event-based control of first-order linear stochastic systems , 2008, Autom..

[11]  Nicolas Marchand,et al.  Further results on event-based PID controller , 2009, 2009 European Control Conference (ECC).

[12]  Tongwen Chen,et al.  Optimal Sampling and Performance Comparison of Periodic and Event Based Impulse Control , 2012, IEEE Transactions on Automatic Control.

[13]  Paulo Tabuada,et al.  An introduction to event-triggered and self-triggered control , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[14]  Haibo He,et al.  Event-triggered reinforcement learning approach for unknown nonlinear continuous-time system , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[15]  Christian Stöcker,et al.  Event-Based Control , 2014 .

[16]  Marek Miskowicz,et al.  Event-Based Control and Signal Processing , 2015 .

[17]  Kyriakos G. Vamvoudakis,et al.  Model-free event-triggered control algorithm for continuous-time linear systems with optimal performance , 2018, Autom..

[18]  Sebastian Trimpe,et al.  Event-Triggered Learning for Resource-Efficient Networked Control , 2018, 2018 Annual American Control Conference (ACC).

[19]  Antonio Visioli Event-based PID control , 2018, 2018 IEEE 16th World Symposium on Applied Machine Intelligence and Informatics (SAMI).

[20]  Sebastian Trimpe,et al.  Deep Reinforcement Learning for Event-Triggered Control , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[21]  Derong Liu,et al.  Event-Triggered Optimal Neuro-Controller Design With Reinforcement Learning for Unknown Nonlinear Systems , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[22]  Sebastian Trimpe,et al.  Event-triggered Learning , 2019, Autom..