An online actor/critic algorithm for event-triggered optimal control of continuous-time nonlinear systems

This paper proposes a novel optimal adaptive event-triggered control algorithm for nonlinear continuous-time systems. The goal is to reduce the controller updates, by sampling the state only when an event is triggered to maintain stability and optimality. The online algorithm is implemented based on an actor/critic neural network structure. The algorithm proposed exhibits dynamics with continuous evolutions described by ordinary differential equations and instantaneous jumps. A Lyapunov stability proof ensures that the closed-loop system is asymptotically stable.

[1]  Marios M. Polycarpou,et al.  On-line approximation control of uncertain nonlinear systems: issues with control input saturation , 2003, Proceedings of the 2003 American Control Conference, 2003..

[2]  Frank L. Lewis,et al.  Optimal Adaptive Control and Differential Games by Reinforcement Learning Principles , 2012 .

[3]  Petros A. Ioannou,et al.  Adaptive Control Tutorial (Advances in Design and Control) , 2006 .

[4]  Paulo Tabuada,et al.  Periodic event-triggered control for nonlinear systems , 2013, 52nd IEEE Conference on Decision and Control.

[5]  Paulo Tabuada,et al.  Event-Triggered Real-Time Scheduling of Stabilizing Control Tasks , 2007, IEEE Transactions on Automatic Control.

[6]  F. Lewis,et al.  Reinforcement Learning and Feedback Control: Using Natural Decision Methods to Design Optimal Adaptive Controllers , 2012, IEEE Control Systems.

[7]  João Pedro Hespanha,et al.  Lyapunov conditions for input-to-state stability of impulsive systems , 2008, Autom..

[8]  Wassim M. Haddad,et al.  Impulsive and Hybrid Dynamical Systems: Stability, Dissipativity, and Control , 2006 .

[9]  W. P. M. H. Heemels,et al.  Output-Based Event-Triggered Control With Guaranteed ${\cal L}_{\infty}$-Gain and Improved and Decentralized Event-Triggering , 2012, IEEE Transactions on Automatic Control.

[10]  Xiaofeng Wang,et al.  On event design in event-triggered feedback systems , 2011, Autom..

[11]  Michael D. Lemmon,et al.  Event-Triggered Feedback in Control, Estimation, and Optimization , 2010 .

[12]  Eloy García,et al.  Model-based event-triggered control with time-varying network delays , 2011, IEEE Conference on Decision and Control and European Control Conference.

[13]  J. Primbs,et al.  Constrained nonlinear optimal control: a converse HJB approach , 1996 .