Model‐free self‐triggered control based on deep reinforcement learning for unknown nonlinear systems

This article proposes a joint learning technique for control inputs and triggering intervals of self‐triggered control nonlinear systems with unknown dynamics. First, deep reinforcement learning is introduced to the self‐triggered control system by considering both the control performance and triggering performance in the reward function. Then, the control inputs and triggering intervals are simultaneously learned by the developed deep deterministic policy gradient approach. Under this strategy, not only the desired control performance is guaranteed for unknown nonlinear systems, but also both the computation and communication occupation for the controlled system are decreased without any triggering thresholds. Finally, simulations for the cart‐pole swing‐up system are illustrated to verify the effectiveness of the proposed scheme.

[1]  Ding Wang,et al.  The intelligent critic framework for advanced optimal control , 2022, Artif. Intell. Rev..

[2]  Ding Wang,et al.  Adaptive Critic for Event-Triggered Unknown Nonlinear Optimal Tracking Design With Wastewater Treatment Applications , 2021, IEEE Transactions on Neural Networks and Learning Systems.

[3]  Lixing Yang,et al.  Robust efficient cruise control for high-speed train movement based on the self-triggered mechanism , 2021, Transportation Research Part C: Emerging Technologies.

[4]  Fei Liu,et al.  Dynamic Self-Triggered Controller Codesign for Markov Jump Systems , 2021, IEEE Transactions on Automatic Control.

[5]  E. Petriu,et al.  Model-Free Control of Finger Dynamics in Prosthetic Hand Myoelectric-based Control Systems , 2020, Studies in Informatics and Control.

[6]  Weiping Wang,et al.  Self-Triggered Consensus of Vehicle Platoon System With Time-Varying Topology , 2020, Frontiers in Neurorobotics.

[7]  S. Trimpe,et al.  Learning Event-triggered Control from Data through Joint Optimization , 2020, IFAC J. Syst. Control..

[8]  Xianwei Li,et al.  Consensus of multi-agent systems via fully distributed event-triggered control , 2020, Autom..

[9]  Kangkang Sun,et al.  Event-Triggered Robust Fuzzy Adaptive Finite-Time Control of Nonlinear Systems With Prescribed Performance , 2020, IEEE Transactions on Fuzzy Systems.

[10]  Guanghui Sun,et al.  State estimation and self-triggered control of CPSs against joint sensor and actuator attacks , 2020, Autom..

[11]  Sandra Hirche,et al.  Feedback Linearization Based on Gaussian Processes With Event-Triggered Online Learning , 2019, IEEE Transactions on Automatic Control.

[12]  Wojciech M. Czarnecki,et al.  Grandmaster level in StarCraft II using multi-agent reinforcement learning , 2019, Nature.

[13]  S. Trimpe,et al.  Event-Triggered Learning for Linear Quadratic Control , 2019, IEEE Transactions on Automatic Control.

[14]  T. Ushio,et al.  Learning Self-Triggered Controllers With Gaussian Processes , 2019, IEEE Transactions on Cybernetics.

[15]  Hwai Chyuan Ong,et al.  Effects of acids pre-treatment on the microbial fermentation process for bioethanol production from microalgae , 2019, Biotechnology for Biofuels.

[16]  Thomas Seel,et al.  Hierarchical Event-Triggered Learning for Cyclically Excited Systems With Application to Wireless Sensor Networks , 2019, IEEE Control Systems Letters.

[17]  Sebastian Trimpe,et al.  Event-triggered Learning , 2019, Autom..

[18]  Sebastian Trimpe,et al.  Deep Reinforcement Learning for Event-Triggered Control , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[19]  Paul G. Lucey,et al.  Direct evidence of surface exposed water ice in the lunar polar regions , 2018, Proceedings of the National Academy of Sciences.

[20]  Prashanth Siddhamshetty,et al.  Approximate Dynamic Programming Based Control of Proppant Concentration in Hydraulic Fracturing , 2018, Mathematics.

[21]  Demis Hassabis,et al.  Mastering the game of Go without human knowledge , 2017, Nature.

[22]  Paulo Tabuada,et al.  An introduction to event-triggered and self-triggered control , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[23]  Jun Morimoto,et al.  Robust Reinforcement Learning , 2005, Neural Computation.

[24]  Hongjiu Yang,et al.  Self-triggered MPC for nonholonomic systems with multiple constraints by adaptive transmission intervals , 2021, Autom..