Near-optimal control of nonlinear dynamical systems: A brief survey

Abstract For nonlinear dynamical systems, an optimal control problem generally requires solving a partial differential equation called the Hamilton–Jacobi–Bellman equation, the analytical solution of which generally cannot be obtained. However, the demand for optimal control keeps increasing, with the goal to save energy, reduce transient time, minimize error accumulation, etc. Consequently, methods were reported to approximately solve the problem leading to the so-called near-optimal control, although their technical details differ. This research direction has experienced great progress in recent years but a timely review of it is still missing. This paper serves as a brief survey for existing methods in this research direction.

[1]  Frank L. Lewis,et al.  Optimal and Autonomous Control Using Reinforcement Learning: A Survey , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[2]  Minyue Fu,et al.  Linear Quadratic Regulation and Stabilization of Discrete-Time Systems With Delay and Multiplicative Noise , 2015, IEEE Transactions on Automatic Control.

[3]  Jooyoung Park,et al.  Universal Approximation Using Radial-Basis-Function Networks , 1991, Neural Computation.

[4]  Haibo He,et al.  Intelligent Critic Control With Disturbance Attenuation for Affine Dynamics Including an Application to a Microgrid System , 2017, IEEE Transactions on Industrial Electronics.

[5]  Frank L. Lewis,et al.  Reinforcement learning and optimal adaptive control: An overview and implementation examples , 2012, Annu. Rev. Control..

[6]  Zheng Yan,et al.  Robust Model Predictive Control of Nonlinear Systems With Unmodeled Dynamics and Bounded Uncertainties Based on Neural Networks , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[7]  S. Jagannathan,et al.  Optimal control of affine nonlinear continuous-time systems using an online Hamilton-Jacobi-Isaacs formulation , 2010, 49th IEEE Conference on Decision and Control (CDC).

[8]  Jinyu Wen,et al.  Adaptive Learning in Tracking Control Based on the Dual Critic Network Design , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[9]  R. Bellman Dynamic programming. , 1957, Science.

[10]  Frank Allgöwer,et al.  Discrete-time Incremental ISS: A framework for Robust NMPC , 2013, 2013 European Control Conference (ECC).

[11]  Xin Zhang,et al.  Data-Driven Robust Approximate Optimal Tracking Control for Unknown General Nonlinear Systems Using Adaptive Dynamic Programming Method , 2011, IEEE Transactions on Neural Networks.

[12]  Haibo He,et al.  Neuro-Optimal Tracking Control for Continuous Stirred Tank Reactor With Input Constraints , 2019, IEEE Transactions on Industrial Informatics.

[13]  Dong Zhe,et al.  Networked nonlinear model predictive control of the ball and beam system , 2008, 2008 27th Chinese Control Conference.

[14]  Shaocheng Tong,et al.  Fuzzy Approximation-Based Adaptive Backstepping Optimal Control for a Class of Nonlinear Discrete-Time Systems With Dead-Zone , 2016, IEEE Transactions on Fuzzy Systems.

[15]  Sarangapani Jagannathan,et al.  Optimal control of unknown affine nonlinear discrete-time systems using offline-trained neural networks with proof of convergence , 2009, Neural Networks.

[16]  Wei Kang,et al.  Mitigating the curse of dimensionality: sparse grid characteristics method for optimal feedback control and HJB equations , 2015, Computational Optimization and Applications.

[17]  Haibo He,et al.  Near-Optimal Tracking Control of Mobile Robots Via Receding-Horizon Dual Heuristic Programming , 2016, IEEE Transactions on Cybernetics.

[18]  Michael Fairbank,et al.  Simple and Fast Calculation of the Second-Order Gradients for Globalized Dual Heuristic Dynamic Programming in Neural Networks , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[19]  Andrzej M. Trzynadlowski,et al.  Robust Nonlinear Predictive Controller for Permanent-Magnet Synchronous Motors With an Optimized Cost Function , 2012, IEEE Transactions on Industrial Electronics.

[20]  Huiping Li,et al.  Robust Distributed Model Predictive Control of Constrained Continuous-Time Nonlinear Systems: A Robustness Constraint Approach , 2014, IEEE Transactions on Automatic Control.

[21]  Shuai Li,et al.  Adaptive Near-Optimal Control of Uncertain Systems With Application to Underactuated Surface Vessels , 2018, IEEE Transactions on Control Systems Technology.

[22]  Frank L. Lewis,et al.  Discrete-Time Nonlinear HJB Solution Using Approximate Dynamic Programming: Convergence Proof , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[23]  Wei-Song Lin,et al.  Adaptive critic motion control design of autonomous wheeled mobile robot by dual heuristic programming , 2008, Autom..

[24]  John V. Ringwood,et al.  Improving the Computational Performance of Nonlinear Pseudospectral Control of Wave Energy Converters , 2018, IEEE Transactions on Sustainable Energy.

[25]  Huaguang Zhang,et al.  A Novel Infinite-Time Optimal Tracking Control Scheme for a Class of Discrete-Time Nonlinear Systems via the Greedy HDP Iteration Algorithm , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[26]  Renquan Lu,et al.  Trajectory-Tracking Control of Mobile Robot Systems Incorporating Neural-Dynamic Optimized Model Predictive Approach , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[27]  Thomas Stastny,et al.  Robust and Adaptive Nonlinear Model Predictive Controller for Unsteady and Highly Nonlinear Unmanned Aircraft , 2015, IEEE Transactions on Control Systems Technology.

[28]  Brett Ninness,et al.  Nonlinear model predictive control of an inverted pendulum , 2009, 2009 American Control Conference.

[29]  Guang-Ren Duan,et al.  Linear quadratic regulation for linear time-varying systems with multiple input delays part II: continuous-time case , 2006, 2005 International Conference on Control and Automation.

[30]  Haibo He,et al.  Air-Breathing Hypersonic Vehicle Tracking Control Based on Adaptive Dynamic Programming , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[31]  Jennie Si,et al.  A New Powered Lower Limb Prosthesis Control Framework Based on Adaptive Dynamic Programming , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[32]  M. Diehl,et al.  Fast reduced multiple shooting methods for nonlinear model predictive control , 2007 .

[33]  Hung Manh La,et al.  A Distributed Control Framework of Multiple Unmanned Aerial Vehicles for Dynamic Wildfire Tracking , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[34]  Jun Wang,et al.  Nonlinear Model Predictive Control Based on Collective Neurodynamic Optimization , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[35]  Mayuresh V. Kothare,et al.  Efficient scheduled stabilizing output feedback model predictive control for constrained nonlinear systems , 2004, IEEE Transactions on Automatic Control.

[36]  Kalmanje Krishnakumar,et al.  A sparse collocation method for solving time-dependent HJB equations using multivariate B-splines , 2014, Autom..

[37]  Soheil Ganjefar,et al.  Modified homotopy perturbation method for optimal control problems using the Padé approximant , 2016 .

[38]  Mark Cannon,et al.  Efficient nonlinear model predictive control algorithms , 2004, Annu. Rev. Control..

[39]  Ying Zhang,et al.  Adaptive output control of nonlinear systems with uncertain dead-zone nonlinearity , 2006, IEEE Transactions on Automatic Control.

[40]  Toshiyuki Ohtsuka,et al.  A continuation/GMRES method for fast computation of nonlinear receding horizon control , 2004, Autom..

[41]  Zhong-Ping Jiang,et al.  Global Adaptive Dynamic Programming for Continuous-Time Nonlinear Systems , 2013, IEEE Transactions on Automatic Control.

[42]  Haibo He,et al.  Adaptive Critic Nonlinear Robust Control: A Survey , 2017, IEEE Transactions on Cybernetics.

[43]  Calin Belta,et al.  Experimental Validation of Linear and Nonlinear MPC on an Articulated Unmanned Ground Vehicle , 2018, IEEE/ASME Transactions on Mechatronics.

[44]  Frank L. Lewis,et al.  Optimal Control , 1986 .

[45]  Kyriakos G. Vamvoudakis,et al.  Online Optimal Operation of Parallel Voltage-Source Inverters Using Partial Information , 2017, IEEE Transactions on Industrial Electronics.

[46]  Derong Liu,et al.  Generalized Receding Horizon Control of Fuzzy Systems Based on Numerical Optimization Algorithm , 2009, IEEE Transactions on Fuzzy Systems.

[47]  Derong Liu,et al.  An iterative ϵ-optimal control scheme for a class of discrete-time nonlinear systems with unfixed initial state , 2012, Neural Networks.

[48]  Nasser L. Azad,et al.  A Nonlinear Model Predictive Controller With Multiagent Online Optimizer for Automotive Cold-Start Hydrocarbon Emission Reduction , 2016, IEEE Transactions on Vehicular Technology.

[49]  Xie Yunxiang,et al.  Three-phase four-leg active power filter based on nonlinear optimal predictive control , 2008, 2008 27th Chinese Control Conference.

[50]  J. Karl Hedrick,et al.  Linear Tracking for a Fixed-Wing UAV Using Nonlinear Model Predictive Control , 2009, IEEE Transactions on Control Systems Technology.

[51]  Haibo He,et al.  Adaptive Event-Triggered Control Based on Heuristic Dynamic Programming for Nonlinear Discrete-Time Systems , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[52]  Haibo He,et al.  GrDHP: A General Utility Function Representation for Dual Heuristic Dynamic Programming , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[53]  G. Saridis,et al.  Approximate Solutions to the Time-Invariant Hamilton–Jacobi–Bellman Equation , 1998 .

[54]  Xun Gong,et al.  Fast Nonlinear Model Predictive Control on FPGA Using Particle Swarm Optimization , 2016, IEEE Transactions on Industrial Electronics.

[55]  John V. Ringwood,et al.  Receding Horizon Pseudospectral Control for Energy Maximization With Application to Wave Energy Devices , 2017, IEEE Transactions on Control Systems Technology.

[56]  Derong Liu,et al.  Adaptive Dynamic Programming for Optimal Tracking Control of Unknown Nonlinear Systems With Application to Coal Gasification , 2014, IEEE Transactions on Automation Science and Engineering.

[57]  Tingwen Huang,et al.  Model-Free Optimal Tracking Control via Critic-Only Q-Learning , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[58]  B. Anderson,et al.  Optimal control: linear quadratic methods , 1990 .

[59]  Derong Liu,et al.  Neural-Network-Based Optimal Control for a Class of Unknown Discrete-Time Nonlinear Systems Using Globalized Dual Heuristic Programming , 2012, IEEE Transactions on Automation Science and Engineering.

[60]  Leopoldo G. Franquelo,et al.  Model Predictive Control: A Review of Its Applications in Power Electronics , 2014, IEEE Industrial Electronics Magazine.

[61]  William W. Hager,et al.  Pseudospectral methods for solving infinite-horizon optimal control problems , 2011, Autom..

[62]  Frank L. Lewis,et al.  Linear Quadratic Tracking Control of Partially-Unknown Continuous-Time Systems Using Reinforcement Learning , 2014, IEEE Transactions on Automatic Control.

[63]  Derong Liu,et al.  Neural-network-based robust optimal control design for a class of uncertain nonlinear systems via adaptive dynamic programming , 2014, Inf. Sci..

[64]  Wei Xing Zheng,et al.  Composite predictive flight control for airbreathing hypersonic vehicles , 2014, Int. J. Control.

[65]  Ali Heydari,et al.  Optimal Switching of DC–DC Power Converters Using Approximate Dynamic Programming , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[66]  Jun Wang,et al.  Model Predictive Control of Unknown Nonlinear Dynamical Systems Based on Recurrent Neural Networks , 2012, IEEE Transactions on Industrial Electronics.

[67]  Jinghao Zhu A feedback optimal control by Hamilton-Jacobi-Bellman equation , 2017, Eur. J. Control.

[68]  Frank L. Lewis,et al.  Optimal Output-Feedback Control of Unknown Continuous-Time Linear Systems Using Off-policy Reinforcement Learning , 2016, IEEE Transactions on Cybernetics.

[69]  Toufik Rekioua,et al.  Real time simulation of nonlinear generalized predictive control for wind energy conversion system with nonlinear observer. , 2014, ISA transactions.

[70]  Qinglai Wei,et al.  Optimal control of unknown nonaffine nonlinear discrete-time systems based on adaptive dynamic programming , 2012, Autom..

[71]  Sergio Salazar,et al.  Adaptive consensus algorithms for real‐time operation of multi‐agent systems affected by switching network events , 2017 .

[72]  Zongquan Deng,et al.  Reinforcement Learning Neural Network-Based Adaptive Control for State and Input Time-Delayed Wheeled Mobile Robots , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[73]  Rachid Errouissi,et al.  Nonlinear predictive controller for a permanent magnet synchronous motor drive , 2010, Math. Comput. Simul..

[74]  Liqun Chen,et al.  Optimal control of attitude for coupled-rigid-body spacecraft via Chebyshev-Gauss pseudospectral method , 2017 .

[75]  Ahmad Fakharian,et al.  Solving the Hamilton–Jacobi–Bellman equation using Adomian decomposition method , 2010, Int. J. Comput. Math..

[76]  Demin Xu,et al.  Robust self-triggered min-max model predictive control for discrete-time nonlinear systems , 2018, Autom..

[77]  Wei Xing Zheng,et al.  Offset-Free Nonlinear MPC for Mismatched Disturbance Attenuation With Application to a Static Var Compensator , 2014, IEEE Transactions on Circuits and Systems II: Express Briefs.

[78]  Huaguang Zhang,et al.  Optimal Tracking Control for a Class of Nonlinear Discrete-Time Systems With Time Delays Based on Heuristic Dynamic Programming , 2011, IEEE Transactions on Neural Networks.

[79]  Wen-Hua Chen,et al.  Tracking control of small-scale helicopters using explicit nonlinear MPC augmented with disturbance observers , 2012 .

[80]  Shuai Li,et al.  Time-Scale Expansion-Based Approximated Optimal Control for Underactuated Systems Using Projection Neural Networks , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[81]  Tao Feng,et al.  Distributed Optimal Consensus Control for Nonlinear Multiagent System With Unknown Dynamic , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[82]  Weihua Sheng,et al.  Multirobot Cooperative Learning for Predator Avoidance , 2015, IEEE Transactions on Control Systems Technology.

[83]  Chenguang Yang,et al.  Neural Networks Enhanced Adaptive Admittance Control of Optimized Robot–Environment Interaction , 2019, IEEE Transactions on Cybernetics.

[84]  F.L. Lewis,et al.  Reinforcement learning and adaptive dynamic programming for feedback control , 2009, IEEE Circuits and Systems Magazine.

[85]  Shengbo Eben Li,et al.  A Unified Pseudospectral Computational Framework for Optimal Control of Road Vehicles , 2015, IEEE/ASME Transactions on Mechatronics.

[86]  Haibo He,et al.  Gr-GDHP: A New Architecture for Globalized Dual Heuristic Dynamic Programming , 2017, IEEE Transactions on Cybernetics.

[87]  David Q. Mayne,et al.  Model predictive control: Recent developments and future promise , 2014, Autom..

[88]  Haibo He,et al.  Kernel-Based Approximate Dynamic Programming for Real-Time Online Learning Control: An Experimental Study , 2014, IEEE Transactions on Control Systems Technology.

[89]  Ali Mesbah,et al.  Stochastic model predictive control with active uncertainty learning: A Survey on dual control , 2017, Annu. Rev. Control..

[90]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Suboptimal Control: A Survey from ADP to MPC , 2005, Eur. J. Control.

[91]  Andrzej M. Trzynadlowski,et al.  Robust Cascaded Nonlinear Predictive Control of a Permanent Magnet Synchronous Motor With Antiwindup Compensator , 2012, IEEE Transactions on Industrial Electronics.

[92]  Antonella Ferrara,et al.  Robust Model Predictive Control With Integral Sliding Mode in Continuous-Time Sampled-Data Nonlinear Systems , 2011, IEEE Transactions on Automatic Control.

[93]  Haibo He,et al.  A three-network architecture for on-line learning and optimization based on adaptive dynamic programming , 2012, Neurocomputing.

[94]  Derong Liu,et al.  On Mixed Data and Event Driven Design for Adaptive-Critic-Based Nonlinear $H_{\infty}$ Control , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[95]  Ahmed Al-Durra,et al.  Design and Implementation of a Nonlinear PI Predictive Controller for a Grid-Tied Photovoltaic Inverter , 2017, IEEE Transactions on Industrial Electronics.

[96]  Jan Swevers,et al.  Experimental validation of nonlinear MPC on an overhead crane using automatic code generation , 2012, 2012 American Control Conference (ACC).

[97]  Young-Bae Kim,et al.  Improved optimal sliding mode control for a non-linear vehicle active suspension system , 2017 .

[98]  David Q. Mayne,et al.  Constrained model predictive control: Stability and optimality , 2000, Autom..

[99]  Shuai Li,et al.  Neural Network-Based Model-Free Adaptive Near-Optimal Tracking Control for a Class of Nonlinear Systems , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[100]  Hyondong Oh,et al.  Coordinated Trajectory Planning for Efficient Communication Relay Using Multiple UAVs , 2013 .

[101]  Jing Sun,et al.  Model Predictive Control for a Full Bridge DC/DC Converter , 2012, IEEE Transactions on Control Systems Technology.

[102]  William W. Hager,et al.  A unified framework for the numerical solution of optimal control problems using pseudospectral methods , 2010, Autom..

[103]  Alessandro Astolfi,et al.  Dynamic Approximate Solutions of the HJ Inequality and of the HJB Equation for Input-Affine Nonlinear Systems , 2012, IEEE Transactions on Automatic Control.

[104]  Changyin Sun,et al.  An Event-Triggered Approach for Load Frequency Control With Supplementary ADP , 2017, IEEE Transactions on Power Systems.

[105]  Hamid Reza Marzban,et al.  A composite pseudospectral method for optimal control problems with piecewise smooth solutions , 2017, J. Frankl. Inst..

[106]  Haijun Peng,et al.  An hp symplectic pseudospectral method for nonlinear optimal control , 2017, Commun. Nonlinear Sci. Numer. Simul..

[107]  Haibo He,et al.  An Event-Triggered ADP Control Approach for Continuous-Time System With Unknown Internal States , 2017, IEEE Transactions on Cybernetics.

[108]  Haibo He,et al.  Model-Free Dual Heuristic Dynamic Programming , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[109]  Shuai Li,et al.  A dynamic neural controller for adaptive optimal control of permanent magnet DC motors , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[110]  Sohrab Effati,et al.  An approximate-analytical solution for the Hamilton–Jacobi–Bellman equation via homotopy perturbation method , 2012 .

[111]  W. Hager,et al.  An hp‐adaptive pseudospectral method for solving optimal control problems , 2011 .

[112]  H. Arioui,et al.  Cascaded predictive controller design for speed control and load torque rejection of induction motor , 2008, 2008 American Control Conference.

[113]  Sarangapani Jagannathan,et al.  Online optimal control of nonlinear discrete-time systems using approximate dynamic programming , 2011 .

[114]  Jiming Chen,et al.  Cooperative and Active Sensing in Mobile Sensor Networks for Scalar Field Mapping , 2015, IEEE Trans. Syst. Man Cybern. Syst..

[115]  Jun Wang,et al.  Model Predictive Control of Nonlinear Systems With Unmodeled Dynamics Based on Feedforward and Recurrent Neural Networks , 2012, IEEE Transactions on Industrial Informatics.

[116]  Frank L. Lewis,et al.  2009 Special Issue: Neural network approach to continuous-time direct adaptive optimal control for partially unknown nonlinear systems , 2009 .

[117]  Bin Wang,et al.  Dual Heuristic dynamic Programming for nonlinear discrete-time uncertain systems with state delay , 2014, Neurocomputing.

[118]  Derong Liu,et al.  Output Tracking Control Based on Adaptive Dynamic Programming With Multistep Policy Evaluation , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[119]  Michael Fairbank,et al.  An Equivalence Between Adaptive Dynamic Programming With a Critic and Backpropagation Through Time , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[120]  Wen-Hua Chen,et al.  Closed-form nonlinear MPC for multivariable nonlinear systems with different relative degree , 2003, Proceedings of the 2003 American Control Conference, 2003..

[121]  Huaguang Zhang,et al.  Adaptive Dynamic Programming: An Introduction , 2009, IEEE Computational Intelligence Magazine.

[122]  Dongbin Zhao,et al.  Model-Free Optimal Control for Affine Nonlinear Systems With Convergence Analysis , 2015, IEEE Transactions on Automation Science and Engineering.

[123]  Jennie Si,et al.  Online learning control by association and reinforcement. , 2001, IEEE transactions on neural networks.

[124]  Ahmed Al-Durra,et al.  Experimental Validation of a Robust Continuous Nonlinear Model Predictive Control Based Grid-Interlinked Photovoltaic Inverter , 2016, IEEE Transactions on Industrial Electronics.

[125]  Huaguang Zhang,et al.  Neural-Network-Based Constrained Optimal Control Scheme for Discrete-Time Switched Nonlinear System Using Dual Heuristic Programming , 2014, IEEE Transactions on Automation Science and Engineering.

[126]  Gary G. Yen,et al.  Improving the performance of globalized dual heuristic programming for fault tolerant control through an online learning supervisor , 2005, IEEE Transactions on Automation Science and Engineering.

[127]  Thang Nguyen,et al.  Formation Control and Obstacle Avoidance of Multiple Rectangular Agents With Limited Communication Ranges , 2017, IEEE Transactions on Control of Network Systems.

[128]  Mohd Azlan Hussain,et al.  Control of polystyrene batch reactors using neural network based model predictive control (NNMPC): An experimental investigation , 2011 .

[129]  Robert Prucka,et al.  An Economic Nonlinear Model Predictive Control Strategy for SI Engines: Model-Based Design and Real-Time Experimental Validation , 2019, IEEE Transactions on Control Systems Technology.

[130]  Iakovos Michailidis,et al.  Adaptive Optimal Control for Large-Scale Nonlinear Systems , 2017, IEEE Transactions on Automatic Control.

[131]  Yue Chen,et al.  On infinite-time nonlinear quadratic optimal control , 2004, Syst. Control. Lett..

[132]  Shaocheng Tong,et al.  Optimal Control-Based Adaptive NN Design for a Class of Nonlinear Discrete-Time Block-Triangular Systems , 2016, IEEE Transactions on Cybernetics.

[133]  Johannes P. Schlöder,et al.  Block-structured quadratic programming for the direct multiple shooting method for optimal control , 2011, Optim. Methods Softw..

[134]  Shuai Li,et al.  Predictive Suboptimal Consensus of Multiagent Systems With Nonlinear Dynamics , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[135]  Xin Chen,et al.  An iterative method for optimal feedback control and generalized HJB equation , 2018, IEEE/CAA Journal of Automatica Sinica.

[136]  Shen Yin,et al.  Velocity-Free Fault-Tolerant and Uncertainty Attenuation Control for a Class of Nonlinear Systems , 2016, IEEE Transactions on Industrial Electronics.

[137]  Xiong Yang,et al.  Adaptive Critic Designs for Event-Triggered Robust Control of Nonlinear Systems With Unknown Dynamics , 2019, IEEE Transactions on Cybernetics.

[138]  I. Michael Ross,et al.  Advances in Pseudospectral Methods for Optimal Control , 2008 .

[139]  Frank L. Lewis,et al.  Cooperative Optimal Control for Multi-Agent Systems on Directed Graph Topologies , 2014, IEEE Transactions on Automatic Control.

[140]  Derong Liu,et al.  Policy Iteration Adaptive Dynamic Programming Algorithm for Discrete-Time Nonlinear Systems , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[141]  S. Zhang,et al.  A symplectic pseudospectral method for nonlinear optimal control problems with inequality constraints. , 2017, ISA transactions.

[142]  Bao-Zhu Guo,et al.  Convergence of an Upwind Finite-Difference Scheme for Hamilton–Jacobi–Bellman Equation in Optimal Control , 2015, IEEE Transactions on Automatic Control.

[143]  Ning Sun,et al.  Nonlinear Hierarchical Control for Unmanned Quadrotor Transportation Systems , 2018, IEEE Transactions on Industrial Electronics.

[144]  Peter J. Gawthrop,et al.  Optimal control of nonlinear systems: a predictive control approach , 2003, Autom..

[145]  Huaguang Zhang,et al.  Model-free multiobjective approximate dynamic programming for discrete-time nonlinear systems with general performance index functions , 2009, Neurocomputing.

[146]  Shuai Li,et al.  Adaptive near-optimal consensus of high-order nonlinear multi-agent systems with heterogeneity , 2017, Autom..

[147]  Sebastien Gros,et al.  A distributed algorithm for NMPC-based wind farm control , 2014, 53rd IEEE Conference on Decision and Control.

[148]  Jay H. Lee,et al.  Model predictive control: Review of the three decades of development , 2011 .

[149]  Wolfgang Marquardt,et al.  How to verify optimal controls computed by direct shooting methods? – A tutorial , 2012 .

[150]  Shuai Li,et al.  Near-Optimal Control Without Solving HJB Equations and Its Applications , 2018, IEEE Transactions on Industrial Electronics.

[151]  Zhong-Ping Jiang,et al.  Robust adaptive dynamic programming for linear and nonlinear systems: An overview , 2013, Eur. J. Control.

[152]  Justin Ruths,et al.  Convergence of a pseudospectral method for optimal control of complex dynamical systems , 2011, IEEE Conference on Decision and Control and European Control Conference.

[153]  Junzhi Yu,et al.  Neural-Network-Based Nonlinear Model Predictive Control for Piezoelectric Actuators , 2015, IEEE Transactions on Industrial Electronics.

[154]  Hao Xu,et al.  Neural Network-Based Finite-Horizon Optimal Control of Uncertain Affine Nonlinear Discrete-Time Systems , 2015, IEEE Trans. Neural Networks Learn. Syst..

[155]  M. Gerdts Direct Shooting Method for the Numerical Solution of Higher-Index DAE Optimal Control Problems , 2003 .

[156]  Thomas Parisini,et al.  Robust Model Predictive Control of Nonlinear Systems With Bounded and State-Dependent Uncertainties , 2009, IEEE Transactions on Automatic Control.

[157]  Lei Yang,et al.  Direct Heuristic Dynamic Programming for Nonlinear Tracking Control With Filtered Tracking Error , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).