Neural Network-Based Model-Free Adaptive Near-Optimal Tracking Control for a Class of Nonlinear Systems

In this paper, the receding horizon near-optimal tracking control problem about a class of continuous-time nonlinear systems with fully unknown dynamics is considered. The main challenges of this problem lie in two aspects: 1) most existing systems only restrict their considerations to the state feedback part while the input channel parameters are assumed to be known. This paper considers fully unknown system dynamics in both the state feedback channel and the input channel and 2) the optimal control of nonlinear systems requires the solution of nonlinear Hamilton–Jacobi–Bellman equations. Up to date, there are no systematic approaches in the existing literature to solve it accurately. A novel model-free adaptive near-optimal control method is proposed to solve this problem via utilizing the Taylor expansion-based problem relaxation, the universal approximation property of sigmoid neural networks, and the concept of sliding mode control. By making approximation for the performance index, it is first relaxed to a quadratic program, and then, a linear algebraic equation with unknown terms. An auxiliary system is designed to reconstruct the input-to-output property of the control systems with unknown dynamics, so as to tackle the difficulty caused by the unknown terms. Then, by considering the property of the sliding-mode surface, an explicit adaptive near-optimal control law is derived from the linear algebraic equation. Theoretical analysis shows that the auxiliary system is convergent, the resultant closed-loop system is asymptotically stable, and the performance index asymptomatically converges to optimal. An illustrative example and experimental results are presented, which substantiate the efficacy of the proposed method and verify the theoretical results.

[1]  Shaocheng Tong,et al.  Adaptive Neural Output Feedback Controller Design With Reduced-Order Observer for a Class of Uncertain Nonlinear SISO Systems , 2011, IEEE Transactions on Neural Networks.

[2]  Ahmed Al-Durra,et al.  Design and Implementation of a Nonlinear PI Predictive Controller for a Grid-Tied Photovoltaic Inverter , 2017, IEEE Transactions on Industrial Electronics.

[3]  Ali Heydari,et al.  Finite-Horizon Control-Constrained Nonlinear Optimal Control Using Single Network Adaptive Critics , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[4]  Shuai Li,et al.  Noise-Tolerant ZNN Models for Solving Time-Varying Zero-Finding Problems: A Control-Theoretic Approach , 2017, IEEE Transactions on Automatic Control.

[5]  George A. Rovithakis,et al.  Adaptive Dynamic Output Feedback Neural Network Control of Uncertain MIMO Nonlinear Systems With Prescribed Performance , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[6]  Chenguang Yang,et al.  Neural-Learning-Based Telerobot Control With Guaranteed Performance , 2017, IEEE Transactions on Cybernetics.

[7]  Lin Zhao,et al.  Fuzzy Finite-Time Command Filtered Control of Nonlinear Systems With Input Saturation , 2018, IEEE Transactions on Cybernetics.

[8]  Antonio Loría,et al.  Observers are Unnecessary for Output-Feedback Control of Lagrangian Systems , 2016, IEEE Transactions on Automatic Control.

[9]  Sastry,et al.  Necessary and sufficient conditions for parameter convergence in adaptive control , 1984 .

[10]  Yaonan Wang,et al.  Simultaneous Stabilization and Tracking of Nonholonomic Mobile Robots: A Lyapunov-Based Approach , 2015, IEEE Transactions on Control Systems Technology.

[11]  Long Jin,et al.  GD-aided IOL (input–output linearisation) controller for handling affine-form nonlinear system with loose condition on relative degree , 2016, Int. J. Control.

[12]  Frank Allgöwer,et al.  Robust Consensus Controller Design for Nonlinear Relative Degree Two Multi-Agent Systems With Communication Constraints , 2011, IEEE Transactions on Automatic Control.

[13]  Honghai Shen,et al.  Improving the Rapidity of Nonlinear Tracking Differentiator via Feedforward , 2014, IEEE Transactions on Industrial Electronics.

[14]  Avrie Levent,et al.  Robust exact differentiation via sliding mode technique , 1998, Autom..

[15]  Chen Peng,et al.  Singularity-conquering ZG controllers of z2g1 type for tracking control of the IPC system , 2014, Int. J. Control.

[16]  Haoyong Yu,et al.  Composite Learning From Adaptive Dynamic Surface Control , 2016, IEEE Transactions on Automatic Control.

[17]  Shaocheng Tong,et al.  Optimal Control-Based Adaptive NN Design for a Class of Nonlinear Discrete-Time Block-Triangular Systems , 2016, IEEE Transactions on Cybernetics.

[18]  Gonzalo Joya,et al.  Hopfield neural networks for optimization: study of the different dynamics , 2002 .

[19]  Maolin Jin,et al.  A New Adaptive Sliding-Mode Control Scheme for Application to Robot Manipulators , 2016, IEEE Transactions on Industrial Electronics.

[20]  Changyin Sun,et al.  Distributed Cooperative Adaptive Identification and Control for a Group of Continuous-Time Systems With a Cooperative PE Condition via Consensus , 2014, IEEE Transactions on Automatic Control.

[21]  Peng Shi,et al.  Adaptive Neural Tracking Control for a Class of Nonlinear Systems With Dynamic Uncertainties , 2017, IEEE Transactions on Cybernetics.

[22]  Lijie Wang,et al.  Adaptive Fuzzy Control of Nonlinear Systems With Unmodeled Dynamics and Input Saturation Using Small-Gain Approach , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[23]  Wen-Hua Chen,et al.  Disturbance observer based control for nonlinear systems , 2004, IEEE/ASME Transactions on Mechatronics.

[24]  Tingwen Huang,et al.  A Neural-Network-Based Controller for Piezoelectric-Actuated Stick–Slip Devices , 2018, IEEE Transactions on Industrial Electronics.

[25]  Michael I. Friswell,et al.  Fixed-Time Attitude Control for Rigid Spacecraft With Actuator Saturation and Faults , 2016, IEEE Transactions on Control Systems Technology.

[26]  Wen-Hua Chen,et al.  Tracking control of small-scale helicopters using explicit nonlinear MPC augmented with disturbance observers , 2012 .

[27]  Peter J. Gawthrop,et al.  Nonlinear PID predictive controller , 1999 .

[28]  Chi-Tsong Chen,et al.  Linear System Theory and Design , 1995 .

[29]  Frank L. Lewis,et al.  Neuro-adaptive cooperative tracking control of unknown higher-order affine nonlinear systems , 2014, Autom..

[30]  Franck Plestan,et al.  Continuous Differentiator Based on Adaptive Second-Order Sliding-Mode Control for a 3-DOF Helicopter , 2016, IEEE Transactions on Industrial Electronics.

[31]  MengChu Zhou,et al.  Modified Primal-Dual Neural Networks for Motion Control of Redundant Manipulators With Dynamic Rejection of Harmonic Noises , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[32]  Yan Shi,et al.  Distributed Adaptive Fuzzy Control for Nonlinear Multiagent Systems Via Sliding Mode Observers , 2016, IEEE Transactions on Cybernetics.

[33]  Shuzhi Sam Ge,et al.  Vibration Control of Flexible Marine Riser Systems With Input Saturation , 2016, IEEE/ASME Transactions on Mechatronics.

[34]  Peter J. Gawthrop,et al.  A nonlinear disturbance observer for robotic manipulators , 2000, IEEE Trans. Ind. Electron..

[35]  Shaocheng Tong,et al.  Fuzzy Adaptive Output Feedback Optimal Control Design for Strict-Feedback Nonlinear Systems , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[36]  G. Lewicki,et al.  Approximation by Superpositions of a Sigmoidal Function , 2003 .

[37]  Shaocheng Tong,et al.  Barrier Lyapunov Functions-based adaptive control for a class of nonlinear pure-feedback systems with full state constraints , 2016, Autom..

[38]  Warren E. Dixon,et al.  Global exponential tracking control of a mobile robot system via a PE condition , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[39]  Wei-Song Lin,et al.  Adaptive Optimal Control for Designing Automatic Train Regulation for Metro Line , 2012, IEEE Transactions on Control Systems Technology.

[40]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[41]  Mohamed Wissem Naouar,et al.  Model Predictive-Sliding Mode Control for Three-Phase Grid-Connected Converters , 2017, IEEE Transactions on Industrial Electronics.

[42]  Shuai Li,et al.  Nonlinearly Activated Neural Network for Solving Time-Varying Complex Sylvester Equation , 2014, IEEE Transactions on Cybernetics.

[43]  Peter J. Gawthrop,et al.  Optimal control of nonlinear systems: a predictive control approach , 2003, Autom..

[44]  Bao-Zhu Guo,et al.  On convergence of tracking differentiator and application to frequency estimation of sinusoidal signals , 2011, 2011 8th Asian Control Conference (ASCC).

[45]  Peng Shi,et al.  Decentralized Adaptive Fuzzy Tracking Control for Robot Finger Dynamics , 2015, IEEE Transactions on Fuzzy Systems.

[46]  Erdal Kayacan,et al.  Adaptive Neuro-Fuzzy Control of a Spherical Rolling Robot Using Sliding-Mode-Control-Theory-Based Online Learning Algorithm , 2013, IEEE Transactions on Cybernetics.

[47]  Jing Na,et al.  Adaptive Control for Nonlinear Pure-Feedback Systems With High-Order Sliding Mode Observer , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[48]  Dongbing Gu,et al.  Receding horizon tracking control of wheeled mobile robots , 2006, IEEE Transactions on Control Systems Technology.

[49]  Andrzej Cichocki,et al.  Robust neural networks with on-line learning for blind identification and blind separation of sources , 1996 .

[50]  A. Isidori Nonlinear Control Systems: An Introduction , 1986 .

[51]  Xinghuo Yu,et al.  Sliding-mode control for systems with mismatched uncertainties via a disturbance observer , 2011, IECON 2011 - 37th Annual Conference of the IEEE Industrial Electronics Society.

[52]  Cong Wang,et al.  Neural Learning Control of Marine Surface Vessels With Guaranteed Transient Tracking Performance , 2016, IEEE Transactions on Industrial Electronics.

[53]  Changyin Sun,et al.  Adaptive Neural Network Control of a Flapping Wing Micro Aerial Vehicle With Disturbance Observer , 2017, IEEE Transactions on Cybernetics.

[54]  Andrzej M. Trzynadlowski,et al.  Robust Nonlinear Predictive Controller for Permanent-Magnet Synchronous Motors With an Optimized Cost Function , 2012, IEEE Transactions on Industrial Electronics.

[55]  Zhijun Zhang,et al.  Acceleration-Level Cyclic-Motion Generation of Constrained Redundant Robots Tracking Different Paths , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[56]  Laxmidhar Behera,et al.  Near-Optimal Controller for Nonlinear Continuous-Time Systems With Unknown Dynamics Using Policy Iteration , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[57]  Jorge Davila,et al.  Exact Tracking Using Backstepping Control Design and High-Order Sliding Modes , 2013, IEEE Transactions on Automatic Control.

[58]  Mingyu Wang,et al.  Approximation-Based Adaptive Tracking Control for MIMO Nonlinear Systems With Input Saturation , 2015, IEEE Transactions on Cybernetics.

[59]  Yuzhu Huang,et al.  Neuro-observer based online finite-horizon optimal control for uncertain non-linear continuous-time systems , 2017 .

[60]  Shuai Li,et al.  Dynamic Neural Networks for Kinematic Redundancy Resolution of Parallel Stewart Platforms , 2016, IEEE Transactions on Cybernetics.

[61]  Gang Tao,et al.  Adaptive Neural Network Based Control of Noncanonical Nonlinear Systems , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[62]  Shaocheng Tong,et al.  Fuzzy Approximation-Based Adaptive Backstepping Optimal Control for a Class of Nonlinear Discrete-Time Systems With Dead-Zone , 2016, IEEE Transactions on Fuzzy Systems.