Fuzzy Approximation-Based Adaptive Backstepping Optimal Control for a Class of Nonlinear Discrete-Time Systems With Dead-Zone

In this paper, an adaptive fuzzy optimal control design is addressed for a class of unknown nonlinear discrete-time systems. The controlled systems are in a strict-feedback frame and contain unknown functions and nonsymmetric dead-zone. For this class of systems, the control objective is to design a controller, which not only guarantees the stability of the systems, but achieves the optimal control performance as well. This immediately brings about the difficulties in the controller design. To this end, the fuzzy logic systems are employed to approximate the unknown functions in the systems. Based on the utility functions and the critic designs, and by applying the backsteppping design technique, a reinforcement learning algorithm is used to develop an optimal control signal. The adaptation auxiliary signal for unknown dead-zone parameters is established to compensate for the effect of nonsymmetric dead-zone on the control performance, and the updating laws are obtained based on the gradient descent rule. The stability of the control systems can be proved based on the difference Lyapunov function method. The feasibility of the proposed control approach is further demonstrated via two simulation examples.

[1]  Li Tang,et al.  Adaptive control for a class of chemical reactor systems in discrete-time form , 2013, Neural Computing and Applications.

[2]  Jing Na,et al.  Adaptive neural dynamic surface control for servo systems with unknown dead-zone , 2011 .

[3]  Jang Myung Lee,et al.  Precise Positioning of Nonsmooth Dynamic Systems Using Fuzzy Wavelet Echo State Networks and Dynamic Surface Sliding Mode Control , 2013, IEEE Transactions on Industrial Electronics.

[4]  Xin Chen,et al.  Adaptive Tracking Control for A Class of Nonlinear Systems With a Fuzzy Dead-Zone Input , 2015, IEEE Transactions on Fuzzy Systems.

[5]  Hak-Keung Lam,et al.  Stability Analysis of Polynomial-Fuzzy-Model-Based Control Systems With Mismatched Premise Membership Functions , 2014, IEEE Transactions on Fuzzy Systems.

[6]  Huaguang Zhang,et al.  Optimal Tracking Control for a Class of Nonlinear Discrete-Time Systems With Time Delays Based on Heuristic Dynamic Programming , 2011, IEEE Transactions on Neural Networks.

[7]  Jin Zhang,et al.  Adaptive neural network control for a class of MIMO nonlinear systems with disturbances in discrete-time , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[8]  Vinay Kumar Deolia,et al.  Backstepping Control of Discrete-Time Nonlinear System Under Unknown Dead-zone Constraint , 2011, 2011 International Conference on Communication Systems and Network Technologies.

[9]  Shaocheng Tong,et al.  Adaptive neural network tracking design for a class of uncertain nonlinear discrete-time systems with dead-zone , 2012, Science China Information Sciences.

[10]  Jean-Jacques E. Slotine,et al.  Neural Network Control of Unknown Nonlinear Systems , 1989, 1989 American Control Conference.

[11]  Shuzhi Sam Ge,et al.  Adaptive Control of a Flexible Crane System With the Boundary Output Constraint , 2014, IEEE Transactions on Industrial Electronics.

[12]  Frank L. Lewis,et al.  Deadzone compensation in discrete time using adaptive fuzzy logic , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[13]  Shuzhi Sam Ge,et al.  Boundary control of a flexible marine installation system , 2011, 49th IEEE Conference on Decision and Control (CDC).

[14]  Jang Myung Lee,et al.  Output-Tracking-Error-Constrained Robust Positioning Control for a Nonsmooth Nonlinear Dynamic System , 2014, IEEE Transactions on Industrial Electronics.

[15]  Abdesselem Boulkroune,et al.  A fuzzy adaptive variable-structure control scheme for uncertain chaotic MIMO systems with sector nonlinearities and dead-zones , 2011, Expert Syst. Appl..

[16]  Jianbin Qiu,et al.  Adaptive Fuzzy Backstepping Control for A Class of Nonlinear Systems With Sampled and Delayed Measurements , 2015, IEEE Transactions on Fuzzy Systems.

[17]  Shuzhi Sam Ge,et al.  Top Tension Control of a Flexible Marine Riser by Using Integral-Barrier Lyapunov Function , 2015, IEEE/ASME Transactions on Mechatronics.

[18]  Derong Liu,et al.  Policy Iteration Adaptive Dynamic Programming Algorithm for Discrete-Time Nonlinear Systems , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[19]  Abdesselem Boulkroune,et al.  Adaptive fuzzy controller for multivariable nonlinear state time-varying delay systems subject to input nonlinearities , 2011, Fuzzy Sets Syst..

[20]  Shaocheng Tong,et al.  Adaptive Fuzzy Output Feedback Tracking Backstepping Control of Strict-Feedback Nonlinear Systems With Unknown Dead Zones , 2012, IEEE Transactions on Fuzzy Systems.

[21]  Bing Chen,et al.  Fuzzy Approximation-Based Adaptive Control of Nonlinear Delayed Systems With Unknown Dead Zone , 2014, IEEE Transactions on Fuzzy Systems.

[22]  Derong Liu,et al.  Neural-Network-Based Optimal Control for a Class of Unknown Discrete-Time Nonlinear Systems Using Globalized Dual Heuristic Programming , 2012, IEEE Transactions on Automation Science and Engineering.

[23]  Derong Liu,et al.  Finite-Approximation-Error-Based Optimal Control Approach for Discrete-Time Nonlinear Systems , 2013, IEEE Transactions on Cybernetics.

[24]  Manolis A. Christodoulou,et al.  Adaptive control of unknown plants using dynamical neural networks , 1994, IEEE Trans. Syst. Man Cybern..

[25]  Shuzhi Sam Ge,et al.  Output Feedback NN Control for Two Classes of Discrete-Time Systems With Unknown Control Directions in a Unified Approach , 2008, IEEE Transactions on Neural Networks.

[26]  Shaocheng Tong,et al.  Adaptive Fuzzy Output Feedback Control of MIMO Nonlinear Systems With Unknown Dead-Zone Inputs , 2013, IEEE Transactions on Fuzzy Systems.

[27]  Jang Myung Lee,et al.  Partial Tracking Error Constrained Fuzzy Dynamic Surface Control for a Strict Feedback Nonlinear Dynamic System , 2014, IEEE Transactions on Fuzzy Systems.

[28]  Derong Liu,et al.  An iterative adaptive dynamic programming algorithm for optimal control of unknown discrete-time nonlinear systems with constrained inputs , 2013, Inf. Sci..

[29]  H. Lam State and Output Feedback Control of A Class of Fuzzy Systems with Mismatched Membership Functions , 2014 .

[30]  Shaocheng Tong,et al.  Adaptive Fuzzy Control for a Class of Nonlinear Discrete-Time Systems With Backlash , 2014, IEEE Transactions on Fuzzy Systems.

[31]  Zhijun Li,et al.  Adaptive Fuzzy Control for Synchronization of Nonlinear Teleoperators With Stochastic Time-Varying Communication Delays , 2011, IEEE Transactions on Fuzzy Systems.

[32]  Huaguang Zhang,et al.  Neural-Network-Based Near-Optimal Control for a Class of Discrete-Time Affine Nonlinear Systems With Control Constraints , 2009, IEEE Transactions on Neural Networks.

[33]  Derong Liu,et al.  Decentralized Stabilization for a Class of Continuous-Time Nonlinear Interconnected Systems Using Online Learning Optimal Control Approach , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[34]  Shuzhi Sam Ge,et al.  Adaptive NN control for a class of strict-feedback discrete-time nonlinear systems , 2003, Autom..

[35]  Licheng Jiao,et al.  Adaptive Backstepping Fuzzy Control for Nonlinearly Parameterized Systems With Periodic Disturbances , 2010, IEEE Transactions on Fuzzy Systems.

[36]  Frank L. Lewis,et al.  2009 Special Issue: Neural network approach to continuous-time direct adaptive optimal control for partially unknown nonlinear systems , 2009 .

[37]  Zhongke Shi,et al.  Reinforcement Learning Output Feedback NN Control Using Deterministic Learning Technique , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[38]  Qinmin Yang,et al.  Reinforcement Learning Controller Design for Affine Nonlinear Discrete-Time Systems using Online Approximators , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[39]  Shuzhi Sam Ge,et al.  Adaptive Predictive Control Using Neural Network for a Class of Pure-Feedback Systems in Discrete Time , 2008, IEEE Transactions on Neural Networks.

[40]  Xin Zhang,et al.  Neural-network-based reinforcement learning controller for nonlinear systems with non-symmetric dead-zone inputs , 2009, 2009 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning.

[41]  Derong Liu,et al.  Neural-network-based online optimal control for uncertain non-linear continuous-time systems with control constraints , 2013 .

[42]  Huaguang Zhang,et al.  A Novel Infinite-Time Optimal Tracking Control Scheme for a Class of Discrete-Time Nonlinear Systems via the Greedy HDP Iteration Algorithm , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[43]  Kumpati S. Narendra,et al.  Identification and control of dynamical systems using neural networks , 1990, IEEE Trans. Neural Networks.

[44]  Huaguang Zhang,et al.  Near-Optimal Control for Nonzero-Sum Differential Games of Continuous-Time Nonlinear Systems Using Single-Network ADP , 2013, IEEE Transactions on Cybernetics.