Design of a completely model free adaptive control in the presence of parametric, non-parametric uncertainties and random control signal delay.

In this paper, an adaptive controller is developed for discrete time linear systems that takes into account parametric uncertainty, internal-external non-parametric random uncertainties, and time varying control signal delay. Additionally, the proposed adaptive control is designed in such a way that it is utterly model free. Even though these properties are studied separately in the literature, they are not taken into account all together in adaptive control literature. The Q-function is used to estimate long-term performance of the proposed adaptive controller. Control policy is generated based on the long-term predicted value, and this policy searches an optimal stabilizing control signal for uncertain and unstable systems. The derived control law does not require an initial stabilizing control assumption as in the ones in the recent literature. Learning error, control signal convergence, minimized Q-function, and instantaneous reward are analyzed to demonstrate the stability and effectiveness of the proposed adaptive controller in a simulation environment. Finally, key insights on parameters convergence of the learning and control signals are provided.

[1]  Zhizhou Zhang,et al.  Hopf bifurcation of time-delayed feedback control for maglev system with flexible guideway , 2013, Appl. Math. Comput..

[2]  Huijun Gao,et al.  Saturated Adaptive Robust Control for Active Suspension Systems , 2013, IEEE Transactions on Industrial Electronics.

[3]  Zhizhou Zhang,et al.  Stability and Bifurcation Analysis in a Maglev System with Multiple Delays , 2015, Int. J. Bifurc. Chaos.

[4]  Derong Liu,et al.  Data-Based Adaptive Critic Designs for Nonlinear Robust Optimal Control With Uncertain Dynamics , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[5]  Onder Tutsoy,et al.  Chaotic dynamics and convergence analysis of temporal difference algorithms with bang‐bang control , 2016 .

[6]  Yongduan Song,et al.  Adaptive finite-time consensus control of a group of uncertain nonlinear mechanical systems , 2015, Autom..

[7]  Martin Brown,et al.  Reinforcement learning analysis for a minimum time balance problem , 2016 .

[8]  W. K. Lai,et al.  MODELING AND CONTROLLER DESIGN OF PNEUMATIC ACTUATOR SYSTEM WITH CONTROL VALVE , 2012 .

[9]  Shuzhi Sam Ge,et al.  Adaptive control for a discrete-time first-order nonlinear system with both parametric and non-parametric uncertainties , 2007, 2007 46th IEEE Conference on Decision and Control.

[10]  Bing Chen,et al.  Direct adaptive fuzzy control for nonlinear systems with time-varying delays , 2010, Inf. Sci..

[11]  Shengyuan Xu,et al.  Asymptotic Tracking Control of Uncertain Nonlinear Systems With Unknown Actuator Nonlinearity , 2014, IEEE Transactions on Automatic Control.

[12]  Hao Xu,et al.  Stochastic optimal control of unknown linear networked control system in the presence of random delays and packet losses , 2012, Autom..

[13]  Lennart Ljung,et al.  Identification of unstable systems using output error and Box-Jenkins model structures , 2000, IEEE Trans. Autom. Control..

[14]  Dan Ye,et al.  A Separated Approach to Control of Markov Jump Nonlinear Systems With General Transition Probabilities , 2016, IEEE Transactions on Cybernetics.

[15]  Shuzhi Sam Ge,et al.  Robust adaptive control of nonlinear systems with unknown time delays , 2004, Proceedings of the 2004 IEEE International Symposium on Intelligent Control, 2004..

[16]  Shuzhi Sam Ge,et al.  Adaptive Control of a Flexible Crane System With the Boundary Output Constraint , 2014, IEEE Transactions on Industrial Electronics.

[17]  Zhongjiu Zheng,et al.  Global Asymptotic Model-Free Trajectory-Independent Tracking Control of an Uncertain Marine Vehicle: An Adaptive Universe-Based Fuzzy Control Approach , 2018, IEEE Transactions on Fuzzy Systems.

[18]  Long Cheng,et al.  Neural-Network-Based Adaptive Leader-Following Control for Multiagent Systems With Uncertainties , 2010, IEEE Transactions on Neural Networks.

[19]  Frank L. Lewis,et al.  Model-free Q-learning designs for linear discrete-time zero-sum games with application to H-infinity control , 2007, Autom..

[20]  Onder Tutsoy,et al.  Design and Comparison Base Analysis of Adaptive Estimator for Completely Unknown Linear Systems in the Presence of OE Noise and Constant Input Time Delay , 2016 .

[21]  Shunan Wu,et al.  Adaptive control for spacecraft relative translation with parametric uncertainty , 2013 .

[22]  Kai-Yew Lum,et al.  Adaptive Estimation and Control for Systems with Parametric and Nonparametric Uncertainties , 2009 .

[23]  M. Melluso,et al.  Fuzzy adaptive EKF motion control for non-holonomic and underactuated cars with parametric and non-parametric uncertainties , 2007 .

[24]  Onder Tutsoy,et al.  Adaptive estimator design for unstable output error systems: A test problem and traditional system identification based analysis , 2015, J. Syst. Control. Eng..

[25]  Zhi-Zhou Zhang,et al.  Adaptive notch filter design for levitation sensing system based on vibration computation , 2019, Cluster Computing.

[26]  Anuradha M. Annaswamy,et al.  Adaptive control of hypersonic vehicles in the presence of modeling uncertainties , 2009, 2009 American Control Conference.

[27]  Song Ting,et al.  Model-free Adaptive Control for Spacecraft Attitude , 2016 .

[28]  Frank L. Lewis,et al.  Reinforcement Learning for Partially Observable Dynamic Processes: Adaptive Dynamic Programming Using Measured Output Data , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[29]  Bing Chen,et al.  Fuzzy-Approximation-Based Adaptive Control of Strict-Feedback Nonlinear Systems With Time Delays , 2010, IEEE Transactions on Fuzzy Systems.

[30]  Petros A. Ioannou,et al.  Robust Adaptive Control , 2012 .