Intelligent adaptive learning and control for discrete-time nonlinear uncertain systems in multiple environments

Abstract This paper focuses on an adaptive learning and control problem for a class of discrete-time nonlinear uncertain systems operating under multiple environments. A novel intelligent learning control framework is proposed by using a combination of offline and online learning methods. Specifically, in the offline learning mode, a deterministic learning (DL) based adaptive dynamics learning approach is first proposed to achieve locally-accurate identification of associated nonlinear uncertain system dynamics under each anticipated individual environment, and the learned knowledge is obtained and stored in a set of constant radial basis function neural network models. Then, with the learned knowledge, an online adaptive learning control scheme is further developed, which consists of: (i) an online adaptive learning control mechanism composed of multiple experience-based controllers and a DL-based adaptive learning controller, aiming to provide desired control performance for the plant operating under each individual environment; and (ii) a learning-based recognition mechanism composed of multiple recognition estimators and a DL-based identifier, aiming to recognize the active environment and schedule appropriate control strategies in real time. To guarantee the system stability during environment transition, a robust quasi-sliding-mode controller is further developed and embedded in the overall controller architecture. With this new intelligent adaptive learning control framework, the overall system is capable of adapting not only to any anticipated (pre-defined) environment by re-utilizing the knowledge obtained from both offline and online learning, but also to unanticipated (new) environments by actively acquiring new knowledge online. Simulation studies are conducted to verify the effectiveness and advantages of this new framework.

[1]  David J. Hill,et al.  Deterministic Learning Theory , 2009 .

[2]  Wei Zeng,et al.  Composite adaptive NN learning and control for discrete-time nonlinear uncertain systems in normal form , 2020, Neurocomputing.

[3]  Jooyoung Park,et al.  Universal Approximation Using Radial-Basis-Function Networks , 1991, Neural Computation.

[4]  Chao Zeng,et al.  A Learning Framework of Adaptive Manipulative Skills From Human to Robot , 2019, IEEE Transactions on Industrial Informatics.

[5]  Kumpati S. Narendra,et al.  Adaptive control using multiple models, switching and tuning , 2003 .

[6]  Kumpati S. Narendra,et al.  Adaptive control using multiple models , 1997, IEEE Trans. Autom. Control..

[7]  C. L. Philip Chen,et al.  A survey of human-centered intelligent robots: issues and challenges , 2017, IEEE/CAA Journal of Automatica Sinica.

[8]  Shuzhi Sam Ge,et al.  Optimal Critic Learning for Robot Control in Time-Varying Environments , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[9]  Miomir Vukobratovic,et al.  Survey of Intelligent Control Techniques for Humanoid Robots , 2003, J. Intell. Robotic Syst..

[10]  Zhijun Li,et al.  Design and Adaptive Control for an Upper Limb Robotic Exoskeleton in Presence of Input Saturation , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[11]  Cong Wang,et al.  Rapid Oscillation Fault Detection and Isolation for Distributed Systems via Deterministic Learning , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[12]  Kumpati S. Narendra,et al.  Adaptive control of discrete-time systems using multiple models , 2000, IEEE Trans. Autom. Control..

[13]  King-Sun Fu,et al.  Learning Control Systems-Review and Outlook , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Chenguang Yang,et al.  Robot Learning System Based on Adaptive Neural Control and Dynamic Movement Primitives , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[15]  Chengzhi Yuan,et al.  Small fault detection from discrete-time closed-loop control using fault dynamics residuals , 2019, Neurocomputing.

[16]  Chenguang Yang,et al.  Neural Networks Enhanced Adaptive Admittance Control of Optimized Robot–Environment Interaction , 2019, IEEE Transactions on Cybernetics.

[17]  Cong Wang,et al.  Persistency of excitation and performance of deterministic learning , 2011, Proceedings of the 30th Chinese Control Conference.

[18]  Cong Wang,et al.  Pattern-based NN control for uncertain pure-feedback nonlinear systems , 2019, J. Frankl. Inst..

[19]  Nagarajan Sukavanam,et al.  Adaptive neural controller for cooperative multiple robot manipulator system manipulating a single rigid object , 2012, Appl. Soft Comput..

[20]  Chengzhi Yuan,et al.  Similar Fault Isolation of Discrete-Time Nonlinear Uncertain Systems: An Adaptive Threshold Based Approach , 2020, IEEE Access.

[21]  Shuzhi Sam Ge,et al.  Consensus-based distributed cooperative learning control for a group of discrete-time nonlinear multi-agent systems using neural networks , 2014, Autom..

[22]  Cong Wang,et al.  Pattern-Based NN Control of a Class of Uncertain Nonlinear Systems , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[23]  Gang Tao,et al.  Multivariable adaptive control: A survey , 2014, Autom..

[24]  Wei He,et al.  Adaptive Fuzzy Neural Network Control for a Constrained Robot Using Impedance Learning , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[25]  Cong Wang,et al.  Learning from neural control for a class of discrete-time nonlinear systems , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[26]  Leszek Rutkowski,et al.  Adaptive probabilistic neural networks for pattern classification in time-varying environment , 2004, IEEE Transactions on Neural Networks.

[27]  Qixin Cao,et al.  Based on force sensing-controlled human-machine interaction system for walking assistant robot , 2010, 2010 8th World Congress on Intelligent Control and Automation.

[28]  Daniel G. Sbarbaro-Hofer,et al.  An adaptive sliding-mode controller for discrete nonlinear systems , 2000, IEEE Trans. Ind. Electron..

[29]  Haibo He,et al.  Small Fault Detection of Discrete-Time Nonlinear Uncertain Systems , 2019, IEEE Transactions on Cybernetics.