Consensus-based distributed cooperative learning control for a group of discrete-time nonlinear multi-agent systems using neural networks

This paper focuses on the cooperative learning capability of radial basis function neural networks in adaptive neural controllers for a group of uncertain discrete-time nonlinear systems where system structures are identical but reference signals are different. By constructing an interconnection topology among learning laws of NN weights in order to share their learned knowledge on-line, a novel adaptive NN control scheme, called distributed cooperative learning control scheme, is proposed. It is guaranteed that if the interconnection topology is undirected and connected, all closed-loop signals are uniform ultimate bounded and tracking errors of all systems can converge to a small neighborhood around the origin. Moreover, it is proved that all estimated NN weights converge to a small neighborhood of their common optimal value along the union of all state trajectories, which means that the estimated NN weights reach consensus with a small consensus error. Thus, all learned NN models have the better generalization capability than ones obtained by the deterministic learning method. The learned knowledge is also adopted to control a class of uncertain systems with the same structure but different reference signals. Finally, a simulation example is provided to verify the effectiveness and advantages of the distributed cooperative learning control scheme developed in this paper.

[1]  Long Cheng,et al.  Distributed Adaptive Coordinated Control of Multi-Manipulator Systems Using Neural Networks , 2010 .

[2]  Dan Wang,et al.  Neural network-based adaptive dynamic surface control for a class of uncertain nonlinear systems in strict-feedback form , 2005, IEEE Transactions on Neural Networks.

[3]  Marios M. Polycarpou,et al.  Stable adaptive neural control scheme for nonlinear systems , 1996, IEEE Trans. Autom. Control..

[4]  Cong Wang,et al.  Deterministic learning of nonlinear dynamical systems , 2003, Proceedings of the 2003 IEEE International Symposium on Intelligent Control.

[5]  Cong Wang,et al.  Learning From ISS-Modular Adaptive NN Control of Nonlinear Strict-Feedback Systems , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[6]  Petros A. Ioannou,et al.  Adaptive control tutorial , 2006, Advances in design and control.

[7]  Tao Zhang,et al.  Stable Adaptive Neural Network Control , 2001, The Springer International Series on Asian Studies in Computer and Information Science.

[8]  S. Ge,et al.  Adaptive neural control of nonlinear time-delay systems with unknown virtual control coefficients , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[9]  M. Hénon A two-dimensional mapping with a strange attractor , 1976 .

[10]  Richard M. Murray,et al.  Information flow and cooperative control of vehicle formations , 2004, IEEE Transactions on Automatic Control.

[11]  David J. Hill,et al.  Deterministic Learning Theory , 2009 .

[12]  Huaguang Zhang,et al.  Optimal Tracking Control for a Class of Nonlinear Discrete-Time Systems With Time Delays Based on Heuristic Dynamic Programming , 2011, IEEE Transactions on Neural Networks.

[13]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[14]  Long Cheng,et al.  Decentralized Robust Adaptive Control for the Multiagent System Consensus Problem Using Neural Networks , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  Changyin Sun,et al.  Distributed Cooperative Adaptive Identification and Control for a Group of Continuous-Time Systems With a Cooperative PE Condition via Consensus , 2014, IEEE Transactions on Automatic Control.

[16]  Guo-Xing Wen,et al.  Adaptive Consensus Control for a Class of Nonlinear Multiagent Time-Delay Systems Using Neural Networks , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[17]  Shuzhi Sam Ge,et al.  Adaptive neural network control for strict-feedback nonlinear systems using backstepping design , 1999, Proceedings of the 1999 American Control Conference (Cat. No. 99CH36251).

[18]  H. Khalil,et al.  Adaptive control of a class of nonlinear systems using neural networks , 1995, Proceedings of 1995 34th IEEE Conference on Decision and Control.

[19]  Reza Olfati-Saber,et al.  Flocking for multi-agent dynamic systems: algorithms and theory , 2006, IEEE Transactions on Automatic Control.

[20]  William R. Ward,et al.  Formation of the Galilean Satellites: Conditions of Accretion , 2002 .

[21]  Cong Wang,et al.  Learning from neural control for a class of discrete-time nonlinear systems , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[22]  Yongcan Cao,et al.  Distributed Coordination of Multi-agent Networks , 2011 .

[23]  Sarangapani Jagannathan,et al.  Discrete-time neural network output feedback control of nonlinear discrete-time systems in non-strict form , 2008, Autom..

[24]  Huaguang Zhang,et al.  Neural-Network-Based Near-Optimal Control for a Class of Discrete-Time Affine Nonlinear Systems With Control Constraints , 2009, IEEE Transactions on Neural Networks.

[25]  Sivasubramanya N. Balakrishnan,et al.  Optimal Tracking Control of Motion Systems , 2012, IEEE Transactions on Control Systems Technology.

[26]  Cong Wang,et al.  Learning from neural control , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[27]  Wei Ren,et al.  Information consensus in multivehicle cooperative control , 2007, IEEE Control Systems.

[28]  Yongming Li,et al.  Observer-Based Adaptive Fuzzy Backstepping Dynamic Surface Control for a Class of MIMO Nonlinear Systems , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[29]  T.H. Lee,et al.  A leader-follower formation flight control scheme for UAV helicopters , 2008, 2008 IEEE International Conference on Automation and Logistics.

[30]  Pavel Yu. Chebotarev,et al.  The Matrix of Maximum Out Forests of a Digraph and Its Applications , 2006, ArXiv.

[31]  Wenwu Yu,et al.  An Overview of Recent Progress in the Study of Distributed Multi-Agent Coordination , 2012, IEEE Transactions on Industrial Informatics.

[32]  F. J. Narcowich,et al.  Persistency of Excitation in Identification Using Radial Basis Function Approximants , 1995 .

[33]  Cong Wang,et al.  Deterministic Learning and Rapid Dynamical Pattern Recognition , 2007, IEEE Transactions on Neural Networks.

[34]  Shuzhi Sam Ge,et al.  Adaptive NN control for a class of strict-feedback discrete-time nonlinear systems , 2003, Autom..

[35]  Hassan K. Khalil,et al.  Adaptive control of a class of nonlinear discrete-time systems using neural networks , 1995, IEEE Trans. Autom. Control..

[36]  Yu-Ping Tian,et al.  Frequency-Domain Analysis and Design of Distributed Control Systems , 2012 .

[37]  Nader Sadegh,et al.  A perceptron network for functional identification and control of nonlinear systems , 1993, IEEE Trans. Neural Networks.

[38]  Long Cheng,et al.  Neural-Network-Based Adaptive Leader-Following Control for Multiagent Systems With Uncertainties , 2010, IEEE Transactions on Neural Networks.

[39]  K. D. Do,et al.  Practical formation control of multiple underactuated ships with limited sensing ranges , 2011, Robotics Auton. Syst..

[40]  Frank L. Lewis,et al.  Multilayer discrete-time neural-net controller with guaranteed performance , 1996, IEEE Trans. Neural Networks.

[41]  Shaocheng Tong,et al.  Fuzzy-Adaptive Decentralized Output-Feedback Control for Large-Scale Nonlinear Systems With Dynamical Uncertainties , 2010, IEEE Transactions on Fuzzy Systems.

[42]  Shuzhi Sam Ge,et al.  Output Feedback NN Control for Two Classes of Discrete-Time Systems With Unknown Control Directions in a Unified Approach , 2008, IEEE Transactions on Neural Networks.

[43]  Radoslaw Romuald Zakrzewski,et al.  Neural network control of nonlinear discrete time systems , 1994 .

[44]  Soummya Kar,et al.  Distributed Consensus Algorithms in Sensor Networks: Quantized Data and Random Link Failures , 2007, IEEE Transactions on Signal Processing.