Lyapunov, Adaptive, and Optimal Design Techniques for Cooperative Systems on Directed Communication Graphs

This paper presents three design techniques for cooperative control of multiagent systems on directed graphs, namely, Lyapunov design, neural adaptive design, and linear quadratic regulator (LQR)-based optimal design. Using a carefully constructed Lyapunov equation for digraphs, it is shown that many results of cooperative control on undirected graphs or balanced digraphs can be extended to strongly connected digraphs. Neural adaptive control technique is adopted to solve the cooperative tracking problems of networked nonlinear systems with unknown dynamics and disturbances. Results for both first-order and high-order nonlinear systems are given. Two examples, i.e., cooperative tracking control of coupled Lagrangian systems and modified FitzHugh-Nagumo models, justify the feasibility of the proposed neural adaptive control technique. For cooperative tracking control of the general linear systems, which include integrator dynamics as special cases, it is shown that the control gain design can be decoupled from the topology of the graphs, by using the LQR-based optimal control technique. Moreover, the synchronization region is unbounded, which is a desired property of the controller. The proposed optimal control method is applied to cooperative tracking control of two-mass-spring systems, which are well-known models for vibration in many mechanical systems.

[1]  John N. Tsitsiklis,et al.  Distributed Asynchronous Deterministic and Stochastic Gradient Optimization Algorithms , 1984, 1984 American Control Conference.

[2]  Frank L. Lewis,et al.  Optimal Control , 1986 .

[3]  John Rinzel,et al.  A Formal Classification of Bursting Mechanisms in Excitable Systems , 1987 .

[4]  Vicsek,et al.  Novel type of phase transition in a system of self-driven particles. , 1995, Physical review letters.

[5]  Frank L. Lewis,et al.  Neural Network Control Of Robot Manipulators And Non-Linear Systems , 1998 .

[6]  Guanrong Chen,et al.  Pinning control of scale-free dynamical networks , 2002 .

[7]  Frank L. Lewis,et al.  Robot Manipulator Control: Theory and Practice , 2003 .

[8]  R. Murray,et al.  Consensus protocols for networks of dynamic agents , 2003, Proceedings of the 2003 American Control Conference, 2003..

[9]  Jie Lin,et al.  Coordination of groups of mobile autonomous agents using nearest neighbor rules , 2003, IEEE Trans. Autom. Control..

[10]  Guanrong Chen,et al.  Pinning a complex dynamical network to its equilibrium , 2004, IEEE Transactions on Circuits and Systems I: Regular Papers.

[11]  Richard M. Murray,et al.  Information flow and cooperative control of vehicle formations , 2004, IEEE Transactions on Automatic Control.

[12]  Richard M. Murray,et al.  Consensus problems in networks of agents with switching topology and time-delays , 2004, IEEE Transactions on Automatic Control.

[13]  Jon Rigelsford,et al.  Robot Manipulator Control: Theory and Practice 2/e , 2004 .

[14]  E.M. Atkins,et al.  A survey of consensus problems in multi-agent coordination , 2005, Proceedings of the 2005, American Control Conference, 2005..

[15]  Manfredi Maggiore,et al.  Necessary and sufficient graphical conditions for formation control of unicycles , 2005, IEEE Transactions on Automatic Control.

[16]  Luc Moreau,et al.  Stability of multiagent systems with time-dependent communication links , 2005, IEEE Transactions on Automatic Control.

[17]  M. Spong,et al.  Robot Modeling and Control , 2005 .

[18]  Randal W. Beard,et al.  Consensus seeking in multiagent systems under dynamically changing interaction topologies , 2005, IEEE Transactions on Automatic Control.

[19]  Wang Jinhuan,et al.  Consensus of Multi-agent Systems with Higher Order Dynamics , 2006, 2007 Chinese Control Conference.

[20]  Jean-Jacques E. Slotine,et al.  A theoretical study of different leader roles in networks , 2006, IEEE Transactions on Automatic Control.

[21]  Mark W. Spong,et al.  Passivity-Based Control of Multi-Agent Systems , 2006 .

[22]  Murat Arcak,et al.  Passivity as a Design Tool for Group Coordination , 2007, IEEE Transactions on Automatic Control.

[23]  Richard M. Murray,et al.  Recent Research in Cooperative Control of Multivehicle Systems , 2007 .

[24]  R. Fierro,et al.  Decentralized cooperative control - A multivehicle platform for research in networked embedded systems , 2007, IEEE Control Systems.

[25]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[26]  Wei Ren,et al.  Information consensus in multivehicle cooperative control , 2007, IEEE Control Systems.

[27]  Kevin L. Moore,et al.  High-Order and Model Reference Consensus Algorithms in Cooperative Control of MultiVehicle Systems , 2007 .

[28]  Yiguang Hong,et al.  Distributed Observers Design for Leader-Following Control of Multi-Agent Networks (Extended Version) , 2017, 1801.00258.

[29]  S. E. Tuna.  LQR-based coupling gain for synchronization of linear systems , 2008, 0801.3390.

[30]  Michael Defoort,et al.  Sliding-Mode Formation Control for Cooperative Autonomous Mobile Robots , 2008, IEEE Transactions on Industrial Electronics.

[31]  Randal W. Beard,et al.  Distributed Consensus in Multi-vehicle Cooperative Control - Theory and Applications , 2007, Communications and Control Engineering.

[32]  M. Fujita,et al.  Passivity-based output synchronization in SE(3) , 2008, 2008 American Control Conference.

[33]  Long Cheng,et al.  Decentralized Robust Adaptive Control for the Multiagent System Consensus Problem Using Neural Networks , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[34]  Z. Qu,et al.  Cooperative Control of Dynamical Systems: Applications to Autonomous Vehicles , 2009 .

[35]  D. Bernstein.  Matrix Mathematics: Theory, Facts, and Formulas , 2009 .

[36]  Yongcan Cao,et al.  Distributed Coordination of Multi-agent Networks: Emergent Problems, Models, and Issues , 2010 .

[37]  Jiming Chen,et al.  Distributed Collaborative Control for Industrial Automation With Wireless Sensor and Actuator Networks , 2010, IEEE Transactions on Industrial Electronics.

[38]  Shuzhi Sam Ge,et al.  Synchronized tracking control of multi-agent system with limited information , 2010, 49th IEEE Conference on Decision and Control (CDC).

[39]  Daizhan Cheng,et al.  Leader-following consensus of second-order agents with multiple time-varying delays , 2010, Autom..

[40]  Lin Huang,et al.  Consensus of Multiagent Systems and Synchronization of Complex Networks: A Unified Viewpoint , 2016, IEEE Transactions on Circuits and Systems I: Regular Papers.

[41]  Frank L. Lewis,et al.  Synchronization of networked higher-order nonlinear systems with unknown dynamics , 2010, 49th IEEE Conference on Decision and Control (CDC).

[42]  Frank L. Lewis,et al.  Distributed adaptive control for synchronization of unknown nonlinear networked systems , 2010, Autom..

[43]  Beibei Ren,et al.  Synchronized altitude tracking control of multiple unmanned helicopters , 2010, Proceedings of the 2010 American Control Conference.

[44]  Frank L. Lewis,et al.  Optimal Design for Synchronization of Cooperative Systems: State Feedback, Observer and Output Feedback , 2011, IEEE Transactions on Automatic Control.

[45]  P. Olver.  Nonlinear Systems , 2013 .