Distributed Cooperative Optimal Control for Multiagent Systems on Directed Graphs: An Inverse Optimal Approach

In this paper, the inverse optimal approach is employed to design distributed consensus protocols that guarantee consensus and global optimality with respect to some quadratic performance indexes for identical linear systems on a directed graph. The inverse optimal theory is developed by introducing the notion of partial stability. As a result, the necessary and sufficient conditions for inverse optimality are proposed. By means of the developed inverse optimal theory, the necessary and sufficient conditions are established for globally optimal cooperative control problems on directed graphs. Basic optimal cooperative design procedures are given based on asymptotic properties of the resulting optimal distributed consensus protocols, and the multiagent systems can reach desired consensus performance (convergence rate and damping rate) asymptotically. Finally, two examples are given to illustrate the effectiveness of the proposed methods.

[1]  Wenjie Dong,et al.  Distributed optimal control of multiple systems , 2010, Int. J. Control.

[2]  Xin Zhang,et al.  Data-Driven Robust Approximate Optimal Tracking Control for Unknown General Nonlinear Systems Using Adaptive Dynamic Programming Method , 2011, IEEE Transactions on Neural Networks.

[3]  G. Stein,et al.  Quadratic weights for asymptotic regulator properties , 1977, 1977 IEEE Conference on Decision and Control including the 16th Symposium on Adaptive Processes and A Special Symposium on Fuzzy Set Theory and Applications.

[4]  Li Qiu,et al.  Best Achievable Tracking Performance in Sampled-Data Systems via LTI Controllers , 2008, IEEE Transactions on Automatic Control.

[5]  Yongcan Cao,et al.  Optimal Linear-Consensus Algorithms: An LQR Perspective , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[6]  R. E. Kalman,et al.  When Is a Linear Control System Optimal , 1964 .

[7]  T. Fujii,et al.  A new approach to the LQ design from the viewpoint of the inverse regulator problem , 1987 .

[8]  Yongming Li,et al.  Observer-Based Adaptive Decentralized Fuzzy Fault-Tolerant Control of Nonlinear Large-Scale Systems With Actuator Failures , 2014, IEEE Transactions on Fuzzy Systems.

[9]  Randal W. Beard,et al.  Information Consensus in Multivehicle Control , 2007 .

[10]  Beibei Ren,et al.  Synchronized altitude tracking control of multiple unmanned helicopters , 2010, Proceedings of the 2010 American Control Conference.

[11]  Shaocheng Tong,et al.  Observer-Based Adaptive Fuzzy Backstepping Control for a Class of Stochastic Nonlinear Strict-Feedback Systems , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[12]  D. Bernstein,et al.  Controller design with regional pole constraints , 1992 .

[13]  Shuzhi Sam Ge,et al.  Synchronized tracking control of multi-agent system with limited information , 2010, 49th IEEE Conference on Decision and Control (CDC).

[14]  Shaocheng Tong,et al.  Adaptive Fuzzy Output Feedback Tracking Backstepping Control of Strict-Feedback Nonlinear Systems With Unknown Dead Zones , 2012, IEEE Transactions on Fuzzy Systems.

[15]  Shinji Hara,et al.  Sum-of-Squares Decomposition via Generalized KYP Lemma , 2009, IEEE Transactions on Automatic Control.

[16]  Huaguang Zhang,et al.  Output regulation of state-coupled linear multi-agent systems with globally reachable topologies , 2014, Neurocomputing.

[17]  A. Jameson,et al.  Inverse Problem of Linear Optimal Control , 1973 .

[18]  Frank L. Lewis,et al.  Lyapunov, Adaptive, and Optimal Design Techniques for Cooperative Systems on Directed Communication Graphs , 2012, IEEE Transactions on Industrial Electronics.

[19]  Frank L. Lewis,et al.  Optimal Design for Synchronization of Cooperative Systems: State Feedback, Observer and Output Feedback , 2011, IEEE Transactions on Automatic Control.

[20]  Jean-Jacques E. Slotine,et al.  A theoretical study of different leader roles in networks , 2006, IEEE Transactions on Automatic Control.

[21]  Vadim I. Utkin,et al.  A singular perturbation analysis of high-gain feedback systems , 1977 .

[22]  Frank L. Lewis,et al.  Optimal Control: Lewis/Optimal Control 3e , 2012 .

[23]  William B. Dunbar,et al.  Distributed receding horizon control for multi-vehicle formation stabilization , 2006, Autom..

[24]  Richard M. Murray,et al.  INFORMATION FLOW AND COOPERATIVE CONTROL OF VEHICLE FORMATIONS , 2002 .

[25]  Guanrong Chen,et al.  Pinning control of scale-free dynamical networks , 2002 .

[26]  Frank L. Lewis,et al.  Multi-agent differential graphical games , 2011, Proceedings of the 30th Chinese Control Conference.

[27]  Frank L. Lewis,et al.  Cooperative Optimal Control for Multi-Agent Systems on Directed Graph Topologies , 2014, IEEE Transactions on Automatic Control.

[28]  Shinji Hara,et al.  Eigenvector-based characterization for hierarchical multi-agent dynamical systems with low rank interconnection , 2010, 2010 IEEE International Conference on Control Applications.

[29]  Huaguang Zhang,et al.  Leader-Based Optimal Coordination Control for the Consensus Problem of Multiagent Differential Games via Fuzzy Adaptive Dynamic Programming , 2015, IEEE Transactions on Fuzzy Systems.

[30]  Ligang Wu,et al.  Sensor Networks With Random Link Failures: Distributed Filtering for T–S Fuzzy Systems , 2013, IEEE Transactions on Industrial Informatics.

[31]  Francesco Borrelli,et al.  Distributed LQR Design for Identical Dynamically Decoupled Systems , 2008, IEEE Transactions on Automatic Control.

[32]  Masahiro Kaneda,et al.  Reduced-order proper H∞ controllers for descriptor systems: Existence conditions and LMI-based design algorithms , 2008, 2007 46th IEEE Conference on Decision and Control.

[33]  Shinji Hara,et al.  Consensus in hierarchical multi-agent dynamical systems with low-rank interconnections: Analysis of stability and convergence rates , 2009, 2009 American Control Conference.

[34]  Lin Huang,et al.  Consensus of Multiagent Systems and Synchronization of Complex Networks: A Unified Viewpoint , 2016, IEEE Transactions on Circuits and Systems I: Regular Papers.

[35]  Derong Liu,et al.  Adaptive Dynamic Programming for Control: Algorithms and Stability , 2012 .

[36]  Jun Zhao,et al.  Cooperative Adaptive Fuzzy Tracking Control for Networked Unknown Nonlinear Multiagent Systems With Time-Varying Actuator Faults , 2014, IEEE Transactions on Fuzzy Systems.

[37]  Zhihua Qu,et al.  Inverse optimality of cooperative control for networked systems , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[38]  Reza Olfati-Saber,et al.  Flocking for multi-agent dynamic systems: algorithms and theory , 2006, IEEE Transactions on Automatic Control.

[39]  Kevin L. Moore,et al.  High-Order and Model Reference Consensus Algorithms in Cooperative Control of MultiVehicle Systems , 2007 .

[40]  Shaocheng Tong,et al.  Adaptive Fuzzy Output Feedback Control of MIMO Nonlinear Systems With Unknown Dead-Zone Inputs , 2013, IEEE Transactions on Fuzzy Systems.

[41]  E.M. Atkins,et al.  A survey of consensus problems in multi-agent coordination , 2005, Proceedings of the 2005, American Control Conference, 2005..

[42]  Wei Ren,et al.  Information consensus in multivehicle cooperative control , 2007, IEEE Control Systems.