Excitation Conditions for Uniform Exponential Stability of the Cooperative Gradient Algorithm Over Weakly Connected Digraphs

In this letter, we study the problem of robust adaptive parameter estimation over networks with persistently exciting (PE) nodes and cooperative estimation dynamics. For this problem, it is well known that for networks characterized by undirected connected graphs, the property of uniform exponential stability (UES) can be established under a cooperative PE condition that relaxes the standard individual PE assumptions traditionally used in adaptive control. However, it is an open question whether similar cooperative PE conditions can also be used in general directed graphs. We provide an answer to this question by characterizing a generalized cooperative PE condition that is proved to be necessary and sufficient for UES in cooperative gradient dynamics evolving over arbitrary weakly connected digraphs. We also derive a similar generalized cooperative data-based condition for distributed learning dynamics that use recorded data instead of persistently exciting signals. We further present numerical experiments that study the rates of convergence of the dynamics.

[1]  Tamer Basar,et al.  Controllability of Formations Over Directed Time-Varying Graphs , 2017, IEEE Transactions on Control of Network Systems.

[2]  Kyriakos G. Vamvoudakis,et al.  Data‐enabled extremum seeking: A cooperative concurrent learning‐based approach , 2020, International Journal of Adaptive Control and Signal Processing.

[3]  Brian D. O. Anderson,et al.  Convergence and State Reconstruction of Time-Varying Multi-Agent Systems From Complete Observability Theory , 2017, IEEE Transactions on Automatic Control.

[4]  Girish Chowdhary,et al.  Concurrent learning adaptive control of linear systems with exponentially convergent bounds , 2013 .

[5]  Frank L. Lewis,et al.  Adaptive Tracking Control of Cooperative Robot Manipulators With Markovian Switched Couplings , 2021, IEEE Transactions on Industrial Electronics.

[6]  Richard M. Murray,et al.  Collaborative system identification via parameter consensus , 2014, 2014 American Control Conference.

[7]  S. Sastry,et al.  Adaptive Control: Stability, Convergence and Robustness , 1989 .

[8]  C. Wu Synchronization in networks of nonlinear dynamical systems coupled via a directed graph , 2005 .

[9]  Antonio Loría,et al.  Decentralized synchronization of time-varying oscillators under time-varying bidirectional graphs , 2019, 2019 American Control Conference (ACC).

[10]  Andrew R. Teel,et al.  Hybrid online learning control in networked multiagent systems: A survey , 2019 .

[11]  Anuradha M. Annaswamy,et al.  Robust Adaptive Control , 1984, 1984 American Control Conference.

[12]  Changyin Sun,et al.  Distributed Cooperative Adaptive Identification and Control for a Group of Continuous-Time Systems With a Cooperative PE Condition via Consensus , 2014, IEEE Transactions on Automatic Control.

[13]  Warren E. Dixon,et al.  Concurrent learning-based approximate feedback-Nash equilibrium solution of N-player nonzero-sum differential games , 2013, IEEE/CAA Journal of Automatica Sinica.

[14]  Laurent Praly,et al.  Convergence of the gradient algorithm for linear regression models in the continuous and discrete time cases , 2017 .

[15]  A. R. Meenakshi,et al.  On a product of positive semidefinite matrices , 1999 .

[16]  Antonio Loría,et al.  Relaxed persistency of excitation for uniform asymptotic stability , 2001, IEEE Trans. Autom. Control..

[17]  Anuradha M. Annaswamy,et al.  Convergence Properties of Adaptive Systems and the Definition of Exponential Stability , 2015, SIAM J. Control. Optim..

[18]  Antonio Loría,et al.  Synchronization and Dynamic Consensus of Heterogeneous Networked Systems , 2017, IEEE Transactions on Automatic Control.

[19]  Antonio Loría,et al.  Formation-Tracking Control of Autonomous Vehicles Under Relaxed Persistency of Excitation Conditions , 2018, IEEE Transactions on Control Systems Technology.

[20]  Z. Qu,et al.  Cooperative Control of Dynamical Systems: Applications to Autonomous Vehicles , 2009 .